owen/opencode-proxy
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Redis ratelimits

Browse Source
This commit is contained in:
owen
2026-07-21 15:55:32 -05:00
parent 571f3e9fd8
commit d59673e0c5
8 changed files with 290 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+6
View File
@@ -37,6 +37,12 @@ The global context limit defaults to 256k tokens and can be changed with `MAX_CO
Inference requests are limited per client IP to 2 requests per second, 100 requests per five hours, and $15 of reported upstream cost per five hours. Railway's `X-Real-IP` header is used to identify clients.
Set `REDIS_URL` to persist and share these limits across process restarts and multiple proxy instances. The Redis backend stores only the active five-hour window and uses atomic operations, so concurrent instances enforce one shared limit. Without `REDIS_URL`, limits remain in memory as before.
```sh
REDIS_URL=redis://localhost:6379
```
To exempt trusted clients from those proxy limits, set `UNLIMITED_API_KEYS` to a JSON array and have the client send a configured key using `Authorization: Bearer <key>` or `x-api-key`. These keys only bypass this proxy's rate and spend limits; they do not bypass upstream OpenCode Go limits.
```sh