GenPark Token Bucket Traffic Shaper runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 24 Oct 2026.
Token bucket traffic shaper with smooth replenishment and burst capacity for LLM tool call throttlin
Today is the operative word: we check GenPark Token Bucket Traffic Shaper every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
Adaptive multi-tier TPM/RPM rate limiter with smooth leaky bucket queuing and burst wait estimation
Nginx-style smooth weighted round-robin load balancer with dynamic weight adjustment for multi-LLM r
Multi-model LLM token cost budget ledger and burn rate forecaster enforcing spending limits and earl
Find retiring LLM calls in code and test the replacement model on real traffic before switching.
Context GC for LLM agents: offload large tool outputs and recall them to save tokens.
Servers for agents, rented by the month: Linux with root and a public IPv4. Pay per call.
Apache Camel API Gateway with REST-to-MCP bridging for LLM agents.
Full jitter exponential backoff retry scheduling and half-open circuit breaker for LLM APIs
Answers built from our own checks of this server.