Generic async resource pool with rotation, cooldown, and retry
-
Updated
Jul 4, 2026 - Python
Generic async resource pool with rotation, cooldown, and retry
Turn free NVIDIA NIM API keys into one reliable OpenAI-compatible LLM gateway: key pool with round-robin, HTTP/SOCKS5 proxy rotation, auto retries & cooldowns, streaming chat UI and coder IDE agent. FastAPI + vanilla JS, self-hosted.
Add a description, image, and links to the api-key-pool topic page so that developers can more easily learn about it.
To associate your repository with the api-key-pool topic, visit your repo's landing page and select "manage topics."