Hermes Agent plugin for fail-closed, session-derived custom request headers across named local and OpenAI-compatible providers.
-
Updated
Jul 29, 2026 - Python
#
session-affinity
Here are 7 public repositories matching this topic...
该仓库用于记录解决基于 URL 查询参数（如 appid 和 roomid）的 WebSocket 请求路由与会话亲和性问题。通过合理配置和负载均衡策略，确保客户端在扩容和重连的情况下，能够始终连接到相同的 Pod，保持 WebSocket 会话的稳定性与一致性。
-
Updated
Dec 27, 2024
A Go microservice that routes tasks to workers while maintaining session affinity with retry mechanisms
-
Updated
Jul 3, 2026 - Go
Upstream-first downstream fork of OmniRoute for hard session-lifetime connection leases, continuity, and capacity-safe managed-provider routing.
oauth sqlite concurrency routing codex continuity ai-gateway session-affinity llm-gateway omniroute upstream-first session-lease
-
Updated
Aug 14, 2026 - TypeScript
Load Balancing Test: Example Shiny App
-
Updated
Jul 7, 2024 - JavaScript
One OpenAI-compatible endpoint in front of three vLLM replicas. Pins each conversation to the same GPU so its KV cache stays warm, sends cheap work to the small tier, and tracks token budgets per agent.
python portfolio prometheus load-balancing fastapi opentelemetry kv-cache rendezvous-hashing llmops llm-serving vllm session-affinity inference-gateway
-
Updated
Aug 10, 2026 - Python
Rotate Pi provider session-affinity IDs without losing local conversation history.
-
Updated
Jul 28, 2026 - TypeScript
Improve this page
Add a description, image, and links to the session-affinity topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the session-affinity topic, visit your repo's landing page and select "manage topics."