thushan/olla
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
0Active
On the radar — signal detected
Stars
191
Forks
22
Contributors
4
Language
Go
Score updated Apr 12, 2026
// SUBSCRIBE
The repos that moved this week, why they matter, and what to watch next. One email. No noise.