GIT_FEED

thushan/olla

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

View on GitHub
0Active

On the radar — signal detected

Stars
191
Forks
22
Contributors
4
Language
Go

Score updated Apr 12, 2026

// SUBSCRIBE

The repos that moved this week, why they matter, and what to watch next. One email. No noise.