Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

peva3/SmarterRouter

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

Owner
peva3 (personal account)
Stars
Stars: 155
Forks
Forks: 19
Language
Python
License
MIT
Created
2026
Topics
ai-gatewaydockerfastapigpu-monitoringllmllm-proxyllm-routerlocal-llmmodel-servingollama
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by peva3

All 2 repos by peva3

Nearby in Python

All Python repos