AlphaUncommon
messkan/prompt-cache
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response
- Owner
- messkan (personal account)
- Stars
- Stars: 425
- Forks
- Forks: 43
- Language
- Go
- License
- MIT
- Created
- 2025
- Topics
- aibadgerdbcachecost-optimizationgollmmiddlewareopenaiperformancerag
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by messkan
All 2 repos by messkan- messkan/rag-chunkStars: 121PythonPrototype
Nearby in Go
All Go repos- JumpsecLabs/TokenSmithStars: 425GoAlpha
- Nomadcxx/sysc-greetStars: 425GoAlpha
- remoteoss/dexterStars: 425GoAlpha
- djimenez/iconv-goStars: 425GoAlpha
- firstrow/tcp_serverStars: 425GoAlpha
- gogo/letmegrpcStars: 425GoAlpha