PrototypeCommon
snu-comparch/InfiniGen
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
- Owner
- snu-comparch (organization)
- Stars
- Stars: 195
- Forks
- Forks: 40
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Tier
- Prototype (100 to 249 ★) What this tier means
Nearby in Python
All Python repos- suvamneog/jobradarStars: 195PythonPrototype
- lusouldepth-ai/FDE_LearningStars: 195PythonPrototype
- Seagey/couch-tvStars: 195PythonPrototype
- guilhermechapiewski/simple-db-migrateStars: 195PythonPrototype
- gak/pygooglechartStars: 195PythonPrototype
- saymedia/remoteobjectsStars: 195PythonPrototype