PrototypeCommon
AnswerDotAI/cold-compress
Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.
- Owner
- AnswerDotAI (organization)
- Stars
- Stars: 153
- Forks
- Forks: 16
- Language
- Python
- License
- BSD-3-Clause
- Created
- 2024
- Topics
- inferencellmllm-inferencenlpopen-source
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by AnswerDotAI
All 25 repos by AnswerDotAI- AnswerDotAI/fasthtmlStars: 7,061Jupyter NotebookStable
- AnswerDotAI/nbdevStars: 5,323Jupyter NotebookStable
- AnswerDotAI/gpu.cppStars: 3,993C++RC
- AnswerDotAI/RAGatouilleStars: 3,973PythonRC
- AnswerDotAI/llms-txtStars: 2,671Jupyter NotebookRC
- AnswerDotAI/ModernBERTStars: 1,776PythonBeta
Nearby in Python
All Python repos- Yharnam-Hunters/PalebloodStars: 153PythonPrototype
- bertel2020/HA-HousekeeperStars: 153PythonPrototype
- semrincaballero/Polymarket-Prediction-BotStars: 153PythonPrototype
- heynemann/pynqStars: 153PythonPrototype
- deepthawtz/fakerStars: 153PythonPrototype
- softlayer/softlayer-pythonStars: 153PythonPrototype