Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Owner
InternLM (organization)
Stars
Stars: 8,126
Forks
Forks: 772
Language
Python
License
Apache-2.0
Created
2023
Topics
cuda-kernelsdeepspeedfastertransformerllm-inferenceturbomindinternlmllamallmcodellamallama2
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by InternLM

All 26 repos by InternLM

Nearby in Python

All Python repos