Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

modelscope/dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.

Owner
modelscope (organization)
Stars
Stars: 272
Forks
Forks: 29
Language
C
License
Apache-2.0
Created
2024
Topics
cpullmllm-inferencenative-enginecudaguided-decoding
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by modelscope

All 35 repos by modelscope

Nearby in C

All C repos