Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

PrototypeCommon

ling0322/libllm

A lightweight vLLM-style inference engine in Rust

Owner: ling0322 (personal account)
Stars: Stars: 154
Forks: Forks: 7
Language: C++
License: MIT
Created: 2023
Topics: aicpplanguage-modelpythonllamallmrust
Tier: Prototype (100 to 249 ★) What this tier means

More repos by ling0322

All 2 repos by ling0322

ling0322/webdictStars: 349Alpha

Nearby in C++

M2noa/MCLCE-ArchiveStars: 154C++Prototype
effcol/wiz3DStars: 154C++Prototype
gminustwo/msr2dsStars: 154C++Prototype
RC1140/cr-gpgStars: 154C++Prototype
Shouqun/node-dbusStars: 154C++Prototype
ros-perception/image_commonStars: 154C++Prototype