Illustration: the project’s public image, pixelated by RepoMasters. Credits
RCEpic

Luce-Org/lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Owner
Luce-Org (organization)
Stars
Stars: 2,969
Forks
Forks: 285
Language
C++
License
Apache-2.0
Created
2026
Topics
kernelllama-cpplocal-aiqwenrtx3090megakernelcudacuda-kernelsdflashluce
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

Nearby in C++

All C++ repos