Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

beehive-lab/jitllm

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs

Owner
beehive-lab (organization)
Stars
Stars: 294
Forks
Forks: 41
Language
Java
License
MIT
Created
2025
Topics
acceleratorscompilersgpujavajava21llama3nvidiatornadovmggufllm
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by beehive-lab

All 4 repos by beehive-lab

Nearby in Java

All Java repos