Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

NVIDIA/Star-Attention

Efficient LLM Inference over Long Sequences

Owner
NVIDIA (organization)
Stars
Stars: 392
Forks
Forks: 24
Language
Python
License
Apache-2.0
Created
2024
Topics
attention-mechanismlarge-language-modelsllm-inference
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by NVIDIA

All 269 repos by NVIDIA

Nearby in Python

All Python repos