Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

vipshop/ffpa-attn

Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.

Owner
vipshop (organization)
Stars
Stars: 346
Forks
Forks: 29
Language
Python
License
Apache-2.0
Created
2024
Topics
flash-attentionfp4fp8sage-attention
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by vipshop

All 12 repos by vipshop

Nearby in Python

All Python repos