AlphaUncommon
foundation-model-stack/fms-fsdp
🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
- Owner
- foundation-model-stack (organization)
- Stars
- Stars: 289
- Forks
- Forks: 47
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- distributed-trainingllmpytorch
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by foundation-model-stack
All 4 repos by foundation-model-stack- foundation-model-stack/foundation-model-stackStars: 234PythonPrototype
- foundation-model-stack/fastsafetensorsStars: 181PythonPrototype
- foundation-model-stack/bambaStars: 140PythonPrototype
Nearby in Python
All Python repos- techjanitor/botmakerStars: 289PythonAlpha
- ZhFkl/resumeworkflowStars: 289PythonAlpha
- NandhaKishorM/vegamlStars: 289PythonAlpha
- seomoz/pyreBloomStars: 289PythonAlpha
- chikatoike/IMESupportStars: 289PythonAlpha
- mediacloud/backendStars: 289PythonAlpha