PrototypeCommon
kingoflolz/swarm-jax
Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
- Owner
- kingoflolz (personal account)
- Stars
- Stars: 241
- Forks
- Forks: 22
- Language
- Python
- License
- None
- Created
- 2020
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by kingoflolz
All 2 repos by kingoflolz- kingoflolz/mesh-transformer-jaxStars: 6,390PythonStable
Nearby in Python
All Python repos- Razdva122/clean-your-tv-lg-webosStars: 241PythonPrototype
- Cattmonkey/ChaosIntelligenceStars: 241PythonPrototype
- phuryn/product-engineeringStars: 241PythonPrototype
- rupa/j2Stars: 241PythonPrototype
- bitly/bitly-api-pythonStars: 241PythonPrototype
- plex-unofficial/PornHub.bundleStars: 241PythonPrototype