# kingoflolz/swarm-jax

<https://repo.masters-masters.com/en/repos/kingoflolz/swarm-jax>

[Home](https://repo.masters-masters.com/en) › [kingoflolz](https://repo.masters-masters.com/en/owners/kingoflolz) › [swarm-jax](https://repo.masters-masters.com/en/repos/kingoflolz/swarm-jax)

kingoflolz/swarm-jax has 241 stars on GitHub. Its RepoMasters card: Prototype tier. Swarm training framework using Haiku + JAX + Ray for layer parallel…

| Field | Value |
| --- | --- |
| Owner | [kingoflolz](https://repo.masters-masters.com/en/owners/kingoflolz) |
| Stars | 241 |
| Forks | 22 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2020 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [kingoflolz/swarm-jax](https://github.com/kingoflolz/swarm-jax) |

## Repository

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by kingoflolz

- [kingoflolz/mesh-transformer-jax · ★ 6,390 · Python · Stable](https://repo.masters-masters.com/en/repos/kingoflolz/mesh-transformer-jax)

## Nearby in Python

- [Razdva122/clean-your-tv-lg-webos · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/Razdva122/clean-your-tv-lg-webos)
- [Cattmonkey/ChaosIntelligence · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/Cattmonkey/ChaosIntelligence)
- [phuryn/product-engineering · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/phuryn/product-engineering)
- [rupa/j2 · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/rupa/j2)
- [bitly/bitly-api-python · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/bitly/bitly-api-python)
- [plex-unofficial/PornHub.bundle · ★ 241 · Python · Prototype](https://repo.masters-masters.com/en/repos/plex-unofficial/PornHub.bundle)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.