# allenai/tpu\_pretrain

<https://repo.masters-masters.com/en/repos/allenai/tpu_pretrain>

[Home](https://repo.masters-masters.com/en) › [allenai](https://repo.masters-masters.com/en/owners/allenai) › [tpu\_pretrain](https://repo.masters-masters.com/en/repos/allenai/tpu_pretrain)

allenai/tpu\_pretrain has 137 stars on GitHub. Its RepoMasters card: Prototype tier. LM Pretraining with PyTorch/TPU Language: Python.

| Field | Value |
| --- | --- |
| Owner | [allenai](https://repo.masters-masters.com/en/owners/allenai) |
| Stars | 137 |
| Forks | 12 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2019 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [allenai/tpu\_pretrain](https://github.com/allenai/tpu_pretrain) |

## Repository

LM Pretraining with PyTorch/TPU

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by allenai

- [allenai/olmocr · ★ 19,814 · Python · Stable](https://repo.masters-masters.com/en/repos/allenai/olmocr)
- [allenai/allennlp · ★ 11,883 · Python · Stable](https://repo.masters-masters.com/en/repos/allenai/allennlp)
- [allenai/OLMo · ★ 6,728 · Python · Stable](https://repo.masters-masters.com/en/repos/allenai/OLMo)
- [allenai/open-instruct · ★ 3,924 · Python · RC](https://repo.masters-masters.com/en/repos/allenai/open-instruct)
- [allenai/RL4LMs · ★ 2,400 · Python · RC](https://repo.masters-masters.com/en/repos/allenai/RL4LMs)
- [allenai/longformer · ★ 2,208 · Python · RC](https://repo.masters-masters.com/en/repos/allenai/longformer)

## Nearby in Python

- [Esmerubphire/astrbot\_plugin\_feiyu\_voice · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/Esmerubphire/astrbot_plugin_feiyu_voice)
- [sanjayadanushka712/TaskFlow · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/sanjayadanushka712/TaskFlow)
- [Mayzmei/anime-series-maker · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/Mayzmei/anime-series-maker)
- [svetlyak40wt/django-tagging-ng · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/svetlyak40wt/django-tagging-ng)
- [dayorbyte/MongoAlchemy · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/dayorbyte/MongoAlchemy)
- [seantis/seantis-questionnaire · ★ 137 · Python · Prototype](https://repo.masters-masters.com/en/repos/seantis/seantis-questionnaire)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.