# guotong1988/BERT-pre-training

<https://repo.masters-masters.com/en/repos/guotong1988/BERT-pre-training>

[Home](https://repo.masters-masters.com/en) › [guotong1988](https://repo.masters-masters.com/en/owners/guotong1988) › [BERT-pre-training](https://repo.masters-masters.com/en/repos/guotong1988/BERT-pre-training)

guotong1988/BERT-pre-training has 171 stars on GitHub. Its RepoMasters card: Prototype tier. multi-gpu pre-training in one machine for BERT without horovod…

| Field | Value |
| --- | --- |
| Owner | [guotong1988](https://repo.masters-masters.com/en/owners/guotong1988) |
| Stars | 171 |
| Forks | 52 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2018 |
| Topics | tensorflow, bert, nlp, multi-gpu |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [guotong1988/BERT-pre-training](https://github.com/guotong1988/BERT-pre-training) |

## Repository

multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by guotong1988

- [guotong1988/chinese\_dictionary · ★ 541 · Alpha](https://repo.masters-masters.com/en/repos/guotong1988/chinese_dictionary)
- [guotong1988/NL2SQL-RULE · ★ 194 · Python · Prototype](https://repo.masters-masters.com/en/repos/guotong1988/NL2SQL-RULE)

## Nearby in Python

- [kipperacademy/skillpper · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/kipperacademy/skillpper)
- [vrgamegirl19/VRGDG-SeedVR2-TensorRT-Studio · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/vrgamegirl19/VRGDG-SeedVR2-TensorRT-Studio)
- [thu-nics/AKV · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/thu-nics/AKV)
- [jgoerzen/pygopherd · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/jgoerzen/pygopherd)
- [etsy/nagios\_tools · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/etsy/nagios_tools)
- [guanqun/git-punchcard-plot · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/guanqun/git-punchcard-plot)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.