# SimiaoZuo/MoEBERT

<https://repo.masters-masters.com/en/repos/SimiaoZuo/MoEBERT>

[Home](https://repo.masters-masters.com/en) › [SimiaoZuo](https://repo.masters-masters.com/en/owners/SimiaoZuo) › [MoEBERT](https://repo.masters-masters.com/en/repos/SimiaoZuo/MoEBERT)

SimiaoZuo/MoEBERT has 114 stars on GitHub. Its RepoMasters card: Prototype tier. This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via…

| Field | Value |
| --- | --- |
| Owner | [SimiaoZuo](https://repo.masters-masters.com/en/owners/SimiaoZuo) |
| Stars | 114 |
| Forks | 12 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2022 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [SimiaoZuo/MoEBERT](https://github.com/SimiaoZuo/MoEBERT) |

## Repository

This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by SimiaoZuo

- [SimiaoZuo/Transformer-Hawkes-Process · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/SimiaoZuo/Transformer-Hawkes-Process)

## Nearby in Python

- [dinosn/php-cve-2026-10961x-lab-poc · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/dinosn/php-cve-2026-10961x-lab-poc)
- [Toyaspio/maibot-baidu-search · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/Toyaspio/maibot-baidu-search)
- [CumulusAlpha/Dex-Supermimic · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/CumulusAlpha/Dex-Supermimic)
- [leah/django-elsewhere · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/leah/django-elsewhere)
- [fschulze/mr.developer · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/fschulze/mr.developer)
- [cloudkick/libcloud · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/cloudkick/libcloud)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.