# pjlab-sys4nlp/llama-moe

<https://repo.masters-masters.com/en/repos/pjlab-sys4nlp/llama-moe>

[Home](https://repo.masters-masters.com/en) › [pjlab-sys4nlp](https://repo.masters-masters.com/en/owners/pjlab-sys4nlp) › [llama-moe](https://repo.masters-masters.com/en/repos/pjlab-sys4nlp/llama-moe)

pjlab-sys4nlp/llama-moe has 1,004 stars on GitHub. Its RepoMasters card: Beta tier. ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual…

| Field | Value |
| --- | --- |
| Owner | [pjlab-sys4nlp](https://repo.masters-masters.com/en/owners/pjlab-sys4nlp) |
| Stars | 1,004 |
| Forks | 60 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | llama, llm, mixture-of-experts, moe, continual-pre-training, expert-partition |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [pjlab-sys4nlp/llama-moe](https://github.com/pjlab-sys4nlp/llama-moe) |

## Repository

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [cenglin123/SteganographierGUI · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/cenglin123/SteganographierGUI)
- [lmgame-org/GamingAgent · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/lmgame-org/GamingAgent)
- [browser-use/macos-harness · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/browser-use/macos-harness)
- [wakatime/legacy-python-cli · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/wakatime/legacy-python-cli)
- [blaze/odo · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/blaze/odo)
- [coreylynch/async-rl · ★ 1,004 · Python · Beta](https://repo.masters-masters.com/en/repos/coreylynch/async-rl)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.