BetaRare
pjlab-sys4nlp/llama-moe
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
- Owner
- pjlab-sys4nlp (organization)
- Stars
- Stars: 1,004
- Forks
- Forks: 60
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- llamallmmixture-of-expertsmoecontinual-pre-trainingexpert-partition
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- cenglin123/SteganographierGUIStars: 1,004PythonBeta
- lmgame-org/GamingAgentStars: 1,004PythonBeta
- browser-use/macos-harnessStars: 1,004PythonBeta
- wakatime/legacy-python-cliStars: 1,004PythonBeta
- blaze/odoStars: 1,004PythonBeta
- coreylynch/async-rlStars: 1,004PythonBeta