# AviSoori1x/makeMoE

<https://repo.masters-masters.com/en/repos/AviSoori1x/makeMoE>

[Home](https://repo.masters-masters.com/en) › [AviSoori1x](https://repo.masters-masters.com/en/owners/AviSoori1x) › [makeMoE](https://repo.masters-masters.com/en/repos/AviSoori1x/makeMoE)

AviSoori1x/makeMoE has 820 stars on GitHub. Its RepoMasters card: Beta tier. From scratch implementation of a sparse mixture of experts language model…

| Field | Value |
| --- | --- |
| Owner | [AviSoori1x](https://repo.masters-masters.com/en/owners/AviSoori1x) |
| Stars | 820 |
| Forks | 96 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | MIT |
| Created | 2024 |
| Topics | large-language-models, llm, mixture-of-experts, deep-learning, neural-networks, pytorch, pytorch-implementation |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [AviSoori1x/makeMoE](https://github.com/AviSoori1x/makeMoE) |

## Repository

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by AviSoori1x

- [AviSoori1x/seemore · ★ 262 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/AviSoori1x/seemore)

## Nearby in Jupyter Notebook

- [mitmath/julia-mit · ★ 821 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/mitmath/julia-mit)
- [yangyutu/EssentialMath · ★ 821 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/yangyutu/EssentialMath)
- [xuwenhao/geektime-ai-course · ★ 821 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/xuwenhao/geektime-ai-course)
- [marcotcr/anchor · ★ 819 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/marcotcr/anchor)
- [NeuromatchAcademy/course-content-dl · ★ 819 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/NeuromatchAcademy/course-content-dl)
- [MizuhoAOKI/python\_simple\_mppi · ★ 819 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/MizuhoAOKI/python_simple_mppi)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.