BetaRare
AviSoori1x/makeMoE
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
- Owner
- AviSoori1x (personal account)
- Stars
- Stars: 820
- Forks
- Forks: 96
- Language
- Jupyter Notebook
- License
- MIT
- Created
- 2024
- Topics
- large-language-modelsllmmixture-of-expertsdeep-learningneural-networkspytorchpytorch-implementation
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by AviSoori1x
All 2 repos by AviSoori1x- AviSoori1x/seemoreStars: 262Jupyter NotebookAlpha
Nearby in Jupyter Notebook
All Jupyter Notebook repos- yangyutu/EssentialMathStars: 821Jupyter NotebookBeta
- xuwenhao/geektime-ai-courseStars: 821Jupyter NotebookBeta
- mitmath/julia-mitStars: 820Jupyter NotebookBeta
- marcotcr/anchorStars: 819Jupyter NotebookBeta
- MizuhoAOKI/python_simple_mppiStars: 819Jupyter NotebookBeta
- Wasim37/deeplearning-assignmentStars: 818Jupyter NotebookBeta