Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
RCEpic

dvmazur/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Owner
dvmazur (personal account)
Stars
Stars: 2,334
Forks
Forks: 226
Language
Python
License
MIT
Created
2023
Topics
colab-notebookdeep-learninggoogle-colablanguage-modelllmmixture-of-expertsoffloadingpytorchquantization
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos