AlphaUncommon
SkyworkAI/MoH
MoH: Multi-Head Attention as Mixture-of-Head Attention
- Owner
- SkyworkAI (organization)
- Stars
- Stars: 313
- Forks
- Forks: 14
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- attentionditllmsmixture-of-expertsmoetransformervit
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by SkyworkAI
All 23 repos by SkyworkAI- SkyworkAI/SkyReels-V2Stars: 7,754PythonStable
- SkyworkAI/DeepResearchAgentStars: 3,567PythonRC
- SkyworkAI/Skywork-R1VStars: 3,173PythonRC
- SkyworkAI/Matrix-GameStars: 2,822PythonRC
- SkyworkAI/SkyReels-V1Stars: 2,702PythonRC
- SkyworkAI/SkyworkStars: 1,500PythonBeta
Nearby in Python
All Python repos- www222fff/muse2apiStars: 313PythonAlpha
- songconmaisaix31-design/mcpetStars: 313PythonAlpha
- soimy/c3rb3r-rescueStars: 313PythonAlpha
- samluescher/django-form-designerStars: 313PythonAlpha
- jeffwidman/bitbucket-issue-migrationStars: 313PythonAlpha
- HoverHell/RedditImageGrabStars: 313PythonAlpha