PrototypeCommon
fkodom/yet-another-retnet
A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)
- Owner
- fkodom (personal account)
- Stars
- Stars: 105
- Forks
- Forks: 17
- Language
- Python
- License
- MIT
- Created
- 2023
- Topics
- deep-learningllmsmachine-learningnatural-language-processingneural-networkspythonpytorch
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by fkodom
All 4 repos by fkodom- fkodom/fft-conv-pytorchStars: 524PythonAlpha
- fkodom/grouped-query-attention-pytorchStars: 196PythonPrototype
- fkodom/clip-text-decoderStars: 119PythonPrototype
Nearby in Python
All Python repos- ozguradmin/ahenk-turkish-ttsStars: 105PythonPrototype
- h0ll0w-AkuZr0guY/MiaoTaskStars: 105PythonPrototype
- SuperBigFatDog/mcd-nearest-dealStars: 105PythonPrototype
- infogami/infogamiStars: 105PythonPrototype
- lig/pystardictStars: 105PythonPrototype
- mattball/doxycleanStars: 105PythonPrototype