# fkodom/yet-another-retnet

<https://repo.masters-masters.com/en/repos/fkodom/yet-another-retnet>

[Home](https://repo.masters-masters.com/en) › [fkodom](https://repo.masters-masters.com/en/owners/fkodom) › [yet-another-retnet](https://repo.masters-masters.com/en/repos/fkodom/yet-another-retnet)

fkodom/yet-another-retnet has 105 stars on GitHub. Its RepoMasters card: Prototype tier. A simple but robust PyTorch implementation of RetNet from "Retentive…

| Field | Value |
| --- | --- |
| Owner | [fkodom](https://repo.masters-masters.com/en/owners/fkodom) |
| Stars | 105 |
| Forks | 17 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | deep-learning, llms, machine-learning, natural-language-processing, neural-networks, python, pytorch |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [fkodom/yet-another-retnet](https://github.com/fkodom/yet-another-retnet) |

## Repository

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by fkodom

- [fkodom/fft-conv-pytorch · ★ 524 · Python · Alpha](https://repo.masters-masters.com/en/repos/fkodom/fft-conv-pytorch)
- [fkodom/grouped-query-attention-pytorch · ★ 196 · Python · Prototype](https://repo.masters-masters.com/en/repos/fkodom/grouped-query-attention-pytorch)
- [fkodom/clip-text-decoder · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/fkodom/clip-text-decoder)

## Nearby in Python

- [ozguradmin/ahenk-turkish-tts · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/ozguradmin/ahenk-turkish-tts)
- [SuperBigFatDog/mcd-nearest-deal · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/SuperBigFatDog/mcd-nearest-deal)
- [Mosina1102/Moui · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/Mosina1102/Moui)
- [infogami/infogami · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/infogami/infogami)
- [lig/pystardict · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/lig/pystardict)
- [mattball/doxyclean · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/mattball/doxyclean)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.