# guolinke/TUPE

<https://repo.masters-masters.com/en/repos/guolinke/TUPE>

[Home](https://repo.masters-masters.com/en) › [guolinke](https://repo.masters-masters.com/en/owners/guolinke) › [TUPE](https://repo.masters-masters.com/en/repos/guolinke/TUPE)

guolinke/TUPE has 250 stars on GitHub. Its RepoMasters card: Alpha tier. Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking…

| Field | Value |
| --- | --- |
| Owner | [guolinke](https://repo.masters-masters.com/en/owners/guolinke) |
| Stars | 250 |
| Forks | 27 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2020 |
| Topics | bert, pretraining, language-model, transformer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [guolinke/TUPE](https://github.com/guolinke/TUPE) |

## Repository

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by guolinke

- [guolinke/SphereAR · ★ 114 · Python · Prototype](https://repo.masters-masters.com/en/repos/guolinke/SphereAR)

## Nearby in Python

- [skylartaylor/gbos-vm · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/skylartaylor/gbos-vm)
- [ryan-bergio03h1/Instagram-View-Booster-Free-Reel-Story-Views-Tool-2026 · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/ryan-bergio03h1/Instagram-View-Booster-Free-Reel-Story-Views-Tool-2026)
- [JuneYaooo/rea-video · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/JuneYaooo/rea-video)
- [alex/django-ajax-validation · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/alex/django-ajax-validation)
- [bbangert/velruse · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/bbangert/velruse)
- [Cue/fast-python-pb · ★ 250 · Python · Alpha](https://repo.masters-masters.com/en/repos/Cue/fast-python-pb)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.