# jxiw/BiGS

<https://repo.masters-masters.com/en/repos/jxiw/BiGS>

[Home](https://repo.masters-masters.com/en) › [jxiw](https://repo.masters-masters.com/en/owners/jxiw) › [BiGS](https://repo.masters-masters.com/en/repos/jxiw/BiGS)

jxiw/BiGS has 119 stars on GitHub. Its RepoMasters card: Prototype tier. Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model…

| Field | Value |
| --- | --- |
| Owner | [jxiw](https://repo.masters-masters.com/en/owners/jxiw) |
| Stars | 119 |
| Forks | 9 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [jxiw/BiGS](https://github.com/jxiw/BiGS) |

## Repository

Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE benchmark with subquadratic complexity in length (or without attention).

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by jxiw

- [jxiw/MambaInLlama · ★ 244 · Python · Prototype](https://repo.masters-masters.com/en/repos/jxiw/MambaInLlama)

## Nearby in Python

- [innayakendya/DraftTap · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/innayakendya/DraftTap)
- [BaoZ-XHG/MaiMen-Saver · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/BaoZ-XHG/MaiMen-Saver)
- [tian1326/mcd-coupon-assistant · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/tian1326/mcd-coupon-assistant)
- [rnk/django-media-bundler · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/rnk/django-media-bundler)
- [pnegre/python-whiteboard · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/pnegre/python-whiteboard)
- [powdahound/redis-collectd-plugin · ★ 119 · Python · Prototype](https://repo.masters-masters.com/en/repos/powdahound/redis-collectd-plugin)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.