# keyu-tian/SparK

<https://repo.masters-masters.com/en/repos/keyu-tian/SparK>

[Home](https://repo.masters-masters.com/en) › [keyu-tian](https://repo.masters-masters.com/en/owners/keyu-tian) › [SparK](https://repo.masters-masters.com/en/repos/keyu-tian/SparK)

keyu-tian/SparK has 1,384 stars on GitHub. Its RepoMasters card: Beta tier. \[ICLR'23 Spotlight🔥\] The first successful BERT/MAE-style pretraining on any…

| Field | Value |
| --- | --- |
| Owner | [keyu-tian](https://repo.masters-masters.com/en/owners/keyu-tian) |
| Stars | 1,384 |
| Forks | 86 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | bert, convnet, convolutional-neural-networks, masked-image-modeling, pre-trained-model, self-supervised-learning, sparse-convolution, ssl, cnn, iclr |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [keyu-tian/SparK](https://github.com/keyu-tian/SparK) |

## Repository

\[ICLR'23 Spotlight🔥\] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [bytedance/music\_source\_separation · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/bytedance/music_source_separation)
- [victordibia/designing-multiagent-systems · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/victordibia/designing-multiagent-systems)
- [FireRedTeam/FireRed-Image-Edit · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/FireRedTeam/FireRed-Image-Edit)
- [dthpham/sminterpolate · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/dthpham/sminterpolate)
- [liriansu-opus/chinese-calendar · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/liriansu-opus/chinese-calendar)
- [jachinlin/geektime\_dl · ★ 1,384 · Python · Beta](https://repo.masters-masters.com/en/repos/jachinlin/geektime_dl)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.