Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

keyu-tian/SparK

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

Owner
keyu-tian (personal account)
Stars
Stars: 1,384
Forks
Forks: 86
Language
Python
License
MIT
Created
2023
Topics
bertconvnetconvolutional-neural-networksmasked-image-modelingpre-trained-modelself-supervised-learningsparse-convolutionsslcnniclr
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos