# NikolaiT/Crawling-Infrastructure

<https://repo.masters-masters.com/en/repos/NikolaiT/Crawling-Infrastructure>

[Home](https://repo.masters-masters.com/en) › [NikolaiT](https://repo.masters-masters.com/en/owners/NikolaiT) › [Crawling-Infrastructure](https://repo.masters-masters.com/en/repos/NikolaiT/Crawling-Infrastructure)

NikolaiT/Crawling-Infrastructure has 438 stars on GitHub. Its RepoMasters card: Alpha tier. Distributed crawling infrastructure running on top of severless…

| Field | Value |
| --- | --- |
| Owner | [NikolaiT](https://repo.masters-masters.com/en/owners/NikolaiT) |
| Stars | 438 |
| Forks | 33 |
| Language | [TypeScript](https://repo.masters-masters.com/en/languages/typescript) |
| License | AGPL-3.0 |
| Created | 2020 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [NikolaiT/Crawling-Infrastructure](https://github.com/NikolaiT/Crawling-Infrastructure) |

## Repository

Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by NikolaiT

- [NikolaiT/GoogleScraper · ★ 2,892 · HTML · RC](https://repo.masters-masters.com/en/repos/NikolaiT/GoogleScraper)
- [NikolaiT/se-scraper · ★ 570 · HTML · Alpha](https://repo.masters-masters.com/en/repos/NikolaiT/se-scraper)
- [NikolaiT/zardaxt · ★ 451 · Python · Alpha](https://repo.masters-masters.com/en/repos/NikolaiT/zardaxt)
- [NikolaiT/stealthy-scraping-tools · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/NikolaiT/stealthy-scraping-tools)
- [NikolaiT/uncaptcha3 · ★ 165 · Python · Prototype](https://repo.masters-masters.com/en/repos/NikolaiT/uncaptcha3)
- [NikolaiT/IP-Address-API · ★ 119 · Prototype](https://repo.masters-masters.com/en/repos/NikolaiT/IP-Address-API)

## Nearby in TypeScript

- [SehajveerSingh2005/bloom · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/SehajveerSingh2005/bloom)
- [bridge-mind/bridgeclip · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/bridge-mind/bridgeclip)
- [iam567/rich4-renew-app · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/iam567/rich4-renew-app)
- [ember-intl/ember-intl · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/ember-intl/ember-intl)
- [bcherny/flow-to-typescript · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/bcherny/flow-to-typescript)
- [iamcco/diagnostic-languageserver · ★ 438 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/iamcco/diagnostic-languageserver)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.