# commoncrawl/commoncrawl-crawler

<https://repo.masters-masters.com/en/repos/commoncrawl/commoncrawl-crawler>

[Home](https://repo.masters-masters.com/en) › [commoncrawl](https://repo.masters-masters.com/en/owners/commoncrawl) › [commoncrawl-crawler](https://repo.masters-masters.com/en/repos/commoncrawl/commoncrawl-crawler)

commoncrawl/commoncrawl-crawler has 226 stars on GitHub. Its RepoMasters card: Prototype tier. The Common Crawl Crawler Engine and Related MapReduce code…

| Field | Value |
| --- | --- |
| Owner | [commoncrawl](https://repo.masters-masters.com/en/owners/commoncrawl) |
| Stars | 226 |
| Forks | 64 |
| Language | [Java](https://repo.masters-masters.com/en/languages/java) |
| License | GPL-3.0 |
| Created | 2012 |
| Topics | inactive, archived |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [commoncrawl/commoncrawl-crawler](https://github.com/commoncrawl/commoncrawl-crawler) |

## Repository

The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)

Archived: this repository is read-only

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by commoncrawl

- [commoncrawl/commoncrawl · ★ 507 · C++ · Alpha](https://repo.masters-masters.com/en/repos/commoncrawl/commoncrawl)
- [commoncrawl/cc-pyspark · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/commoncrawl/cc-pyspark)
- [commoncrawl/news-crawl · ★ 383 · Java · Alpha](https://repo.masters-masters.com/en/repos/commoncrawl/news-crawl)
- [commoncrawl/cc-crawl-statistics · ★ 233 · HTML · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cc-crawl-statistics)
- [commoncrawl/cdx\_toolkit · ★ 220 · Python · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cdx_toolkit)
- [commoncrawl/cc-index-table · ★ 132 · Java · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cc-index-table)

## Nearby in Java

- [odrotbohm/arch-evident-spring · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/odrotbohm/arch-evident-spring)
- [WJX20/dataCompare · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/WJX20/dataCompare)
- [zhaoyuxiangyyds-lab/AnyDoor · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/zhaoyuxiangyyds-lab/AnyDoor)
- [tonyg/reversehttp · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/tonyg/reversehttp)
- [m2ym/rsense · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/m2ym/rsense)
- [jenkinsci/trilead-ssh2 · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/jenkinsci/trilead-ssh2)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.