# commoncrawl/cc-pyspark

<https://repo.masters-masters.com/en/repos/commoncrawl/cc-pyspark>

[Home](https://repo.masters-masters.com/en) › [commoncrawl](https://repo.masters-masters.com/en/owners/commoncrawl) › [cc-pyspark](https://repo.masters-masters.com/en/repos/commoncrawl/cc-pyspark)

commoncrawl/cc-pyspark has 459 stars on GitHub. Its RepoMasters card: Alpha tier. Process Common Crawl data with Python and Spark Language: Python.

| Field | Value |
| --- | --- |
| Owner | [commoncrawl](https://repo.masters-masters.com/en/owners/commoncrawl) |
| Stars | 459 |
| Forks | 98 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2017 |
| Topics | spark, warc-files, wet, commoncrawl, sparksql, pyspark, wat-files, common-crawl |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [commoncrawl/cc-pyspark](https://github.com/commoncrawl/cc-pyspark) |

## Repository

Process Common Crawl data with Python and Spark

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by commoncrawl

- [commoncrawl/commoncrawl · ★ 507 · C++ · Alpha](https://repo.masters-masters.com/en/repos/commoncrawl/commoncrawl)
- [commoncrawl/news-crawl · ★ 383 · Java · Alpha](https://repo.masters-masters.com/en/repos/commoncrawl/news-crawl)
- [commoncrawl/cc-crawl-statistics · ★ 233 · HTML · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cc-crawl-statistics)
- [commoncrawl/commoncrawl-crawler · ★ 226 · Java · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/commoncrawl-crawler)
- [commoncrawl/cdx\_toolkit · ★ 220 · Python · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cdx_toolkit)
- [commoncrawl/cc-index-table · ★ 132 · Java · Prototype](https://repo.masters-masters.com/en/repos/commoncrawl/cc-index-table)

## Nearby in Python

- [daydreamlive/scope · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/daydreamlive/scope)
- [waditu-tushare/skills · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/waditu-tushare/skills)
- [Anttwo/Surflo · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/Anttwo/Surflo)
- [miracle2k/flask-assets · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/miracle2k/flask-assets)
- [sinacloud/sae-python-dev-guide · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/sinacloud/sae-python-dev-guide)
- [Stiivi/bubbles · ★ 459 · Python · Alpha](https://repo.masters-masters.com/en/repos/Stiivi/bubbles)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.