# istresearch/scrapy-cluster

<https://repo.masters-masters.com/en/repos/istresearch/scrapy-cluster>

[Home](https://repo.masters-masters.com/en) › [istresearch](https://repo.masters-masters.com/en/owners/istresearch) › [scrapy-cluster](https://repo.masters-masters.com/en/repos/istresearch/scrapy-cluster)

istresearch/scrapy-cluster has 1,223 stars on GitHub. Its RepoMasters card: Beta tier. This Scrapy project uses Redis and Kafka to create a distributed on…

| Field | Value |
| --- | --- |
| Owner | [istresearch](https://repo.masters-masters.com/en/owners/istresearch) |
| Stars | 1,223 |
| Forks | 316 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2015 |
| Topics | python, scrapy, kafka, redis, scraping, distributed |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [istresearch/scrapy-cluster](https://github.com/istresearch/scrapy-cluster) |

## Repository

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Archived: this repository is read-only

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [FunnyWolf/agentic-soc-platform · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/FunnyWolf/agentic-soc-platform)
- [SalesforceAIResearch/enterprise-deep-research · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/SalesforceAIResearch/enterprise-deep-research)
- [ant-research/AntOmniEvo · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/ant-research/AntOmniEvo)
- [SublimeText/Origami · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/SublimeText/Origami)
- [compdemocracy/polis · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/compdemocracy/polis)
- [hunkim/deep\_architecture\_genealogy · ★ 1,223 · Python · Beta](https://repo.masters-masters.com/en/repos/hunkim/deep_architecture_genealogy)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.