BetaRare
istresearch/scrapy-cluster
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Archived: this repository is read-only
- Owner
- istresearch (organization)
- Stars
- Stars: 1,223
- Forks
- Forks: 316
- Language
- Python
- License
- MIT
- Created
- 2015
- Topics
- pythonscrapykafkaredisscrapingdistributed
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- FunnyWolf/agentic-soc-platformStars: 1,223PythonBeta
- SalesforceAIResearch/enterprise-deep-researchStars: 1,223PythonBeta
- ant-research/AntOmniEvoStars: 1,223PythonBeta
- SublimeText/OrigamiStars: 1,223PythonBeta
- compdemocracy/polisStars: 1,223PythonBeta
- hunkim/deep_architecture_genealogyStars: 1,223PythonBeta