# TurboWay/spiderman

<https://repo.masters-masters.com/en/repos/TurboWay/spiderman>

[Home](https://repo.masters-masters.com/en) › [TurboWay](https://repo.masters-masters.com/en/owners/TurboWay) › [spiderman](https://repo.masters-masters.com/en/repos/TurboWay/spiderman)

TurboWay/spiderman has 613 stars on GitHub. Its RepoMasters card: Alpha tier. 基于 scrapy-redis 的通用分布式爬虫框架 Language: Python.

| Field | Value |
| --- | --- |
| Owner | [TurboWay](https://repo.masters-masters.com/en/owners/TurboWay) |
| Stars | 613 |
| Forks | 124 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2020 |
| Topics | spiderman, scapy-redis, kafka, hive, hbase, rdbm, scrapy |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [TurboWay/spiderman](https://github.com/TurboWay/spiderman) |

## Repository

基于 scrapy-redis 的通用分布式爬虫框架

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by TurboWay

- [TurboWay/bigdata\_analyse · ★ 5,456 · Python · Stable](https://repo.masters-masters.com/en/repos/TurboWay/bigdata_analyse)
- [TurboWay/big\_screen · ★ 1,884 · HTML · Beta](https://repo.masters-masters.com/en/repos/TurboWay/big_screen)
- [TurboWay/bigdata\_practice · ★ 275 · Python · Alpha](https://repo.masters-masters.com/en/repos/TurboWay/bigdata_practice)

## Nearby in Python

- [ShaohonChen/Qwen3-SmVL · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/ShaohonChen/Qwen3-SmVL)
- [facebookresearch/drzero · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/facebookresearch/drzero)
- [HojoAI/Hojo-TTS-Light · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/HojoAI/Hojo-TTS-Light)
- [Pythonity/font-awesome-to-png · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/Pythonity/font-awesome-to-png)
- [basak/glacier-cli · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/basak/glacier-cli)
- [tegg89/SRCNN-Tensorflow · ★ 613 · Python · Alpha](https://repo.masters-masters.com/en/repos/tegg89/SRCNN-Tensorflow)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.