# wangy8961/python3-concurrency-pics-02

<https://repo.masters-masters.com/en/repos/wangy8961/python3-concurrency-pics-02>

[Home](https://repo.masters-masters.com/en) › [wangy8961](https://repo.masters-masters.com/en/owners/wangy8961) › [python3-concurrency-pics-02](https://repo.masters-masters.com/en/repos/wangy8961/python3-concurrency-pics-02)

wangy8961/python3-concurrency-pics-02 has 332 stars on GitHub. Its RepoMasters card: Alpha tier. 爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和…

| Field | Value |
| --- | --- |
| Owner | [wangy8961](https://repo.masters-masters.com/en/owners/wangy8961) |
| Stars | 332 |
| Forks | 82 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2018 |
| Topics | python3, concurrency, asyncio, aiohttp, requests, progressbar, futures, threadpool, coroutine |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [wangy8961/python3-concurrency-pics-02](https://github.com/wangy8961/python3-concurrency-pics-02) |

## Repository

爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录，保存更合理。控制台只显示下载的进度条，详细信息保存在日志文件中。支持异常处理，不会终止爬虫程序。失败的请求，下次再执行爬虫程序时会自动下载

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by wangy8961

- [wangy8961/flask-vuejs-madblog · ★ 880 · Vue · Beta](https://repo.masters-masters.com/en/repos/wangy8961/flask-vuejs-madblog)

## Nearby in Python

- [BeamusWayne/simp-skill · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/BeamusWayne/simp-skill)
- [yixiangshijie/ai-agents-in-action-2nd-edition-cn · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/yixiangshijie/ai-agents-in-action-2nd-edition-cn)
- [lithos-ai/lithos-metal · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/lithos-ai/lithos-metal)
- [rdegges/django-twilio · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/rdegges/django-twilio)
- [sileht/bird-lg · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/sileht/bird-lg)
- [lincolnloop/django-layout · ★ 332 · Python · Alpha](https://repo.masters-masters.com/en/repos/lincolnloop/django-layout)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.