# out0fmemory/GuozhongCrawler

<https://repo.masters-masters.com/en/repos/out0fmemory/GuozhongCrawler>

[Home](https://repo.masters-masters.com/en) › [out0fmemory](https://repo.masters-masters.com/en/owners/out0fmemory) › [GuozhongCrawler](https://repo.masters-masters.com/en/repos/out0fmemory/GuozhongCrawler)

out0fmemory/GuozhongCrawler has 103 stars on GitHub. Its RepoMasters card: Prototype tier. GuozhongCrawler的是一个无须配置、便于二次开发的爬虫开源框架，它提供简单灵活的API，只需少量代码即可实现一个爬虫。其设计…

| Field | Value |
| --- | --- |
| Owner | [out0fmemory](https://repo.masters-masters.com/en/owners/out0fmemory) |
| Stars | 103 |
| Forks | 65 |
| Language | [Java](https://repo.masters-masters.com/en/languages/java) |
| License | None |
| Created | 2015 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [out0fmemory/GuozhongCrawler](https://github.com/out0fmemory/GuozhongCrawler) |

## Repository

GuozhongCrawler的是一个无须配置、便于二次开发的爬虫开源框架，它提供简单灵活的API，只需少量代码即可实现一个爬虫。其设计灵感来源于多个爬虫国内外爬虫框架的总结。采用完全模块化的设计，功能覆盖整个爬虫的生命周期(链接提取、页面下载、内容抽取、持久化)，支持多线程抓取，分布式抓取，并支持自动重试，定制执行js、自定义cookie等功能。在处理网站抓取多次后被封IP的问题上，guozhongCrawler采用动态轮换IP机制有效防止IP被封。另外，源码中的注释及Log输出全部采用通俗易懂的中文。让初学者能有更加深刻的理解

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by out0fmemory

- [out0fmemory/qqwry.dat · ★ 1,217 · Python · Beta](https://repo.masters-masters.com/en/repos/out0fmemory/qqwry.dat)
- [out0fmemory/GoAgent-Always-Available · ★ 1,124 · Python · Beta](https://repo.masters-masters.com/en/repos/out0fmemory/GoAgent-Always-Available)
- [out0fmemory/Goproxy-Always-Available · ★ 165 · Go · Prototype](https://repo.masters-masters.com/en/repos/out0fmemory/Goproxy-Always-Available)

## Nearby in Java

- [ly1836/spring-ai-rag-demo · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/ly1836/spring-ai-rag-demo)
- [mastercook777/Heimdall-AYN-Thor-Assistant · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/mastercook777/Heimdall-AYN-Thor-Assistant)
- [zl1nq/Jaco · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/zl1nq/Jaco)
- [apache/maven-scm · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/apache/maven-scm)
- [awsmithson/tcx2nikeplus · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/awsmithson/tcx2nikeplus)
- [intervigilium/MicDroid · ★ 103 · Java · Prototype](https://repo.masters-masters.com/en/repos/intervigilium/MicDroid)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.