Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

RCEpic

gnemoug/distribute_crawler

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

Owner: gnemoug (personal account)
Stars: Stars: 3,235
Forks: Forks: 1,552
Language: Python
License: None
Created: 2013
Tier: RC (2,000 to 4,999 ★) What this tier means

More repos by gnemoug

All 3 repos by gnemoug

gnemoug/sina_reptileStars: 474PythonAlpha
gnemoug/ComPerformanceStars: 387JavaScriptAlpha

Nearby in Python

All Python repos

thearn/webcam-pulse-detectorStars: 3,235PythonRC
mit-han-lab/bevfusionStars: 3,235PythonRC
dexmal/dexboticStars: 3,235PythonRC