PrototypeCommon
JFanZhao/spider
使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。
- Owner
- JFanZhao (personal account)
- Stars
- Stars: 233
- Forks
- Forks: 149
- Language
- Java
- License
- None
- Created
- 2016
- Tier
- Prototype (100 to 249 ★) What this tier means
Nearby in Java
All Java repos- fuzhengwei/book-small-springStars: 233JavaPrototype
- FPSMasterTeam/FPSMaster-EdgeStars: 233JavaPrototype
- bkhtmltopdf/bkhtmltopdfStars: 233JavaPrototype
- paul-hammant/paranamerStars: 233JavaPrototype
- OpenGamma/OG-PlatformStars: 233JavaPrototype
- apache/commons-validatorStars: 233JavaPrototype