Illustration: the project’s public image, pixelated by RepoMasters. Credits
RCEpic

PuerkitoBio/gocrawl

Polite, slim and concurrent web crawler.

Owner
PuerkitoBio (organization)
Stars
Stars: 2,052
Forks
Forks: 196
Language
Go
License
BSD-3-Clause
Created
2012
Topics
crawlerrobots-txt
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

More repos by PuerkitoBio

All 5 repos by PuerkitoBio

Nearby in Go

All Go repos