Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Owner
postmodern (personal account)
Stars
Stars: 836
Forks
Forks: 104
Language
Ruby
License
MIT
Created
2009
Topics
spiderrubyspider-linkscrawlerwebscraperweb-scrapingweb-spiderweb-crawlerweb-scraper
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by postmodern

All 8 repos by postmodern

Nearby in Ruby

All Ruby repos