Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

danielmiessler/RobotsDisallowed

A curated list of the most common and most interesting robots.txt disallowed directories.

Owner
danielmiessler (personal account)
Stars
Stars: 1,498
Forks
Forks: 304
Language
Shell
License
None
Created
2015
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by danielmiessler

All 17 repos by danielmiessler

Nearby in Shell

All Shell repos