Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

jimsmart/grobotstxt

grobotstxt is a native Go port of Google's robots.txt parser and matcher library.

Owner
jimsmart (personal account)
Stars
Stars: 115
Forks
Forks: 7
Language
Go
License
Apache-2.0
Created
2020
Topics
gorobots-txtrobots-exclusion-protocol
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Go

All Go repos