# PuerkitoBio/gocrawl

<https://repo.masters-masters.com/en/repos/PuerkitoBio/gocrawl>

[Home](https://repo.masters-masters.com/en) › [PuerkitoBio](https://repo.masters-masters.com/en/owners/PuerkitoBio) › [gocrawl](https://repo.masters-masters.com/en/repos/PuerkitoBio/gocrawl)

PuerkitoBio/gocrawl has 2,053 stars on GitHub. Its RepoMasters card: RC tier. Polite, slim and concurrent web crawler. Language: Go.

| Field | Value |
| --- | --- |
| Owner | [PuerkitoBio](https://repo.masters-masters.com/en/owners/PuerkitoBio) |
| Stars | 2,053 |
| Forks | 195 |
| Language | [Go](https://repo.masters-masters.com/en/languages/go) |
| License | BSD-3-Clause |
| Created | 2012 |
| Topics | crawler, robots-txt |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [PuerkitoBio/gocrawl](https://github.com/PuerkitoBio/gocrawl) |

## Repository

Polite, slim and concurrent web crawler.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by PuerkitoBio

- [PuerkitoBio/goquery · ★ 14,990 · Go · Stable](https://repo.masters-masters.com/en/repos/PuerkitoBio/goquery)
- [PuerkitoBio/fetchbot · ★ 791 · Go · Beta](https://repo.masters-masters.com/en/repos/PuerkitoBio/fetchbot)
- [PuerkitoBio/purell · ★ 485 · Go · Alpha](https://repo.masters-masters.com/en/repos/PuerkitoBio/purell)
- [PuerkitoBio/rehttp · ★ 223 · Go · Prototype](https://repo.masters-masters.com/en/repos/PuerkitoBio/rehttp)

## Nearby in Go

- [filecoin-project/venus · ★ 2,056 · Go · RC](https://repo.masters-masters.com/en/repos/filecoin-project/venus)
- [canonical/snapd · ★ 2,054 · Go · RC](https://repo.masters-masters.com/en/repos/canonical/snapd)
- [pkg/profile · ★ 2,053 · Go · RC](https://repo.masters-masters.com/en/repos/pkg/profile)
- [talent-plan/tinysql · ★ 2,052 · Go · RC](https://repo.masters-masters.com/en/repos/talent-plan/tinysql)
- [bytedance/gopkg · ★ 2,051 · Go · RC](https://repo.masters-masters.com/en/repos/bytedance/gopkg)
- [yahoo/gryffin · ★ 2,050 · Go · RC](https://repo.masters-masters.com/en/repos/yahoo/gryffin)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.