# hueristiq/xcrawl3r

<https://repo.masters-masters.com/en/repos/hueristiq/xcrawl3r>

[Home](https://repo.masters-masters.com/en) › [hueristiq](https://repo.masters-masters.com/en/owners/hueristiq) › [xcrawl3r](https://repo.masters-masters.com/en/repos/hueristiq/xcrawl3r)

hueristiq/xcrawl3r has 110 stars on GitHub. Its RepoMasters card: Prototype tier. A command-line tool for recursively spidering webpages for URLs. It works by…

| Field | Value |
| --- | --- |
| Owner | [hueristiq](https://repo.masters-masters.com/en/owners/hueristiq) |
| Stars | 110 |
| Forks | 8 |
| Language | [Go](https://repo.masters-masters.com/en/languages/go) |
| License | MIT |
| Created | 2021 |
| Topics | crawler, bug-bounty, penetration-testing, penetration-testing-tools, contentdiscovery, reconnaissance, bug-bounty-tools, ethical-hacking, ethical-hacking-tools, red-teaming |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [hueristiq/xcrawl3r](https://github.com/hueristiq/xcrawl3r) |

## Repository

A command-line tool for recursively spidering webpages for URLs. It works by actively traversing websites, following links embedded in webpages, and parsing files (including sitemaps & robots.txt), to uncover every URL.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by hueristiq

- [hueristiq/xurlfind3r · ★ 734 · Go · Beta](https://repo.masters-masters.com/en/repos/hueristiq/xurlfind3r)
- [hueristiq/xsubfind3r · ★ 119 · Go · Prototype](https://repo.masters-masters.com/en/repos/hueristiq/xsubfind3r)

## Nearby in Go

- [seirenkr/OGInstagram · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/seirenkr/OGInstagram)
- [berkayyytech/vortex · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/berkayyytech/vortex)
- [kure29/flyx · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/kure29/flyx)
- [dchest/authcookie · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/dchest/authcookie)
- [JalfResi/justext · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/JalfResi/justext)
- [marguerite/linux-bing-wallpaper · ★ 110 · Go · Prototype](https://repo.masters-masters.com/en/repos/marguerite/linux-bing-wallpaper)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.