# adamdehaven/fetchurls

<https://repo.masters-masters.com/en/repos/adamdehaven/fetchurls>

[Home](https://repo.masters-masters.com/en) › [adamdehaven](https://repo.masters-masters.com/en/owners/adamdehaven) › [fetchurls](https://repo.masters-masters.com/en/repos/adamdehaven/fetchurls)

adamdehaven/fetchurls has 130 stars on GitHub. Its RepoMasters card: Prototype tier. A bash script to spider a site, follow links, and fetch urls (with…

| Field | Value |
| --- | --- |
| Owner | [adamdehaven](https://repo.masters-masters.com/en/owners/adamdehaven) |
| Stars | 130 |
| Forks | 43 |
| Language | [Shell](https://repo.masters-masters.com/en/languages/shell) |
| License | MIT |
| Created | 2018 |
| Topics | wget, crawl, spider, bash-scripting, shell-script, website, urls |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [adamdehaven/fetchurls](https://github.com/adamdehaven/fetchurls) |

## Repository

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by adamdehaven

- [adamdehaven/change-git-author · ★ 118 · Shell · Prototype](https://repo.masters-masters.com/en/repos/adamdehaven/change-git-author)

## Nearby in Shell

- [roothide/Palera1n-roothide · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/roothide/Palera1n-roothide)
- [aaddrick/claude-pipeline · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/aaddrick/claude-pipeline)
- [Anton-Barinov/php2shell-patches · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/Anton-Barinov/php2shell-patches)
- [benhoskings/dot-files · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/benhoskings/dot-files)
- [mevansam/cmoss · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/mevansam/cmoss)
- [fumiyas/home-commands · ★ 130 · Shell · Prototype](https://repo.masters-masters.com/en/repos/fumiyas/home-commands)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
