# scrapy/dirbot

<https://repo.masters-masters.com/en/repos/scrapy/dirbot>

[Home](https://repo.masters-masters.com/en) › [scrapy](https://repo.masters-masters.com/en/owners/scrapy) › [dirbot](https://repo.masters-masters.com/en/repos/scrapy/dirbot)

scrapy/dirbot has 1,629 stars on GitHub. Its RepoMasters card: Beta tier. Scrapy project to scrape public web directories (educational) \[DEPRECATED\]

| Field | Value |
| --- | --- |
| Owner | [scrapy](https://repo.masters-masters.com/en/owners/scrapy) |
| Stars | 1,629 |
| Forks | 1,039 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2011 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [scrapy/dirbot](https://github.com/scrapy/dirbot) |

## Repository

Scrapy project to scrape public web directories (educational) \[DEPRECATED\]

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by scrapy

- [scrapy/scrapy · ★ 65,186 · Python · LTS](https://repo.masters-masters.com/en/repos/scrapy/scrapy)
- [scrapy/scrapyd · ★ 3,099 · Python · RC](https://repo.masters-masters.com/en/repos/scrapy/scrapyd)
- [scrapy/scrapely · ★ 1,883 · HTML · Beta](https://repo.masters-masters.com/en/repos/scrapy/scrapely)
- [scrapy/parsel · ★ 1,367 · Python · Beta](https://repo.masters-masters.com/en/repos/scrapy/parsel)
- [scrapy/quotesbot · ★ 1,360 · Python · Beta](https://repo.masters-masters.com/en/repos/scrapy/quotesbot)
- [scrapy/scrapyd-client · ★ 771 · Python · Beta](https://repo.masters-masters.com/en/repos/scrapy/scrapyd-client)

## Nearby in Python

- [CodeWithHarry/100-days-of-code-youtube · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/CodeWithHarry/100-days-of-code-youtube)
- [deepseek-ai/DeepSeek-Math-V2 · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/deepseek-ai/DeepSeek-Math-V2)
- [mizorewww/laya-coreml · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/mizorewww/laya-coreml)
- [un33k/python-slugify · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/un33k/python-slugify)
- [spotify/dh-virtualenv · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/spotify/dh-virtualenv)
- [chinoogawa/fbht · ★ 1,629 · Python · Beta](https://repo.masters-masters.com/en/repos/chinoogawa/fbht)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.