# spatie/robots-txt

<https://repo.masters-masters.com/en/repos/spatie/robots-txt>

[Home](https://repo.masters-masters.com/en) › [spatie](https://repo.masters-masters.com/en/owners/spatie) › [robots-txt](https://repo.masters-masters.com/en/repos/spatie/robots-txt)

spatie/robots-txt has 258 stars on GitHub. Its RepoMasters card: Alpha tier. Determine if a page may be crawled from robots.txt, robots meta tags and robot…

| Field | Value |
| --- | --- |
| Owner | [spatie](https://repo.masters-masters.com/en/owners/spatie) |
| Stars | 258 |
| Forks | 44 |
| Language | [PHP](https://repo.masters-masters.com/en/languages/php) |
| License | MIT |
| Created | 2018 |
| Topics | php, robots-txt, crawler |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [spatie/robots-txt](https://github.com/spatie/robots-txt) |

## Repository

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by spatie

- [spatie/laravel-permission · ★ 12,979 · PHP · Stable](https://repo.masters-masters.com/en/repos/spatie/laravel-permission)
- [spatie/laravel-medialibrary · ★ 6,173 · PHP · Stable](https://repo.masters-masters.com/en/repos/spatie/laravel-medialibrary)
- [spatie/laravel-backup · ★ 6,026 · PHP · Stable](https://repo.masters-masters.com/en/repos/spatie/laravel-backup)
- [spatie/laravel-activitylog · ★ 5,911 · PHP · Stable](https://repo.masters-masters.com/en/repos/spatie/laravel-activitylog)
- [spatie/browsershot · ★ 5,251 · PHP · Stable](https://repo.masters-masters.com/en/repos/spatie/browsershot)
- [spatie/laravel-query-builder · ★ 4,467 · PHP · RC](https://repo.masters-masters.com/en/repos/spatie/laravel-query-builder)

## Nearby in PHP

- [LaravelDaily/Laravel-Vue-First-CRUD · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/LaravelDaily/Laravel-Vue-First-CRUD)
- [yankovalenko94/Webdev2019 · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/yankovalenko94/Webdev2019)
- [jan-vandenberg/cruddiy · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/jan-vandenberg/cruddiy)
- [shumkov/rediska · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/shumkov/rediska)
- [vtiger-crm/vtigercrm · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/vtiger-crm/vtigercrm)
- [buddypress/buddypress · ★ 258 · PHP · Alpha](https://repo.masters-masters.com/en/repos/buddypress/buddypress)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.