# samclarke/robots-parser

<https://repo.masters-masters.com/en/repos/samclarke/robots-parser>

[Home](https://repo.masters-masters.com/en) › [samclarke](https://repo.masters-masters.com/en/owners/samclarke) › [robots-parser](https://repo.masters-masters.com/en/repos/samclarke/robots-parser)

samclarke/robots-parser has 168 stars on GitHub. Its RepoMasters card: Prototype tier. NodeJS robots.txt parser with support for wildcard (\*) matching.

| Field | Value |
| --- | --- |
| Owner | [samclarke](https://repo.masters-masters.com/en/owners/samclarke) |
| Stars | 168 |
| Forks | 19 |
| Language | [JavaScript](https://repo.masters-masters.com/en/languages/javascript) |
| License | MIT |
| Created | 2014 |
| Topics | user-agent, javascript, nodejs, robots-txt, robots-exclusion-standard, robots-parser, rfc-9309 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [samclarke/robots-parser](https://github.com/samclarke/robots-parser) |

## Repository

NodeJS robots.txt parser with support for wildcard (\*) matching.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by samclarke

- [samclarke/SCEditor · ★ 706 · JavaScript · Beta](https://repo.masters-masters.com/en/repos/samclarke/SCEditor)

## Nearby in JavaScript

- [humaedihume/kantor-agent · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/humaedihume/kantor-agent)
- [Joker-chichi/claude-mv-skill · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/Joker-chichi/claude-mv-skill)
- [fjaeckel/seriesoftubes · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/fjaeckel/seriesoftubes)
- [mape/node-wargames · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/mape/node-wargames)
- [fortes/history.js · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/fortes/history.js)
- [datagraph/jquery-jsonrpc · ★ 168 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/datagraph/jquery-jsonrpc)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.