# paulpierre/markdown-crawler

<https://repo.masters-masters.com/en/repos/paulpierre/markdown-crawler>

[Home](https://repo.masters-masters.com/en) › [paulpierre](https://repo.masters-masters.com/en/owners/paulpierre) › [markdown-crawler](https://repo.masters-masters.com/en/repos/paulpierre/markdown-crawler)

paulpierre/markdown-crawler has 480 stars on GitHub. Its RepoMasters card: Alpha tier. A multithreaded 🕸️ web crawler that recursively crawls a website and…

| Field | Value |
| --- | --- |
| Owner | [paulpierre](https://repo.masters-masters.com/en/owners/paulpierre) |
| Stars | 480 |
| Forks | 53 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | html-to-markdown, html-to-markdown-converter, html2md, llm, llmops, markdown, markdown-parser, rag, web-scraper, markdown-crawler |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [paulpierre/markdown-crawler](https://github.com/paulpierre/markdown-crawler) |

## Repository

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by paulpierre

- [paulpierre/RasaGPT · ★ 2,458 · Python · RC](https://repo.masters-masters.com/en/repos/paulpierre/RasaGPT)
- [paulpierre/informer · ★ 1,684 · Python · Beta](https://repo.masters-masters.com/en/repos/paulpierre/informer)

## Nearby in Python

- [meituan-longcat/LongCat-Next · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/meituan-longcat/LongCat-Next)
- [hexsecteam/DroidHunter · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/hexsecteam/DroidHunter)
- [nv-tlabs/dvlt · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/nv-tlabs/dvlt)
- [clustershell/clustershell · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/clustershell/clustershell)
- [brandon-rhodes/python-sgp4 · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/brandon-rhodes/python-sgp4)
- [nephila/djangocms-blog · ★ 480 · Python · Alpha](https://repo.masters-masters.com/en/repos/nephila/djangocms-blog)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.