AlphaUncommon
paulpierre/markdown-crawler
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
- Owner
- paulpierre (personal account)
- Stars
- Stars: 480
- Forks
- Forks: 53
- Language
- Python
- License
- MIT
- Created
- 2023
- Topics
- html-to-markdownhtml-to-markdown-converterhtml2mdllmllmopsmarkdownmarkdown-parserragweb-scrapermarkdown-crawler
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by paulpierre
All 3 repos by paulpierre- paulpierre/RasaGPTStars: 2,459PythonRC
- paulpierre/informerStars: 1,684PythonBeta
Nearby in Python
All Python repos- Jeomon/Windows-UseStars: 480PythonAlpha
- meituan-longcat/LongCat-NextStars: 480PythonAlpha
- owl234/ARL-NextStars: 480PythonAlpha
- clustershell/clustershellStars: 480PythonAlpha
- brandon-rhodes/python-sgp4Stars: 480PythonAlpha
- noirblancrouge/YoungSerifStars: 480PythonAlpha