paulpierre/markdown-crawler
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
PythonMIT
Issues
- 0
How to access private git repo?
#14 opened by green999 - 0
cannot access local variable 'main_content' where it is not associated with a value
#11 opened by assumednormal - 0
target_content not used
#10 opened by jhoogeboom - 1
UnicodeEncodeError : 'charmap' codec can't encode characters in position 2473-2474: character maps to
#7 opened by jeaneigsi - 0
Bypass JavaScript check
#8 opened by sebastianbk - 1
- 0
Submitting this as an issue for now, but I may have contributions for you...
#6 opened by symmetricalboy - 0