Aavache/LLMWebCrawler
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
Python
Stargazers
- alexruimySpecta
- aritropcKolkata
- ArturDominguesUSP-University of São Paulo
- bellyfat
- BenedictusAryoJakarta, Indonesia
- BenwoodiUrban
- bs7280
- cemdrkTurkey
- ConicalDrupe
- ddbon-calvin
- dilshan23Sri Lanka
- DominikDary@Salesforce
- dotpyuBrown University
- dragon28
- dsdanielparkSeoul
- flrngel@Ainbr
- HINATASDK
- jannctuIndodana
- jwcunhagit
- LCTechnoConception
- LorenzoBiassio
- Matt-DeacalionBudapest, Hungary
- Meathelix1
- mshojaei77Shiraz, Iran, Earth, Milky Way.
- Njordrenterprises
- Pent
- shaunstoltz
- sirsimonsonLeipzig
- SkkuhodomoSeoul, Korea
- slnwSMS Edge
- supercamel
- threefoldo
- trockerNew York
- VocabVictor南京大学
- Wingie@bookingcom
- zhrnzMalaysia