- It can be used to scrape the content of an blog and create sqlite
embeddings, which can be used for local search
- embed all simon willison TIL blogposts into sqlite-vec as vector embeddings
- create an CLI version
* to update the database
* to search the database and return relevant links using RAG and
reranking
- Things to read and implement:
* all blogposts regarding to embeddings in simon willison TIL site
* parlance labs - RAG videos - to get good grasp about RAG.
- Next Steps:
* maintaining a list of sites from which we can query and embed the
data.
* our own blogsposts knowledge base.