News for hackers. Stuff that matters.

A comment on Show HN: Turn any website into a knowledge base for LLMs. Parent comment

Re:Show HN: Turn any website into a knowledge base for LLMs by tompec on Monday July 29, 2024 @09:11PM (#41105235)
Give it URLs or domains, and it will crawl and extract their content, embed them in a vector database, and give you an endpoint that you can then query when doing RAG stuff or semantic search.
[ Parent | on HN ]
Re:Show HN: Turn any website into a knowledge base for LLMs by xiconfjs on Tuesday July 30, 2024 @02:12AM (#41106461)
But how does it work in the background? What‘s the tech stack?
[ Parent | on HN ]
Re:Show HN: Turn any website into a knowledge base for LLMs by ramon156 on Tuesday July 30, 2024 @05:34AM (#41107488)
In another comment:

> Tech stack is a mix of serverless Laravel, with Cloudflare and AWS functions, and some Pinecone for vector storage. Still experimenting on a few things but don't want to over-engineer unless I know where I'm going.

[ Parent | on HN ]