News for hackers. Stuff that matters.
Re:Ask HN: Who uses open LLMs and coding assistants locally?... by gkfasdfasdf on Saturday November 01, 2025 @01:09PM (#45783342)
What were you using for RAG? Did you build your own or some off the shelf solution (e.g. openwebui)
Re:Ask HN: Who uses open LLMs and coding assistants locally?... by fm2606 on Saturday November 01, 2025 @08:00PM (#45786666)
I used pg vector chunking on paragraphs. For the answers I saved in a flat text file and then parsed to what I needed.

For parsing and vectorizing of the GCP docs I used a Python script. For reading each quiz question, getting a text embedding and submitting to an LLM, I used Spring AI.

It was all roll your own.

But like I stated in my original post I deleted it without backup or vcs. It was the wrong directory that I deleted. Rookie mistake for which I know better.