Re:Ask HN: Who uses open LLMs and coding assistants locally?...
by gkfasdfasdf on Saturday November 01, 2025 @01:09PM
(#45783342)
What were you using for RAG? Did you build your own or some off the shelf solution (e.g. openwebui)
[ Parent
| on HN ]
Re:Ask HN: Who uses open LLMs and coding assistants locally?...
by fm2606 on Saturday November 01, 2025 @08:00PM
(#45786666)
I used pg vector chunking on paragraphs. For the answers I saved in a flat text file and then parsed to what I needed.
For parsing and vectorizing of the GCP docs I used a Python script. For reading each quiz question, getting a text embedding and submitting to an LLM, I used Spring AI.
It was all roll your own.
But like I stated in my original post I deleted it without backup or vcs. It was the wrong directory that I deleted. Rookie mistake for which I know better.