News for hackers. Stuff that matters.

A comment on Korvus: Single-Query RAG with Postgres. Parent comment

Re:Korvus: Single-Query RAG with Postgres by smarvin2 on Thursday July 11, 2024 @05:49PM (#40940906)
It does work by running the LLM on the database server but you can configure the LLM to run on the GPU
[ Parent | on HN ]
Re:Korvus: Single-Query RAG with Postgres by ekianjo on Friday July 12, 2024 @06:44AM (#40944343)
if you are using your database extensively how do you scale up your GPU resources for korvus?
[ Parent | on HN ]