Faster Retrieval for Better, More Efficient RAG

Re:Faster Retrieval for Better, More Efficient RAG by elpakal on Wednesday November 11, 2026 @02:12PM (#50457237)

Agreed, but I wonder how that plays out without them entering the frontier model space. I just downloaded the new foundation models cli and ran some inference on my Mac, it wasn't great, but it was neat to see. I asked which model it was using and it said gpt 4o mini.

An on-device, 100% private AI assistant seems like it could be so big that it could be a legitimate threat to the frontier model providers they are partnering with right now, imho.

[ Parent | on HN ]

Re:Faster Retrieval for Better, More Efficient RAG by andriy_koval on Wednesday November 11, 2026 @02:30PM (#50457419)

> I wonder how that plays out without them entering the frontier model space

bet could be that this space will be commoditized: many good enough open weight models and multiple competing provides.

[ Parent | on HN ]

Re:Faster Retrieval for Better, More Efficient RAG by makmanalp on Wednesday November 11, 2026 @02:35PM (#50457485)

[delayed]

[ Parent | on HN ]