News for hackers. Stuff that matters.
Re:Don't bother parsing: Just use images for RAG by imperfect_light on Monday July 21, 2025 @10:07PM (#44642574)
The emphasis on PDFs for RAG seems like something out of the 1990s. Are there any good frameworks for using RAG if your company doesn't go around creating documents left and right?

After all, the documents/emails/presentations will cover the most common use cases. But we have databases that have all the questions the RAG might be asked, far more answers than that which live in documents.

Re:Don't bother parsing: Just use images for RAG by petesergeant on Monday July 21, 2025 @10:52PM (#44642806)
That's because PDFs are the hard part. If you're starting with small pieces of text, RAG becomes much much easier.
Re:Don't bother parsing: Just use images for RAG by imperfect_light on Tuesday July 22, 2025 @11:31PM (#44655483)
My question is less about PDFs and more about the notion that all the facts needed for the RAG are in documents. In my experience just a fraction of the questions that might be useful exist in a document somewhere. There must be a variation of RAGs that are pulling not from documents, but from databases using some semantic model.
Re:Don't bother parsing: Just use images for RAG by petesergeant on Wednesday July 23, 2025 @03:59AM (#44656784)
Sure, but the process for this is laughably easy: you render the text with a minimum amount of text to place it into context, and submit that to whatever your embedding-maker is to get the embedding. You could potentially store the embedding in the same DB row if you have a DB that's happy with vector searches.