News for hackers. Stuff that matters.
Re:I looked at 1000s of RAG queries to figure out the proble... by npip99 on Monday December 02, 2024 @04:25PM (#42300574)
Yes, a step where you do a structured extraction into a database column would be a potential solution. But, it requires a preprocessing step.

It all depends on the use-case, sometimes you get a query that you couldn't have predicted the filter beforehand. In those cases, usually what you have to do is open up a spreadsheet and then manually categorize every document by hand. LLMs and modern AI are great ways to automate this.

A really good solution might be to have a system that computes these filters on-the-fly, but also caches them for later reuse if a query asks for that filter again.

There are no comments on this comment yet.