> i dont believe ppl are building rag for this

What do you actually think people do when using LLMs to build AI coding agents?

They are, I have people at work building RAG search engines for stuff that works just fine using full text search, or if you really need it, using a cheap model in codex/opencode.

You underestimate the ability of people to overengineer things.

this is quite nuanced. in financial markets you have a combination of natural language questions that involve technical keywords / slang / acronym. and for these specific terms, an off-the-shelf embeddings model fails miserably.