Re:Beating GPT-5.6 Sol on retrieval with 100x cheaper open m...
by kumama on Wednesday August 05, 2026 @09:40PM
(#49191374)
castform founder here. that's a future we are really excited about too :) ideally, you can post-train the llm within the application itself, as it's being used. both interesting infrastructure & algorithmic challenges here
I also didn't realize that people were using agentic harnesses for search, it's an interesting idea. If the context length is short enough it should be fairly cheap compared to running "normal" agentic coding workloads where you have O(100k) context length for doing almost anything.