Re:Show HN: Route your prompts to the best LLM
by qeternity on Friday May 24, 2024 @03:19PM
(#40469591)
We do agentic systems. We already optimize for these things. We route between different models based on various heuristics. I absolutely would not want that to be black box. And doing any sort of vector similarity to determine task complexity is not going to work well.
I would also not try to emulate DSPy, which is a massively overrated bit of kit and of little use in a production pipeline.
I would also not try to emulate DSPy, which is a massively overrated bit of kit and of little use in a production pipeline.