News for hackers. Stuff that matters.
Re:Show HN: Route your prompts to the best LLM by qeternity on Friday May 24, 2024 @03:19PM (#40469591)
We do agentic systems. We already optimize for these things. We route between different models based on various heuristics. I absolutely would not want that to be black box. And doing any sort of vector similarity to determine task complexity is not going to work well.

I would also not try to emulate DSPy, which is a massively overrated bit of kit and of little use in a production pipeline.

Re:Show HN: Route your prompts to the best LLM by tarasglek on Tuesday May 28, 2024 @08:40AM (#40500143)
Curious, can you explain why you think DSPy overrated?