News for hackers. Stuff that matters.
Re:Hypermode Model Router Preview – OpenRouter Alternative by iamtherhino on Thursday May 08, 2025 @01:43PM (#43928961)
We've been playing with that in the background. I can try to shoot you a preview in a few weeks. It works pretty well for reasoning tasks/NLP workloads but for workloads that need a "correct" answer, it's really tough to maintain accuracy when swapping models.

What we've seen most successful is making recommendations in the agent creation process for a given tool/workload and then leaving them somewhat static after creation.

Re:Hypermode Model Router Preview – OpenRouter Alternative by 0xDEAFBEAD on Thursday May 08, 2025 @01:47PM (#43929035)
That's fair. Maybe you could even send the user an email if you detect a new model release or pricing change which handles their workload for cheaper at comparable quality, to notify them to investigate.
Re:Hypermode Model Router Preview – OpenRouter Alternative by iamtherhino on Thursday May 08, 2025 @01:53PM (#43929114)
That's a good idea-- then give them a link to "replay last X inferences with model ABC" so they can do a quick eyeball eval.
Re:Hypermode Model Router Preview – OpenRouter Alternative by 0xDEAFBEAD on Thursday May 08, 2025 @02:07PM (#43929295)
Sweet, maybe you'll like my other idea in this thread too: https://news.ycombinator.com/item?id=43929194