News for hackers. Stuff that matters.
Re:FFmpeg by Example by NavinF on Tuesday January 14, 2025 @11:02PM (#42707185)
Oh I talked to some guys who started a company that does that. This was at an AI meetup in SF last year. They were mainly focused on making $/token cheaper by directing easy/dumb queries to smaller dumber models, but it also increases output quality because some models are just better at certain things. I'm sure all the big companies already have implementations of this by now even if they don't use it everywhere
Re:FFmpeg by Example by Over2Chars on Tuesday January 14, 2025 @11:47PM (#42707425)
I was suggesting optimizing for answer quality, but optimizing for cost might be useful too I suppose for "business innovation" purposes.
Re:FFmpeg by Example by jazzyjackson on Friday January 17, 2025 @02:24PM (#42742233)
Yes they are called routers. One is https://withmartian.com/