News for hackers. Stuff that matters.

A comment on Making LLMs Cheaper and Better via Performance-Efficiency Optimized Routing. Parent comment

Re:Making LLMs Cheaper and Better via Performance-Efficiency... by nico on Friday August 22, 2025 @05:09PM (#44989849)
I wish this could be exploited even further, where a big model could be built with a network of a lot of small, specialized, models

And then maybe you could just customize and optimize your own mode for local use. Almost like mixing and matching different modules. It would be nice to have a model that only knows and does what you need it to

[ Parent | on HN ]
Re:Making LLMs Cheaper and Better via Performance-Efficiency... by mrbald on Saturday August 23, 2025 @02:48AM (#44993849)
A Team-as-a-Service? Would be interesting to be able to create a Python script acting like a team of sales, project management, and engineering working together with telemetry and KPIs dashboard on top. If not to deliver anything useful then as a project management frameworks learning tool.
[ Parent | on HN ]