News for hackers. Stuff that matters.
Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @12:08PM (#42390016)
I think it's a more likely assumption that on device performance will trail off device models by a significant margin for at least the next few years - of course if magically you can make it work locally with the same level of performance it would be better.

Plus a lot of the "agentic" stuff is interaction with the outside world, connectivity is a must regardless.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:09PM (#42390030)
My point is that you do NOT need the same level of performance. You need an adequate level of performance that the cost to get more performance isn’t worth it to most people.
Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @12:13PM (#42390073)
And my point is that it's way too early to try to optimize for running locally, if performance really stabilizes and comes to a halt (which may likely happen) then it makes more sense to optimize.

Plus once you start with on device features you start limiting your development speed and flexibility.

Re:Gemini 2.0: our new AI model for the agentic era by jsight on Wednesday December 11, 2024 @12:51PM (#42390554)
It isn't really hypothetical. Lots of good models run well on a modern Macbook Pro.