Re:Anthropic’s $5B, 4-year plan to take on OpenAI
by gregw134 on Tuesday April 11, 2023 @04:03PM
(#35530724)
My latest mac seems to have about a kilogram of extra battery already compared to the previous model.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI
by anentropic on Tuesday April 11, 2023 @05:40PM
(#35531973)
Most of the time I have my laptop plugged in and sit at a desk...
But anyway, there are two trends:
- processors do more with less power
- LLMs get larger, but also smaller and more efficient (via quantizing, pruning)
Once upon a time it was prohibitively expensive to decode compressed video on the fly, later CPUs (both Intel [1] and Apple [2]) added dedicated decoding hardware. Now watching hours of YouTube or Netflix are part of standard battery life benchmarks
[1] https://www.intel.com/content/www/us/en/developer/articles/t...
[2] https://www.servethehome.com/apple-ignites-the-industry-with...
Very doubtful unless the user wants to carry around another kilogram worth of batteries to power it. The hefty processing required by these models doesn't come for free (energy wise) and Moore's Law is dead as a nail.