Re:Anthropic’s $5B, 4-year plan to take on OpenAI
by anentropic on Tuesday April 11, 2023 @05:40PM
(#35531973)
Most of the time I have my laptop plugged in and sit at a desk...
But anyway, there are two trends:
- processors do more with less power
- LLMs get larger, but also smaller and more efficient (via quantizing, pruning)
Once upon a time it was prohibitively expensive to decode compressed video on the fly, later CPUs (both Intel [1] and Apple [2]) added dedicated decoding hardware. Now watching hours of YouTube or Netflix are part of standard battery life benchmarks
But anyway, there are two trends:
- processors do more with less power
- LLMs get larger, but also smaller and more efficient (via quantizing, pruning)
Once upon a time it was prohibitively expensive to decode compressed video on the fly, later CPUs (both Intel [1] and Apple [2]) added dedicated decoding hardware. Now watching hours of YouTube or Netflix are part of standard battery life benchmarks
[1] https://www.intel.com/content/www/us/en/developer/articles/t...
[2] https://www.servethehome.com/apple-ignites-the-industry-with...