Re:Anthropic’s $5B, 4-year plan to take on OpenAI
by littlestymaar on Tuesday April 11, 2023 @05:21PM
(#35531741)
But then again, every apple silicon user has an unused neural engine sitting around in the SoC an taking a significant amount of die space, yet people don't seem to worry too much about its depreciation.
Yeah but in the cloud that cost is ammortized among everyone else using the service. If you as a consumer buy a gpu in order to run LLMs for personal use, then the vast majority of the time it will just be sitting there depreciating.