Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel
by solardev on Wednesday October 11, 2023 @06:36PM
(#37851238)
I guess it depends on what you're doing with them? If you're running them 24/7 to train or model something, the energy costs might add up. Even if you're not, having more efficient chips might mean more data centers don't need as complex cooling equipment.
[ Parent
| on HN ]
There are no comments on this comment yet.