Re:Facebook LLAMA is being openly distributed via torrents
by CGamesPlay on Friday March 03, 2023 @10:43AM
(#35011063)
No, I'm willing to bet the CO2 cost of the cards is also way higher than the electricity. Those things are built on the global supply chain, with materials potentially making multiple thousands of kms journeys between each step.
[ Parent
| on HN ]
Re:Facebook LLAMA is being openly distributed via torrents
by yunwal on Friday March 03, 2023 @11:58AM
(#35012144)
Long term I also imagine it's much cheaper to run these large model trainings on renewables. It's a very centralized process that doesn't necessarily need 100% availability.
The manufacturing process, however, is totally decentralized, and NVIDIA mostly manufactures in China where coal is cheap.
Re:Facebook LLAMA is being openly distributed via torrents
by verall on Friday March 03, 2023 @01:14PM
(#35013134)
A100s are manufactured in Taiwan.
Re:Facebook LLAMA is being openly distributed via torrents
by yunwal on Friday March 03, 2023 @03:06PM
(#35014355)
True, but previous chips have been manufactured in China, and they’re also developing and manufacturing their successor to A100s (H100s) in China.
https://www.cnbc.com/2022/09/01/nvidia-says-us-government-al...
Re:Facebook LLAMA is being openly distributed via torrents
by verall on Friday March 03, 2023 @05:24PM
(#35015868)
That says "partially developed" in China. H100s will probably be manufactured in Taiwan just like other x100 chips.
All consumer SKUs that I know of are manufactured in China. By volume this is certainly the majority of manufacturing.