News for hackers. Stuff that matters.

A comment on Facebook LLAMA is being openly distributed via torrents. Parent comment

Re:Facebook LLAMA is being openly distributed via torrents by yunwal on Friday March 03, 2023 @11:58AM (#35012144)
Long term I also imagine it's much cheaper to run these large model trainings on renewables. It's a very centralized process that doesn't necessarily need 100% availability.

The manufacturing process, however, is totally decentralized, and NVIDIA mostly manufactures in China where coal is cheap.

[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by verall on Friday March 03, 2023 @01:14PM (#35013134)
A100s are manufactured in Taiwan.
[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by yunwal on Friday March 03, 2023 @03:06PM (#35014355)
True, but previous chips have been manufactured in China, and they’re also developing and manufacturing their successor to A100s (H100s) in China.

https://www.cnbc.com/2022/09/01/nvidia-says-us-government-al...

[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by verall on Friday March 03, 2023 @05:24PM (#35015868)
That says "partially developed" in China. H100s will probably be manufactured in Taiwan just like other x100 chips.

All consumer SKUs that I know of are manufactured in China. By volume this is certainly the majority of manufacturing.

[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by Taek on Saturday March 04, 2023 @06:55PM (#35025718)
I believe in terms of climate impact the chips (made in Taiwan) overwhelm everything else.
[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by Taek on Saturday March 04, 2023 @06:58PM (#35025738)
Because the cards are so expensive, you really do want them running 24/7. The electricity is not a big deal for these really expensive chips
[ Parent | on HN ]