Re:New LLM optimization technique slashes memory costs up to...
by adelpozo on Tuesday December 17, 2024 @01:03PM
(#42443584)
Yeah, but what I found thought provoking is what if you send the solar panels and the datacenter as well for training. No need to transmission of power down to earth. I guess then it becomes a heat dissipation and hardware upgrade and maintenance. But again, thought provoking.
[ Parent
| on HN ]
Re:New LLM optimization technique slashes memory costs up to...
by sobani on Thursday December 19, 2024 @06:31AM
(#42460467)
Heat dissipation becomes a _huge_ problem when you deploy a data center inside a perfect insulator, the vacuum of space.
Currently about a third of the energy consumption of a data center spent on cooling (heat dissipation)? And that's with the use of a huge heat sink, the earth.
Re:New LLM optimization technique slashes memory costs up to...
by cratermoon on Monday December 23, 2024 @12:37AM
(#42492078)
Plus, I feel like GP hasn't ever seen an actual data center. One does not simply strap on on top of a rocket (even a SpaceX Starship) and toss it into LEO.