Re:New LLM optimization technique slashes memory costs up to...
by adelpozo on Tuesday December 17, 2024 @01:12AM
(#42438779)
Or solar in space, which some have already heard of Lumen Orbit https://www.ycombinator.com/companies/lumen-orbit
[ Parent
| on HN ]
Re:New LLM optimization technique slashes memory costs up to...
by cratermoon on Tuesday December 17, 2024 @12:30PM
(#42443273)
Space-based solar power contains little intrinsic advantage that we can get “only from space.” It looks like a wash at best, and the astronomers would say “don’t bother.”
https://dothemath.ucsd.edu/2012/03/space-based-solar-power/
Re:New LLM optimization technique slashes memory costs up to...
by adelpozo on Tuesday December 17, 2024 @01:03PM
(#42443584)
Yeah, but what I found thought provoking is what if you send the solar panels and the datacenter as well for training. No need to transmission of power down to earth. I guess then it becomes a heat dissipation and hardware upgrade and maintenance. But again, thought provoking.
Re:New LLM optimization technique slashes memory costs up to...
by sobani on Thursday December 19, 2024 @06:31AM
(#42460467)
Heat dissipation becomes a _huge_ problem when you deploy a data center inside a perfect insulator, the vacuum of space.
Currently about a third of the energy consumption of a data center spent on cooling (heat dissipation)? And that's with the use of a huge heat sink, the earth.
Re:New LLM optimization technique slashes memory costs up to...
by cratermoon on Monday December 23, 2024 @12:37AM
(#42492078)
Plus, I feel like GP hasn't ever seen an actual data center. One does not simply strap on on top of a rocket (even a SpaceX Starship) and toss it into LEO.