News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by aitchnyu on Tuesday December 17, 2024 @01:05AM (#42438750)
Could be a good candidate for factobattery. Overbuild the system, run them at full speed at peak solar generation, then underclock them at night.

https://www.moderndescartes.com/essays/factobattery/

Re:New LLM optimization technique slashes memory costs up to... by ForHackernews on Tuesday December 17, 2024 @07:21AM (#42440794)
This is a really interesting idea! Of course, in practice that will just mean crypto-token mining rather than anything useful.
Re:New LLM optimization technique slashes memory costs up to... by numpad0 on Tuesday December 17, 2024 @11:27AM (#42442696)
Then why no one seem to be doing it?