News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by baq on Tuesday December 17, 2024 @02:32AM (#42439196)
You have a sota multi-modal LLM running in your head at 20W, shared with best in class sensor package and top performing robotics control unit.

There’s soooo much more to optimize.

Re:New LLM optimization technique slashes memory costs up to... by fecal_henge on Tuesday December 17, 2024 @03:35AM (#42439515)
But can it know love?
Re:New LLM optimization technique slashes memory costs up to... by baq on Tuesday December 17, 2024 @04:41AM (#42439876)
Word on the street is researchers looked at the weights and weights looked back. You’ll have to ask the weights.
Re:New LLM optimization technique slashes memory costs up to... by myrmidon on Tuesday December 17, 2024 @07:12AM (#42440729)
I would argue that our sensor package is losing its lead very quickly-- audio performance is already on par with current tech and image processing is closing the gap very quickly as well (it helps a lot that silicon-based technology is much less constrained on bandwidth). Tactile sensing is still lightyears ahead, and I don't see that situation improving anytime soon...
Re:New LLM optimization technique slashes memory costs up to... by IWeldMelons on Tuesday December 17, 2024 @09:32AM (#42441619)
chemical sensing is still quite good though.