News for hackers. Stuff that matters.
Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by EnPissant on Tuesday March 24, 2026 @01:30PM (#47506246)
That assumes you have significant work to do between fetches (so you can prefetch while using the current data). With LLM decode you don't.

There are no comments on this comment yet.