Re:Run a 1T parameter model on a 32gb Mac by streaming tenso...
by EnPissant on Tuesday March 24, 2026 @01:30PM
(#47506246)
That assumes you have significant work to do between fetches (so you can prefetch while using the current data). With LLM decode you don't.
[ Parent
| on HN ]
There are no comments on this comment yet.