News for hackers. Stuff that matters.

A comment on Apple M3 Ultra. Parent comment

Re:Apple M3 Ultra by pklausler on Thursday March 06, 2025 @01:29AM (#43277059)
There is caching today.
[ Parent | on HN ]
Re:Apple M3 Ultra by ryao on Thursday March 06, 2025 @09:52AM (#43280896)
The cache hitrate is effectively 0 for LLMs since the datasets are so huge.
[ Parent | on HN ]