News for hackers. Stuff that matters.

A comment on Local AI needs to be the norm. Parent comment

Re:Local AI needs to be the norm by reisse on Sunday May 10, 2026 @08:42PM (#48089751)
Nothing special?

I mean, inference engine might need to get some tweaks, to support whatever compute is available. But then, if you put a few terabytes of disk for swap, and replace RAM to bigger sticks if possible, it should work? Slowly, of course, but there is no reason it should not to.

[ Parent | on HN ]
Re:Local AI needs to be the norm by reverius42 on Sunday May 10, 2026 @09:17PM (#48089989)
The big difference will be measuring seconds per token instead of tokens per second.
[ Parent | on HN ]
Re:Local AI needs to be the norm by martijnvds on Monday May 11, 2026 @12:50AM (#48091159)
Seconds per token is just fractional tokens per second ;)
[ Parent | on HN ]
Re:Local AI needs to be the norm by degamad on Monday May 11, 2026 @03:50AM (#48092194)
> fractional

Reciprocal?

[ Parent | on HN ]