News for hackers. Stuff that matters.

A comment on I'm making LLMs work on small and old devices. Parent comment

Re:I'm making LLMs work on small and old devices by mikeayles on Friday November 13, 2026 @04:49AM (#50480892)
I haven't written a new blog post for it yet but there's currently a demo live of my FPGA running bonsai 8b on the same FPGA here

https://www.mikeayles.com/blog/on-chip-llm-kv260/

Its right up against the wall of DDR bandwidth, so I'm trying every trick in the book to get the speed up

[ Parent | on HN ]
Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @06:40AM (#50482100)
Decent!! Also I love the idea of the live chat, would you mind if I put a reference to it on my repo?
[ Parent | on HN ]