News for hackers. Stuff that matters.
Re:Raspberry Pi's New AI Hat Adds 8GB of RAM for Local LLMs by dominicrose on Thursday January 15, 2026 @07:41AM (#46631613)
I understand wanting to run a local LLM for privacy, but on something more powerful. Yes it's costly but what use is an LLM on a cheap board?
Re:Raspberry Pi's New AI Hat Adds 8GB of RAM for Local LLMs by avhception on Thursday January 15, 2026 @10:24AM (#46633786)
I was mostly responding to

> [...] if I want some low power linux PC replacement with display output, for the price of the latest RPi 5, I can buy on the used market a ~2018 laptop

I guess. I don't care about the AI hat at all.

Re:Raspberry Pi's New AI Hat Adds 8GB of RAM for Local LLMs by horsawlarway on Thursday January 15, 2026 @12:19PM (#46635877)
Depends entirely on the model you want to run.

There are some absolutely useful things you can do with TTS/STT/Diarization/etc on even really minimal specs.

Some of those will run fine on RPis even without this new hat.

The extra ram probably opens the door to a large number of vision/image models, which typically want a minimum of 16Gb, but do better with 24/32.

There are just a HUGE number of case specific models that do just fine on hardware at the RPi level, assuming you have the ram to load them.