News for hackers. Stuff that matters.
Re:AI could be the end of the digital wave, not the next big... by dukky on Monday April 13, 2026 @09:31AM (#47751711)
I thought this comment was going the opposite way - previously no internet/googling but now you can run a local model and figure things out without the need for internet at all
Re:AI could be the end of the digital wave, not the next big... by wanderingstan on Monday April 13, 2026 @09:50AM (#47751960)
Mine as well. 2 years ago my mind was blown that I could code in a language I didn’t know (scala) while on a log train ride with no internet (Amtrak) using a local model on a laptop. Couldn’t believe it.
Re:AI could be the end of the digital wave, not the next big... by jimbokun on Monday April 13, 2026 @10:28AM (#47752490)
The staggeringly effective compression of LLMs is still under appreciated, I think.

2 years ago you had downloaded onto your laptop an effective and useful summary of all of the information on the Internet, that could be used to generate computer programs in an arbitrarily selected programming language.

Re:AI could be the end of the digital wave, not the next big... by leoedin on Monday April 13, 2026 @11:59AM (#47753991)
I got excited about that, until I actually tried to download a model and run it locally and ask it questions. A current gen local LLM which is small enough to live on disk and fit in my laptop's RAM is very prone to hallucination of facts. Which makes it kind of useless.

Ask your local model a verifiable question - for example a list of tallest buildings in Europe. I did it with Gemma on my laptop, and after the top 3 they were all fake. I just tried that again with Gemma-4 on my iphone, and it did even worse - the 3 tallest buildings in Europe are apparently the Burj Khalifa, the Torre Glories and the Shanghai Tower.

I wouldn't call that effective compression of information.

Re:AI could be the end of the digital wave, not the next big... by MattPalmer1086 on Monday April 13, 2026 @02:50PM (#47756327)
I don't think any LLMs are good at accurately regurgitating arbitrary facts, unless they happen to be very common in their training, and certainly not good at making novel comparisons between them.
Re:AI could be the end of the digital wave, not the next big... by theshrike79 on Wednesday April 15, 2026 @06:09AM (#47776978)
Yea, it's not an encyclopedia of facts. Language models store the FEELS of the data in vectors (or angles in Gemma4's case, it's a cool thing) not the exact string.

But what you can do with local models is give them actual data and tools to search it. Download a copy of Wikipedia locally, give the agent a way to search it and BOOM accurate information without an internet connection.

Also "small enough to live on disk" is a bit vague, especially when models get super stupid super fast when you get to the smaller size. At that point they're just basically 40k servitors that can use tools and nothing much.

Re:AI could be the end of the digital wave, not the next big... by wanderingstan on Monday April 13, 2026 @10:46AM (#47752776)
Yes! Continuing on thoughts of LLM compression, I'm now convinced and amazed that economics will dictate that all devices contain a copy of all information on the Internet.

I wrote a post about it: Your toaster will know mesopotamian history because it’s more expensive not too.

https://wanderingstan.com/2026-03-01/your-toaster-will-know-...

Re:AI could be the end of the digital wave, not the next big... by queenkjuul on Monday April 13, 2026 @11:37AM (#47753574)
Fairly certain the least expensive option will always be a dumb toaster that just plugs into the wall
Re:AI could be the end of the digital wave, not the next big... by wanderingstan on Monday April 13, 2026 @11:57AM (#47753961)
I chose a toaster specifically because it's about the simplest electrical device out there, and thus pushes the thesis to the extreme. But smart toasters are pretty common: https://revcook.com/products/r180-connect-plus-smart-toaster...

And as other commenter pointed out, a smart toaster with ads or data collection can be subsidized and thus be more profitable. (Oh what a world we're headed for!)

In any case, I think the LLM-everywhere thesis holds even strong for even moderate-complexity devices like power plugs, microwaves, and mobile phones.

Re:AI could be the end of the digital wave, not the next big... by maartenh on Monday April 13, 2026 @11:49AM (#47753795)
But in that case, it won't be subsidized by the manufacturer!

I'm sure people would get a cheaper toaster in exchange of an ad being burned in your bread.

Re:AI could be the end of the digital wave, not the next big... by ryandrake on Monday April 13, 2026 @02:55PM (#47756384)
Shhhhhhhhh! Don't give them any more bad ideas, sheesh!
Re:AI could be the end of the digital wave, not the next big... by jimbokun on Monday April 13, 2026 @11:44AM (#47753702)
Not if it requires the toaster company to maintain a different SKU without the LLM chip and sells very few units.
Re:AI could be the end of the digital wave, not the next big... by bayarearefugee on Monday April 13, 2026 @01:36PM (#47755379)
> Your toaster will know mesopotamian history because it’s more expensive not too.

But will it know the difference between too and to?