> It appears that GLM-5.2 is able to propagate Llama3.1-8B well, which suggests that future small models of the same capability level could also complete the network enumeration... by the end of 2026
so an 8B model will be as good as a 744B one in a few months!?
---
their table of potential devices the botnet can use:
- endoscopy AI units - portable DNA sequencers - smart shopping carts - surgical robots
---
that these tiny models with limit 32k context windows can even carry out the network scouting + exploitation + inference (they never tested all 3 together)
that these models would have complex goals without prompting them to explicitly do such a thing, and that these can run autonomously. they can't.
self-replicating and doing what with what hardware?
---
a 26B Gemma model running across 15 LOCAL $55 Android TV boxes at 0.39 t/s! wow.
plus who has 15 android TVs in the same home (wth fast local LAN)!?
- endoscopy AI units - portable DNA sequencers - smart shopping carts - surgical robots
this is ridiculous.
to the point where it's really great at coding, but lost its knowledge on how to write well!
if instead opus 5 was a full fresh training run, i don't think it'd be this trash at writing.
really great coding perf, but now the weights are adapted to so much code fine tuning that it writes like a weird engineer that's trying to sound smart.
And I can let you use it on this 6-month window for free because it costs me nothing per user! Your own device does all the processing :D
Hi HN :D I'm 20 and I spent a year building something that shouldn't be possible: a custom on-device vision LLM that processes your entire digital life overnight on a phone.We all have thousands of buried screenshots, notes, files, bookmarks, saved posts, etc we'll never find again. The only way to make AI understand all of it is to upload everything to the cloud -- privacy nightmare, and way...
https://github.com/theJayTea/WritingTools/releases/tag/v5
I posted this previously, but there's been a major update.As a high school student, I love LLMs and the execution of Apple's Appel Intelligence Writing Tools, but was disappointed that nothing like that existed for Windows. I thus created Writing Tools, a better than Apple Intelligence open-source alternative that works system-wide on Windows. It's much better than the tiny 2B parameter Apple...
https://github.com/theJayTea/WritingTools/releases/tag/v3
I posted this a while back, but there's been a major update — it now supports local LLMs, multiple cloud LLMs, code editing, chat mode, themes, dark mode, and more!As a high school student, I love LLMs and the execution of Apple's Appel Intelligence Writing Tools, but was disappointed that nothing like that existed for Windows. So, I created Writing Tools, a better than Apple Intelligence...
https://github.com/theJayTea/WritingTools/blob/main/README.md
As a high school student, I love LLMs and the execution of Apple's Appel Intelligence Writing Tools, but was disappointed that nothing like that existed for Windows. So, I created Writing Tools, a better than Apple Intelligence open-source alternative that works system-wide on Windows!Key features: - Uses Google's Gemini 1.5 Flash model for superior AI-assisted writing (much better than the...