News for hackers. Stuff that matters.

A comment on Qwen 3.8 27B on my laptop can interpret model weights, too. Parent comment

Re:Qwen 3.8 27B on my laptop can interpret model weights, too by ActorNightly on Tuesday November 03, 2026 @04:19PM (#50358340)
The latent space of models, which basically steers the token generation into a particular direction is much coarser with the local models compared to big models. Small models known fundamentals well, but do not have the breadth to realize the particularities of combination of fundamental task given certain criteria.

As such, if you want to replicate big model behaviour, you need to basically do context augumentation. How you do that is up to you for your own needs.

[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by dr_hooo on Tuesday November 03, 2026 @04:45PM (#50358636)
But the question remains: isn't something like pi.dev good enough for this? Or are you using custom harness to describe the scripts/skills/etc that you create yourself?
[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by trog on Tuesday November 03, 2026 @06:48PM (#50359833)
I am cheerfully using Opencode and pi.dev on a local model without thinking about any of that stuff, just running it straight out of the box and it's working great. I have access to an RTX6000 on a remote machine so using it for 'free' and it's replaced Claude for my personal projects. It gets stuck occasionally and gets things wrong from time to time, but so does everything.
[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by ActorNightly on Tuesday November 03, 2026 @10:21PM (#50361159)
No. All agents out there basically operate on skills, mempry, and tools. There are almost none that do context injection with every prompt. You basically need an external system that modifies every submitted prompt with additional context
[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by dr_hooo on Wednesday November 04, 2026 @09:11PM (#50374222)
Okay, just started to read up an Agentic Context Engineering (ACE) & Co,: really interesting. Thank you for the explanation!
[ Parent | on HN ]
Re:Qwen 3.8 27B on my laptop can interpret model weights, too by nickspacek on Wednesday November 04, 2026 @05:47AM (#50363745)
Yes, this is a straightforward extension for Pi to have it continually steer the model at every turn. You could write your own with Pi itself or use an existing extension.
[ Parent | on HN ]