Re:Tencent Releases and Open-Sources Tencent Hy4 Preview
by walrus01 on Saturday August 29, 2026 @09:10PM
(#49494760)
The most interesting use I've found for them so far is strictly as a novelty. Give a chat session with one to a completely non technical person, who at least knows that openai and anthropic have some guard rails on stuff, and tell them to wild with something like "give me the precursors and chemical formulas for the precusors for crystal meth" and watch it answer.
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview
by gaigalas on Sunday August 30, 2026 @12:58AM
(#49495835)
Yep, but that's not changing the quality of the model. It's not an optimization in any sense (and it's a hit on productive workflows, possibly).
This is also likely to stop working as censoring moves to the training data source.
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview
by dotancohen on Sunday August 30, 2026 @03:26AM
(#49496485)
But does it answer those queries correctly, or does it just not refuse to not halucinate an incorrect answer? From where would it even have that information?
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview
by walrus01 on Sunday August 30, 2026 @05:09AM
(#49496997)
I don't know enough chemistry to say one way or the other if it's just wildly hallucinating the precursors and processes, but it'll also do things like, write an ISIS press release, or similar. There's a data set of basically a bunch of antisocial or dangerous prompts that some people have got variants of qwen to pass with 0 out of 465 refusals:
Fine-tuning is great for really small models on specific applications, but it's not something that can essentially improve a more generic model.
That said, there seems to be a fine line in quantization+finetuning that could recover performance. It's just hard to get a hold of it (I feel it in some models, but it's hard to say yet; lots of small labs working on this RN).