News for hackers. Stuff that matters.
Re:Tongyi DeepResearch – open-source 30B MoE Model that riva... by Imustaskforhelp on Sunday November 02, 2025 @10:15PM (#45795525)
This is so interesting, I am curious as to why, can you (or anyone) please provide any resources or insightful comments about it, they would really help a ton out here, thanks!
Re:Tongyi DeepResearch – open-source 30B MoE Model that riva... by pixelmelt on Monday November 03, 2025 @01:57AM (#45796509)
Gpt3 was trained on completion data so it likely saw lots of raw chess games layed out in whatever standard format moves are listed in, while 3.5 was post trained on instruct data (talking back and forth) which would have needed to explicitly include those chess games as conversational training data for it to retain as much as it would otherwise