News for hackers. Stuff that matters.

A comment on DeepSeek-v3.2: Pushing the Frontier of Open Large Language Models [pdf]. Parent comment

Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by miohtama on Monday December 01, 2025 @05:12PM (#46114017)
All modern models are MoE already, no?
[ Parent | on HN ]
Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by hasperdi on Tuesday December 02, 2025 @12:55AM (#46118068)
That's not the case. Some are dense and some are hybrid.

MOE is not the holy grail, as there are drawbacks eg. less consistency, expert under/over-use

[ Parent | on HN ]