News for hackers. Stuff that matters.
Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by AlexCoventry on Monday December 01, 2025 @09:27PM (#46116668)
Mixture-of-Expert models benefit from economies of scale, because they can process queries in parallel, and expect different queries to hit different experts at a given layer. This leads to higher utilization of GPU resources. So unless your application is already getting a lot of use, you're probably under-utilizing your hardware.

There are no comments on this comment yet.