News for hackers. Stuff that matters.
Re:MeshGPT: Generating triangle meshes with decoder-only tra... by topwalktown on Tuesday November 28, 2023 @07:21PM (#38453654)
Quantization also works as regularization; it stops the neural network from being able to use arbitrarily complex internal rules.

But really it's only really useful if you absolutely need to have a discrete embedding space for some sort of downstream usage. VQVAEs can be difficult to get to converge, they have problems stemming from the approximation of the gradient like codebook collapse

There are no comments on this comment yet.