Devilstro
Re:A polynomial autoencoder beats PCA on transformer embeddings
on Friday May 08, 2026 @04:05AM (#48060114)
In the article, you mention this approach requires no search over hyper-parameter, because the method comprises a closed-form solution with "simple" linear algebra. I agree with this, but do you not in think need to tune the L2-regularization strength? That would for me be a hyper-parameter you would need to do a CV over (or similarly).