HNHacker News
TopNewBestAskShowJobs

Devilstro

3 karma · joined May 8, 2026

Software & ML engineering student @ DTU
submissionscomments
Devilstro··on A polynomial autoencoder beats PCA on transformer embeddings
In the article, you mention this approach requires no search over hyper-parameter, because the method comprises a closed-form solution with "simple" linear algebra. I agree with this, but do you not in think need to tune the L2-regularization strength? That would for me be a hyper-parameter you would need to do a CV over (or similarly).