News for hackers. Stuff that matters.
Re:A visual explanation for regularization of linear models by antipaul on Tuesday May 05, 2020 @05:06PM (#23085062)
Totally. Often, I see a copy paste of that canonical regularization figure in TL,DR 1. which I’ve never seen adequately explained.

Until this post.

Edit: Ok and now I see what you did there ;)

Re:A visual explanation for regularization of linear models by parrt on Tuesday May 05, 2020 @05:45PM (#23085443)
haha. :) Yeah, I got stuck for SOOooo long trying to reconcile the standard picture from ESL book with the math. Turns out they don't match! The picture is for a hard constraint whereas the math penalty term just makes bigger coefficients more expensive. Man, that really threw me.