News for hackers. Stuff that matters.
Re:How to Visualize Decision Trees by niyyou on Tuesday September 28, 2021 @01:54PM (#28685520)
And his visualization of constrained optimization is astonishing https://explained.ai/regularization/index.html (I struggled for a long time to get the right intuition of a Lagrangian)
Re:How to Visualize Decision Trees by parrt on Tuesday September 28, 2021 @02:23PM (#28685853)
Thanks! Took me a year to discover the key nut there. L1 vs L2 regularization is not well described I found so I went nuts trying to nail it down.
Re:How to Visualize Decision Trees by bravura on Tuesday September 28, 2021 @05:35PM (#28687823)
If you're interested, in my thesis I induced l1-regularized decision trees through a boosting style approach. Adding an l1 term and maximizing the gradient led to sparse tree.