News for hackers. Stuff that matters.
Re:Why does a least squares fit appear to have a bias when a... by frumiousirc on Monday January 05, 2026 @06:45AM (#46497677)
L1 (abs linear difference) is useful as minimizing on it gives an approximation of minimizing on L0 (count, aka maximizing sparsity). The reason for the substitution is that L1 has a gradient and so minimization can be fast with conventional gradient descent methods while minimizing L0 is a combinatoric problem and solving that is "hard". It is also common to add an L1 term to an L2 term to bias the solution to be sparse.

There are no comments on this comment yet.