Lasso Regression

L1-regularised regression that can shrink coefficients exactly to zero, so it performs automatic feature selection.

When to use

Prefer it over Ridge Regression when many features are probably irrelevant (in PS 04 it dropped has_sunroof). Scale features first and pick alpha by cross-validation: too large and every coefficient goes to zero and the model underfits.

See DS Lec 4.

Appears in