Likelihood Ratio Test

Also known as · LR test · LR statistic

The likelihood ratio (LR) test is the MLE analogue of the F-test. To test a set of qq restrictions, estimate the model under the restrictions (restricted, LR\mathcal L_R) and without them (unrestricted, LUR\mathcal L_{UR}), then compute LR=2[log⁡LUR−log⁡LR]LR = 2[\log \mathcal L_{UR} - \log \mathcal L_R]. Under the null, LR∼χ2(q)LR \sim \chi^2(q); reject if LRLR exceeds the critical value. Intuition: if removing the restricted variables makes the fit much worse, those variables matter.

When to use

Test any nested-model restriction estimated by MLE — joint significance of multiple variables in a logit/probit, the validity of a constraint, the addition of a polynomial term. In R, lmtest::lrtest(unrestricted, restricted) does it. Contrast with the F-test, which compares sums of squared residuals from OLS models and uses an F distribution — same logic, different distribution.

Appears in

No references yet.