Week 6 · Dr. Aluma Dembo

Simultaneous Equations & Time Series

Simultaneous Equations & Time Series

Part of: Econometrics Lecture 06 — Applied Econometrics, Dr. Aluma Dembo Key concepts: Simultaneous Equations Model, Serial Correlation, Time Series, Distributed Lag Model, Autoregressive Model, Static Model, Strict Exogeneity, Seasonality, HAC Standard Errors


Part 1: Simultaneous Equations Models


The Fulton Fish Market Problem

Graddy (1995) studied the wholesale market for whiting fish at the Fulton Fish Market in New York (Dec 1991 – May 1992). The goal: estimate supply and demand elasticities — how sensitive quantity is to price on each side of the market.

The model has two equations:

Supply:log⁡QtS=αSlog⁡Pt+βS⋅weathert+utS\text{Supply:} \quad \log Q_t^S = \alpha_S \log P_t + \beta_S \cdot \text{weather}_t + u_t^S
Demand:log⁡QtD=αDlog⁡Pt+βD⋅day.of.weekt+utD\text{Demand:} \quad \log Q_t^D = \alpha_D \log P_t + \beta_D \cdot \text{day.of.week}_t + u_t^D
  • αS\alpha_S = price elasticity of supply (how much more fish gets brought if price rises)
  • αD\alpha_D = price elasticity of demand (how much less fish gets bought if price rises — expected negative)
  • At equilibrium: QtS=QtD=QtQ_t^S = Q_t^D = Q_t
The supply/demand logic

Think of the supply and demand curves as fixed relationships between price and quantity. What we observe in the data is the equilibrium point where those curves cross. Over time, these curves shift due to weather (supply shifts) and day of the week (demand shifts) — and those shifts trace out different equilibrium points.


Why OLS Fails: Endogeneity in Simultaneous Systems

The central problem: price PtP_t is endogenous in both equations.

Here's why: if there's a random shock to supply (utSu_t^S changes), the supply curve shifts, the equilibrium moves, and so price changes. This means cov(Pt,utS)≠0\text{cov}(P_t, u_t^S) \neq 0. Similarly, a demand shock shifts the demand curve and changes equilibrium price, so cov(Pt,utD)≠0\text{cov}(P_t, u_t^D) \neq 0.

In other words, price and quantity are determined together — they're jointly endogenous. Running OLS on either equation treats price as exogenous, which it isn't.

The identification problem

When you observe price and quantity over time, you're watching equilibrium points shift around. Those shifts could be driven by supply changes or demand changes — and without extra information, you can't tell which curve you're tracing. This is the classic "identification problem" in supply/demand estimation.

  Supply shifts (weather) → supply curve moves → new equilibrium (P,Q)
  Demand shifts (day of week) → demand curve moves → new equilibrium (P,Q)

IV Solution: Using Curve Shifters as Instruments

The fix: use variables that shift one curve as instruments for price. This traces out the other curve.

Identifying the Demand Curve

To estimate the demand elasticity, we need exogenous variation in price that's not caused by demand. Weather (affecting supply only) gives us exactly this.

First stage — instrument for equilibrium quantity using weather:

log⁡QtS=γ0+γ1weathert+ϵt\log Q_t^S = \gamma_0 + \gamma_1 \text{weather}_t + \epsilon_t

Second stage — demand equation using predicted quantity:

log⁡Pt=β0+β1log⁡QtS^+β2day.of.weekt+νt\log P_t = \beta_0 + \beta_1 \widehat{\log Q_t^S} + \beta_2 \text{day.of.week}_t + \nu_t

Why does this work?

  • Weather affects supply (rougher seas = fewer fish) → shifts the supply curve → price changes for supply-side reasons
  • Weather has no direct effect on demand (consumers don't care about sea conditions)
  • So weather is a valid instrument for price in the demand equation
The logic in plain English

On stormy days, fewer fish make it to market. Supply drops, price rises. This price variation is purely supply-driven — it's not because consumers suddenly want more fish. So by looking at how quantity demanded responds to these supply-driven price changes, we can estimate the demand elasticity. That's what IV achieves.

Instrument Shifts Valid for identifying
Weather (windspeed, wave height) Supply curve Demand equation
Day of week Demand curve Supply equation
type: supply-shift-identification
Why a shifter "traces out" the other curve

Hold demand fixed (green) and let weather push the supply curve (blue) in and out. Each storm or calm day produces a new equilibrium where the curves cross — and those red dots line up exactly along the demand curve. That's the whole trick: weather varies price for supply-side reasons only, so watching how quantity responds to those price moves reveals the demand elasticity. Without a shifter you'd just see a scatter of dots and couldn't tell which curve you were looking at.


Part 2: Serial Correlation in Time Series


What is Serial Correlation?

Serial correlation (also called autocorrelation) is when residuals at different time periods are correlated with each other:

cov(ut,ut−1)≠0\text{cov}(u_t, u_{t-1}) \neq 0

In the fish market example: after running the IV model, plotting residuals over time reveals a pattern — today's residual is related to yesterday's residual. This violates Assumption TS.4 (no serial correlation).

type: serial-correlation
Two views of the same problem

On the left, the residuals don't bounce randomly around zero — they drift in long runs above and below the line (a positive shock today tends to persist tomorrow). On the right, regressing u^t\hat u_t on u^t−1\hat u_{t-1} gives a clear positive slope (ρ^\hat\rho), so we reject H0:ρ=0H_0:\rho=0. The coefficients stay consistent, but the naive standard errors are too small — which is exactly what HAC (Newey-West) errors repair.

Why would errors be serially correlated?

In time series, many things that affect your outcome today also affect it tomorrow. If today's fish price is unexpectedly high due to some unobserved factor (e.g. a food festival this week), that effect often carries over into tomorrow's price. The error term "remembers" the past.

Why is this a problem?

Impact What happens
Unbiasedness OLS estimators remain unbiased (if exogeneity holds)
Consistency Estimators remain consistent under weak exogeneity
Efficiency OLS is no longer efficient — it's not BLUE
Standard errors Usual standard errors are wrong — hypothesis tests are invalid even in large samples
Serial correlation invalidates your t-tests

Even if your coefficients are right in large samples, the standard errors you compute assuming no serial correlation are biased downward — making your estimates look more significant than they are. This is why you can't just ignore it.

Fix: HAC Standard Errors (Newey-West)

Use Heteroskedasticity and Autocorrelation Consistent (HAC) standard errors. The most common are Newey-West standard errors.

  • The coefficient estimates don't change — only the standard errors are recalculated
  • HAC standard errors are typically larger than naive OLS standard errors (correct widening of confidence intervals)
  • p-values increase → some previously significant results may no longer be significant

Testing for Serial Correlation

Run a regression of residuals on their own lag:

u^t=ρu^t−1+et,∣ρ∣<1\hat{u}_t = \rho \hat{u}_{t-1} + e_t, \quad |\rho| < 1

Test H0:ρ=0H_0: \rho = 0 against H1:ρ≠0H_1: \rho \neq 0.

  • If you reject H0H_0: evidence of serial correlation → use HAC standard errors.

Part 3: Time Series Models


What is a Time Series?

A time series is a sequence of random variables indexed by time: {yt}t=1T\{y_t\}_{t=1}^T.

  • What you observe is one realisation (one possible sequence of outcomes) from an underlying stochastic process
  • The "population" is all possible sequences the process could have generated
  • The key feature: ordering matters — the past can influence the future, but not vice versa
Why is time series different from cross-section?

With cross-sectional data (e.g. 1,000 people), observations are typically independent. With time series, observations are correlated over time — what happened last quarter shapes what happens this quarter. This requires adapting our assumptions.


The Static Model

yt=β0+β1xt+utfor t=1,…,Ty_t = \beta_0 + \beta_1 x_t + u_t \quad \text{for } t = 1, \ldots, T

The static model assumes xx affects yy immediately and only in the same time period. No lag effects — whatever xtx_t is now is what determines yty_t now.

Example — Static Phillips Curve:

inflationt=β0+β1unemploymentt+ut\text{inflation}_t = \beta_0 + \beta_1 \text{unemployment}_t + u_t

The idea: higher unemployment today → lower inflation today (firms compete harder for workers, wage pressure drops, prices follow).


Assumptions for OLS with Time Series

In time series, the standard OLS assumptions are modified. The key change is to exogeneity.

TS.2: Strict Exogeneity (stronger than before)

E[ut∣X]=0\mathbb{E}[u_t \mid \mathbf{X}] = 0

where X\mathbf{X} is all explanatory variables across all time periods (past, present, and future).

Compare with the standard cross-section assumption (contemporaneous exogeneity):

E[ut∣xt]=0(only requires independence at time t)\mathbb{E}[u_t \mid x_t] = 0 \quad \text{(only requires independence at time } t \text{)}
Strict exogeneity is a strong demand

Strict exogeneity requires that utu_t is uncorrelated with xsx_s for all ss — even future values of xx. This fails when:

  • xx is a lagged dependent variable (e.g. yt−1y_{t-1} — obviously correlated with ut−1u_{t-1} which affects yt−1y_{t-1})
  • xx reacts to past values of yy (feedback loops — e.g. central banks adjust interest rates in response to past inflation)
Assumption What it requires Gives you
Contemporaneous exogeneity (A2) E[ut∣xt]=0\mathbb{E}[u_t \mid x_t] = 0 Consistency
Strict exogeneity (TS.2) E[ut∣X]=0\mathbb{E}[u_t \mid \mathbf{X}] = 0 Unbiasedness

Additional time series assumptions:

  • TS.3 Homoskedasticity: Var(ut∣X)=σ2\text{Var}(u_t \mid \mathbf{X}) = \sigma^2 (constant variance across time)
  • TS.4 No serial correlation: Corr(ut,us∣X)=0\text{Corr}(u_t, u_s \mid \mathbf{X}) = 0 for all s≠ts \neq t
  • TS.5 Normality: ut∼i.i.d.  N(0,σ2)u_t \sim \text{i.i.d.} \; N(0, \sigma^2)

Under A1 + TS.2–TS.4: OLS gives correct standard errors and valid tt/FF-tests. Under A1 + TS.2–TS.5: OLS is normally distributed; tt and FF statistics have exact distributions.


Distributed Lag (DL) Models

What if xx in period tt affects yy not just now, but also in future periods?

yt=α0+δ0xt+δ1xt−1+δ2xt−2+⋯+δqxt−q+ut\boxed{y_t = \alpha_0 + \delta_0 x_t + \delta_1 x_{t-1} + \delta_2 x_{t-2} + \cdots + \delta_q x_{t-q} + u_t}

This is a Distributed Lag model with qq lags. The static model is the special case where δ1=⋯=δq=0\delta_1 = \cdots = \delta_q = 0.

Interpreting the coefficients:

  • δ0\delta_0 = the impact effect — how much yy changes in period tt if xx increases by 1 in period tt
  • δk\delta_k = the kk-period lag effect — how much yy changes in period t+kt+k due to a one-time increase in xx at period tt
  • ∑k=0qδk\sum_{k=0}^{q} \delta_k = the long-run multiplier — the total cumulative effect of a permanent one-unit increase in xx
Dynamic Phillips Curve

inflationt=α+δ0unempt+δ1unempt−1+ut\text{inflation}_t = \alpha + \delta_0 \text{unemp}_t + \delta_1 \text{unemp}_{t-1} + u_t

If unemployment increases by 1pp this period:

  • Inflation falls by δ0\delta_0 this period
  • Inflation falls by an additional δ1\delta_1 next period
  • Total effect over two periods: δ0+δ1\delta_0 + \delta_1

In the fish market example: cor(unempt,unempt−1)=0.752\text{cor}(\text{unemp}_t, \text{unemp}_{t-1}) = 0.752 — unemployment is highly autocorrelated (persistent), so the static model understates the full effect.

Multicollinearity in DL models

Lagged values of the same variable tend to be highly correlated with each other. This inflates standard errors and makes it hard to identify individual δk\delta_k coefficients precisely. The long-run total may be well-identified even when individual lags are not.


Autoregressive (AR) Models

What if past values of yy itself help predict current yy?

AR(1) model:

yt=ρyt−1+et\boxed{y_t = \rho y_{t-1} + e_t}

AR(q) model:

yt=α+ϕ1yt−1+ϕ2yt−2+⋯+ϕqyt−q+ety_t = \alpha + \phi_1 y_{t-1} + \phi_2 y_{t-2} + \cdots + \phi_q y_{t-q} + e_t
Why AR models matter

Many economic series are persistent — GDP this quarter is very similar to GDP last quarter, exchange rates tomorrow look like exchange rates today. AR models capture this persistence directly. They're the backbone of most macroeconomic forecasting.

A critical limitation: strict exogeneity cannot hold

In an AR(1): yt−1y_{t-1} is the regressor, and it's correlated with et−1e_{t-1} (because yt−1y_{t-1} is partly determined by et−1e_{t-1}). So cov(yt−1,et−1)≠0\text{cov}(y_{t-1}, e_{t-1}) \neq 0 — strict exogeneity is violated by construction.

This means:

  • ✅ AR models are consistent (under weak exogeneity / contemporaneous exogeneity, which does hold)
  • ❌ AR models are necessarily biased in finite samples
Weak vs. strict exogeneity in AR models

Weak exogeneity (E[et∣yt−1]=0\mathbb{E}[e_t \mid y_{t-1}] = 0) can plausibly hold — knowing last period's yy shouldn't help predict this period's error. That's enough for consistency. Strict exogeneity would require ete_t to be uncorrelated with future yy — impossible if yt+1y_{t+1} depends on yty_t.


Combining AR and DL: The ADL Model

The most general and flexible time series model:

yt=α+ϕ1yt−1+ϕ2yt−2+⋯+δ0xt+δ1xt−1+⋯+βZ+ety_t = \alpha + \phi_1 y_{t-1} + \phi_2 y_{t-2} + \cdots + \delta_0 x_t + \delta_1 x_{t-1} + \cdots + \beta Z + e_t

This is an Autoregressive Distributed Lag (ADL) model. It allows for:

  • Inertia in yy (AR terms)
  • Lagged effects of xx (DL terms)
  • Other controls ZZ
Predicting Global Temperature from CO2

tempt=α+ϕ1tempt−1+ϕ2tempt−2+δ0CO2t+δ1CO2t−1+⋯+et\text{temp}_t = \alpha + \phi_1 \text{temp}_{t-1} + \phi_2 \text{temp}_{t-2} + \delta_0 \text{CO2}_t + \delta_1 \text{CO2}_{t-1} + \cdots + e_t Temperature is persistent (AR terms capture momentum) but also responds to CO2 with a distributed lag effect. ADL handles both.


Seasonality

Many time series exhibit seasonality — predictable, regular patterns tied to the calendar.

Examples:

  • Construction activity peaks in summer (weather-dependent)
  • Cheese sales spike around Shavuot
  • "Matzo" Google searches spike every Passover

Handling seasonality: seasonal dummy variables

For monthly data (January as the reference/control group):

yt=β0+δ1Febt+δ2Mart+⋯+δ11Dect+β1xt1+⋯+uty_t = \beta_0 + \delta_1 \text{Feb}_t + \delta_2 \text{Mar}_t + \cdots + \delta_{11} \text{Dec}_t + \beta_1 x_{t1} + \cdots + u_t

For quarterly data (Q4 as reference):

yt=β0+δ1q1t+δ2q2t+δ3q3t+β1xt1+⋯+uty_t = \beta_0 + \delta_1 q1_t + \delta_2 q2_t + \delta_3 q3_t + \beta_1 x_{t1} + \cdots + u_t
  • Each seasonal dummy captures how much higher/lower the outcome is in that month/quarter compared to the reference period, holding everything else constant.
  • The reference category (excluded dummy) is absorbed into β0\beta_0.
Seasonally adjusted data

Some macroeconomic data from statistical agencies (e.g. GDP, unemployment) are already "seasonally adjusted" — the seasonal patterns have been removed before you receive the data. Check your data source: if it's already seasonally adjusted, don't add seasonal dummies again.


Summary: Time Series Model Types

Model Formula When to use
Static yt=β0+β1xt+uty_t = \beta_0 + \beta_1 x_t + u_t xx affects yy instantly, no carry-over
Distributed Lag (DL) yt=α+δ0xt+δ1xt−1+⋯+uty_t = \alpha + \delta_0 x_t + \delta_1 x_{t-1} + \cdots + u_t xx has lagged effects on yy
Autoregressive (AR) yt=α+ϕ1yt−1+⋯+ety_t = \alpha + \phi_1 y_{t-1} + \cdots + e_t yy's own past predicts its future
ADL Combines AR + DL General purpose — both inertia and lagged effects

Summary

  1. Simultaneous equations models create endogeneity because price and quantity are jointly determined. OLS on either equation is biased.
  2. IV solves identification: use supply shifters (weather) to identify demand, and demand shifters (day of week) to identify supply.
  3. Serial correlation means residuals are correlated over time — this leaves coefficients consistent but makes standard errors wrong. Fix with HAC (Newey-West) standard errors.
  4. Strict exogeneity (TS.2) requires the error to be uncorrelated with xx at all time periods — past, present, and future. Contemporaneous exogeneity (A2) only requires independence at the same period.
  5. Distributed lag models let xx affect yy over multiple periods. Each δk\delta_k is the effect of xx at time tt on yy at time t+kt+k.
  6. AR models include lagged yy as a regressor — consistent but necessarily biased in finite samples.
  7. Seasonality is handled with dummy variables for each month or quarter (minus one for the reference category).