The 2024 Debrief · post-mortem · permanent archive
How did the polling industry do this cycle?
The 2024 industry MAE landed at 4.1pt — graded across 479 historical races with a known outcome — and 268 polls were analyzed across 86 pollsters. Signed bias −3.18pt: pollsters again systematically over-predicted Democrats.
INDUSTRY MAE
4.1pt
vs midterm avg
SIGNED BIAS
−3.18pt
D-leaning
POLLS · POLLSTERS
268
86 firms
RACES SCORED
479
w/ known outcome
Industry mean absolute error · 2002–2024
PoliAgg model · self-grade · 2024
How did our own production model do this cycle? The model issues one prediction per race; the polling industry above is averaged across many polls per race. Metrics are not directly comparable but published side-by-side for transparency.
Mean error per race
7.00pp
poliagg-v16 ensemble vs final margin
Call accuracy
97.2%
fraction with right winner called
Races graded
427
outcomes used in the grade
Per-pollster scorecard · 2024 · sorted by MAE
Signed bias · ±5.0pt
MAE · 0–5.0pt
Biggest-miss races · 2024
| Race | Expected | Actual | Miss | Direction |
|---|---|---|---|---|
| us-senate-2024-fl | R+4.00 | R+12.78 | -8.8pt | R-margin underestimate |
| us-senate-2024-nj | D+18.00 | D+9.62 | -8.4pt | D-margin overestimate |
| us-senate-2024-tn | R+22.00 | R+29.64 | -7.6pt | R-margin underestimate |
| us-senate-2024-ny | D+25.00 | D+17.53 | -7.5pt | D-margin overestimate |
| us-senate-special-2024-ne | R+18.00 | R+25.16 | -7.2pt | R-margin underestimate |
| us-senate-2024-me | R+24.00 | R+17.42 | 6.6pt | R-margin overestimate |
| us-governor-2024-mo | R+14.00 | R+20.42 | -6.4pt | R-margin underestimate |
| us-governor-2024-nh | R+3.00 | R+9.34 | -6.3pt | R-margin underestimate |