Debrief · 2022 cycle
The 2022 Debrief · post-mortem · permanent archive

How did the polling industry do this cycle?

The 2022 industry MAE landed at 4.6pt — graded across 426 historical races with a known outcome — and 438 polls were analyzed across 102 pollsters. Signed bias +0.35pt: polls landed close to the mean — no systematic over-predict on either side.

INDUSTRY MAE
4.6pt
vs midterm avg
SIGNED BIAS
+0.35pt
R-leaning
POLLS · POLLSTERS
438
102 firms
RACES SCORED
426
w/ known outcome
CYCLE 2012 2014 2016 2018 2020 2022 2024
Industry mean absolute error · 2012–2022
2012 4.7pt 2014 4.8pt 2016 6.5pt 2018 4.5pt 2020 5.9pt 2022 4.6pt 2024 4.1pt MAE · 2-WAY MARGIN
PoliAgg model · self-grade · 2022

How did our own production model do this cycle? The model issues one prediction per race; the polling industry above is averaged across many polls per race. Metrics are not directly comparable but published side-by-side for transparency.

Mean error per race
7.00pp
poliagg-v8 ensemble vs final margin
Call accuracy
93.2%
fraction with right winner called
Races graded
426
outcomes used in the grade
Per-pollster scorecard · 2022 · sorted by MAE
Signed bias · ±4.2pt
MAE · 0–4.2pt
east-carolina-university
+0.12pt
1.0pt
echelon-insights
+0.72pt
1.1pt
siena-researchnyt
+1.05pt
1.1pt
umass-lowellyougov
+0.60pt
1.2pt
suffolk-university
+0.39pt
1.6pt
siena-collegenyt
−1.26pt
1.6pt
fox-news
+1.61pt
2.1pt
bsp-researchshaw-co
−0.30pt
2.1pt
research-co
−0.55pt
3.0pt
oh-predictive-insights
−0.30pt
3.1pt
marist-college
−3.19pt
3.4pt
emerson-college
+0.93pt
3.5pt
surveyusa
−0.22pt
3.6pt
activote
−3.65pt
3.6pt
kaconsulting
+3.64pt
3.7pt
Biggest-miss races · 2022
Race Expected Actual Miss Direction
us-senate-special-2022-ok D+11.50 D+26.53 -15.0pt R-margin underestimate
us-senate-2022-ok D+18.00 D+32.20 -14.2pt R-margin underestimate
us-governor-2022-ar D+14.50 D+27.76 -13.3pt R-margin underestimate
us-governor-2022-ok D+2.00 D+13.66 -11.7pt R-margin underestimate
us-senate-2022-wa R+4.50 R+14.52 10.0pt D-margin underestimate
us-senate-2022-fl D+7.50 D+16.41 -8.9pt R-margin underestimate
us-governor-2022-fl D+11.50 D+19.40 -7.9pt R-margin underestimate
us-governor-2022-co R+12.00 R+19.35 7.3pt D-margin underestimate