Propensity Score Matching

Classical Rosenbaum-Rubin propensity-score matching framework and its diagnostics, ingested from Stuart (2010), “Matching Methods for Causal Inference: A Review and a Look Forward,” Statistical Science 25(1).

Routing Summary

Concept Map

ConceptNoteTypeDepends OnKey Result
Workflow & four uses of PSPropensity Score Matching - OverviewoverviewPotential Outcomes, Balancing PropertySeparate design (no outcomes) from analysis; PS used for matching, subclassification, weighting, adjustment
PS definition + Rosenbaum-Rubin theoremPropensity Score and the Balancing PropertytheoremPotential Outcomes, Conditional Independence is a balancing score; under strong ignorability, conditioning on scalar removes observed-covariate bias
Distances & matching structuresMatching Methods and Distance MeasuresconceptBalancing PropertyExact/Mahalanobis/caliper distances; k:1, greedy vs. optimal, with/without replacement, full matching, IPTW
Balance diagnosticsCovariate Balance DiagnosticsconceptBalancing Property, Distance MeasuresUse standardized mean diffs & variance ratios (<0.25, 0.5-2), QQ plots; never use balance p-values
Overlap / common supportCommon Support and OverlapconceptBalancing PropertyEstimate effects only on the region of common support; trim outside it; overlap constrains ATE vs. ATT
Balancing theorem, ATT estimand, PSM vs IPW, when matching failsPropensity Score Matching - Balancing Theorem and Failure ModesconceptThe Selection Problem, Conditional Independence Assumption, Frequentist Causal Estimation is a sufficient statistic for covariate balance; PSM discards units, IPW reweights — complementary methods
NN greedy, caliper , optimal/full matching, subclassificationMatching Algorithms and CaliperconceptPropensity Score Matching - Balancing Theorem and Failure ModesCaliper prevents poor matches; optimal matching minimises total distance globally; full matching uses all data
SMD, love plot, overlap plot, variance ratio, Rubin (2001) criteriaCovariate Balance and Matching DiagnosticsconceptPropensity Score Matching - Balancing Theorem and Failure Modes, Matching Algorithms and CaliperBalance assessed via effect sizes ($

Notes

  • Propensity Score Matching - Overview — CONTAINS: definition of matching, two settings, outcome-free design vs. analysis, the four implementation steps, ATT/ATE estimands, the four uses of the propensity score, Chapin curse-of-dimensionality example, matching-vs-regression complementarity.
  • Propensity Score and the Balancing Property — CONTAINS: , strong ignorability (unconfoundedness + positivity), balancing-score theorem , ignorability given the PS, liberal variable-selection rule (balance not c-statistic), linear/logit PS, caliper bias-reduction figures (0.2 SD → 98%).
  • Matching Methods and Distance Measures — CONTAINS: four affinely-invariant distances with formulas, Mahalanobis-within-caliper formula, k:1 nearest neighbor & ratio matching, greedy vs. optimal, with/without replacement & frequency weights, subclassification (5-10 → 90% bias), full matching (Hansen SAT example), IPTW & weighting-by-odds formulas, weight trimming, doubly-robust.
  • Covariate Balance Diagnostics — CONTAINS: standardized difference in means formula, Rubin (2001) three balance measures, thresholds (SMD<0.25, var ratio 0.5-2), the balance-test caution (in-sample property; tests conflate balance with power), QQ plots and before/after standardized-difference plots.
  • Common Support and Overlap — CONTAINS: region of common support / positivity, propensity-score trimming and convex-hull (King-Zeng), how calipers vs. weighting handle overlap, estimand implications (ATE vs. ATT), why matching surfaces non-overlap that regression hides.
  • Propensity Score Matching - Balancing Theorem and Failure Modes — CONTAINS: Propensity score definition, balancing theorem (R&R 1983 Thm 1), strong ignorability definition, ATT vs ATE estimand comparison, PSM vs IPW table, the matching workflow, why PSM fails for activity bias
  • Matching Algorithms and Caliper — CONTAINS: Logit PS distance metric, NN greedy matching (with/without replacement), caliper definition and width rule, optimal matching, full matching, 1:k matching, subclassification, Mahalanobis distance, common support trimming, MatchIt R code
  • Covariate Balance and Matching Diagnostics — CONTAINS: SMD formula and SMD threshold, why -values are wrong for balance, love plot (definition + cobalt R code), propensity score overlap plot, variance ratio, KS statistic, ESS for weighting, Rubin (2001) three-criteria theorem, outcome-blinding principle, ATT estimation after matching

External Connections

Potential Outcomes Framework · Conditional Independence Assumption · Frequentist Causal Estimation · The Selection Problem · Omitted Variables Bias · Synthetic Control · Bayesian Inverse Probability Weighting · Bayesian Inverse Probability Weighting · Activity Bias in Advertising

Sources

  • Stuart 2010 - Matching Methods for Causal Inference - A Review — Stuart, E. A. (2010). Matching Methods for Causal Inference: A Review and a Look Forward. Statistical Science 25(1), 1-21.