Index: Bayesian Media Mix Modeling

Deep ingestion of Jin, Wang, Sun, Chan & Koehler (Google, 2017), “Bayesian Methods for Media Mix Modeling with Carryover and Shape Effects” — a flexible-functional-form media mix model (MMM) estimated by MCMC, with attribution metrics (ROAS/mROAS), optimal-mix derivation, prior-sensitivity analysis, BIC model selection, and a shampoo-advertiser application.

Routing Summary

Concept Map

ConceptNoteTypeDepends OnKey Result
MMM overview & combined modelBayesian Media Mix Modeling - OverviewoverviewCarryover, ShapeAdditive model ; Bayesian to offset weak single-dataset signal
Adstock / carryoverCarryover (Adstock) Functional FormsdefinitionCarryover Effects and Distributed LagsGeometric decay (= Koyck analog) and delayed/peak (Gaussian kernel), finite-window normalized
Shape / saturationShape (Saturation) EffectsdefinitionShape of the Marketing Response FunctionHill ; Hill poorly identifiable → prefer reach ()
Bayesian estimation & priorsBayesian Estimation and Priors for MMMconceptOverview, Carryover, Shape, MCMC BasicsGibbs/HMC MCMC; small samples → posterior dominated by prior → biased estimates
ROAS, mROAS, optimal mixROAS, mROAS, and Optimal Media MixdefinitionBayesian EstimationCounterfactual zero/perturb spend incl. post-change period; optimal mix has large (multimodal) variance
Model selection & applicationMMM Model Selection and Applicationexampleall of the aboveBIC picks parsimonious Model IV (geometric + reach), BIC 51.49; large samples recover, two-year samples biased
Simulation designJin 2017 MMM - Simulation Design, Signal Strength and PriorsexampleOverview, Carryover, ShapeDGP with Table 1 parameters; signal strength metric (Eq. 17); Table 3 priors
Simulated attribution and optimisationJin 2017 MMM - Simulated ROAS, mROAS and Optimization ResultsexampleROAS, mROAS, and Optimal Media MixROAS/mROAS recovered in large samples; optimal mix unimodal (Scenario I) vs trimodal (Scenario II)
Sample size vs biasJin 2017 MMM - Sample Size vs Bias Study (Two vs Sixty Years)exampleBayesian Estimation and Priors for MMMTwo years: curves underestimated by about 18-40%; sixty years: bias near zero (500 replicates)
Prior sensitivityJin 2017 MMM - Prior Sensitivity Experiments on Beta and Half-SaturationexampleBayesian Estimation and Priors for MMMPrior on beta and K moves attribution by 15-20 points in short series
Shampoo case study detailJin 2017 MMM - Shampoo Case Study Data, Diagnostics and PosteriorsexampleMMM Model Selection and Applicationn = 106 weeks; orthogonalised controls cut Stan time 3040 s to 75 s; retention posterior equals prior
Stan implementationJin 2017 MMM - STAN Sampler Code and MCMC ImplementationmethodBayesian Estimation and Priors for MMMVerbatim Appendix Stan program mapped to paper notation
Scope and extensionsJin 2017 MMM - Conclusions, Limitations and Extensionsconceptwhole clusterNot causal by construction; adstock before shape; hierarchical/geo/simulator extensions

Notes

  • Bayesian Media Mix Modeling - Overview — CONTAINS: definition of MMM and the 4Ps lineage; the combined additive regression equation (Eq. 7); motivation for the Bayesian approach; carryover + shape framing; headline findings (large-sample recovery, small-sample prior bias, high optimal-mix variance).

  • Carryover (Adstock) Functional Forms — CONTAINS: the normalized finite-window adstock (Eq. 1); geometric decay weights and retention rate (Eq. 2); delayed/peak adstock with delay as a Gaussian radial kernel (Eq. 3); choice of carryover length ; explicit Koyck-lag connection.

  • Shape (Saturation) Effects — CONTAINS: the Hill function (Eq. 4); the Hill scaled transform (Eq. 5); the one-parameter reach transformation (Eq. 6); slope vs half-saturation behavior (concave vs S-shape); the near-unidentifiability problem.

  • Bayesian Estimation and Priors for MMM — CONTAINS: MLE vs posterior (Eqs. 8-9); Gibbs (slice/BOOM) vs STAN/HMC samplers; per-parameter prior specifications and rationale; prior-dominance-in-small-samples finding; - and -prior sensitivity studies.

  • ROAS, mROAS, and Optimal Media Mix — CONTAINS: ROAS (Eq. 10) and mROAS (Eq. 11) definitions with post-change-period accounting; plug-posterior-samples-not-means rule; constrained optimal-mix optimization (Eqs. 12-16); the bimodal/high-variance optimal-mix caveat.

  • MMM Model Selection and Application — CONTAINS: BIC formula (Eq. 18); the four candidate specifications (Table 7); sample-size recovery simulations (Tables 4); sampler timing (Table 8); the shampoo dataset, BIC table (Table 9, Model IV wins), real-data ROAS/mROAS, optimization, and residual-autocorrelation misspecification diagnostic.

  • Jin 2017 MMM - Simulation Design, Signal Strength and Priors — CONTAINS: data-generating process; Table 1 generating parameters; Eq. 17 signal-strength metric; Table 2; Table 3 priors; Fig. 4 correlations; Fig. 18 single-dataset posteriors; sampler timing.

  • Jin 2017 MMM - Simulated ROAS, mROAS and Optimization Results — CONTAINS: attribution windows and Fig. 3; Fig. 5 ROAS/mROAS recovery; optimisation design; two-approach optimal-mix algorithm; Fig. 6 Scenario I unimodal vs Scenario II trimodal.

  • Jin 2017 MMM - Sample Size vs Bias Study (Two vs Sixty Years) — CONTAINS: ADEMP-style design of the 500-replicate study; full Table 4 (relative bias of betaHill at x=0.5 and x=1, two vs sixty years); Figs. 7-8; worked conversion of bias to curve units; prior-driven bias mechanism; sixty-years caveat.

  • Jin 2017 MMM - Prior Sensitivity Experiments on Beta and Half-Saturation — CONTAINS: Sec. 7.1 design, full Table 5 and Figs. 9-10; Sec. 7.2 Scenarios I/II, full Table 6 and Figs. 11-12; footnote 3 definition of support.

  • Jin 2017 MMM - Shampoo Case Study Data, Diagnostics and Posteriors — CONTAINS: data description and n = 106; Fig. 13 correlation tables; control-orthogonalisation algorithm; full Table 8; Table 9 with footnotes 5-7; Figs. 14-17 (per-model ROAS, bimodal optimum, posterior equal to prior, wider Hill bands, residual ACF to lag 15).

  • Jin 2017 MMM - STAN Sampler Code and MCMC Implementation — CONTAINS: verbatim Appendix Stan program; code-to-notation map; notes on running it with current Stan; reconstructed Gibbs/slice scheme; timing table.

  • Jin 2017 MMM - Conclusions, Limitations and Extensions — CONTAINS: stated scope limits (not causal, no synergy, independent channels, curvature forms, BIC not causal); adstock-then-shape ordering rule; Sec. 9 conclusions; hierarchical, geo and simulator extensions; MMM audit checklist.

Sources

  • Jin-2017-Bayesian-MMM-Carryover-Shape — Jin, Y., Wang, Y., Sun, Y., Chan, D., & Koehler, J. (2017). Bayesian Methods for Media Mix Modeling with Carryover and Shape Effects. Google Inc., 14 April 2017. 34 pp.

See Also