WorksMathematics
When Predictive Fit Misleads: Selecting Marketing Mix Models Using Experimental RoAS Benchmarks
Abstract
Marketing Mix Models (MMMs) are used to estimate channel-level Return on Ad Spend (RoAS) and guide marketing investment, yet competing specifications are usually compared on predictive-fit metrics such as out-of-sample R-squared, MAPE, or RMSE. We show that predictive fit can diverge from recovery of the causal quantities that drive marketing decisions. In simulations with known RoAS, the best-fitting specification is often not the one that recovers RoAS most accurately; replicated studies show that this disagreement is systematic and persists under media-spend collinearity, noise, and a misspecified carryover shape. Selecting specifications against experimental RoAS benchmarks, even imprecise ones, improves RoAS recovery relative to fit-based selection, and a real-world application with experimental benchmarks shows the same pattern. We propose an applied workflow: calibrate MMM specifications against estimand-aligned experimental benchmarks when they exist, and otherwise report RoAS sensitivity across plausible specifications rather than relying on a single best-fitting model.
Highlights for Practitioners
Standard model accuracy metrics (, MAPE, RMSE) measure how well a model predicts sales — not whether it correctly identifies which advertising channels are driving them. Using these metrics alone to select a marketing mix model (MMM) can lead to misguided budget decisions.
When causal experiments (such as geo-experiments) have been conducted, their RoAS estimates should be used to validate and select among competing model specifications — not just to benchmark the final chosen model.
When no experiments are available, practitioners should run multiple plausible model specifications and report the range of RoAS estimates across them, rather than presenting a single model’s output as definitive.
In 320 simulated datasets where competing models differed only in their saturation curve, the best-fitting model was the most accurate RoAS model less often than a random pick would be; even imprecise experiments (up to 50% noise) picked more accurate models than did.
Small differences in model fit can mask large differences in RoAS estimates: in our real-world application, two models with nearly identical values produced RoAS estimates that differed by 60% in accuracy against an experimental benchmark — a gap large enough to materially affect channel investment decisions.
Introduction
Marketing Mix Models (MMMs), also known as media mix models, have become a central framework for quantifying the effectiveness of marketing investments and informing budget allocation across channels. Organizations rely on MMMs to estimate channel-specific Return on Ad Spend (RoAS), so that media decisions can be tied to incremental business outcomes rather than to exposure or sales correlations alone. Given the scale of contemporary advertising investment, errors in RoAS estimation can translate directly into inefficient budget allocation and lost profitability.
Despite the clear advantages of causal inference, much of MMM practice remains anchored in fit-based diagnostics that are only indirectly related to the business objective of measuring incremental marketing effectiveness. Controlled experiments such as geo-experiments are widely regarded as credible benchmarks for advertising incrementality, but they are often costly and resource-intensive to implement at scale ([28, 20, 2]). As a result, many practitioners continue to evaluate MMM specifications primarily using goodness-of-fit metrics such as out-of-sample , MAPE, and RMSE, even though these metrics reward historical fit rather than causal recovery. This tendency is reinforced by persistent practical and identification challenges in MMM, including multicollinearity, endogeneity, and specification sensitivity ([3, 10, 8]). Widely used MMM workflows also commonly include predictive or posterior predictive diagnostics as important components of model assessment ([22, 13]). These diagnostics are useful for assessing whether a model captures broad sales patterns, but they do not by themselves establish recovery of causal RoAS. For marketing investment decisions ([16]), a central decision-relevant quantity is incremental RoAS, with marginal RoAS needed for formal real-location decisions ([11]).
The applied problem is straightforward. In practice, analysts often face several defensible MMM specifications that produce similar sales fit but materially different channel-level RoAS estimates. The practical question is not simply which model predicts sales best, but which model produces RoAS estimates credible enough to inform investment decisions. The framework below addresses that question when experimental benchmarks exist and provides sensitivity reporting when they do not.
To study this problem, we compare specification choice based on predictive fit with specification choice based on RoAS recovery against causal benchmarks. Our evaluation combines simulation scenarios that vary in saturation form, model complexity, and adstock inclusion with a real-world calibration illustration in which experimental RoAS benchmark estimates are available. Across these settings, the criteria frequently disagree, and the models favored by predictive fit can yield materially worse RoAS estimates. Predictive diagnostics remain useful, but they are not sufficient evidence of causal validity when MMM outputs are used to inform marketing investment decisions.
The contribution is threefold. First, it documents, through controlled simulation scenarios and a Monte Carlo replication with stress tests on media-spend collinearity, noise, and adstock shape, that predictive-fit ranking and causal-RoAS ranking diverge systematically in MMM specification choice; when candidates differ only in saturation form, out-of-sample is essentially uninformative about which specification recovers RoAS best. Second, it proposes using experimental RoAS benchmarks, when available, as calibration targets for selecting among otherwise plausible MMM specifications, and shows that this remains beneficial when the experimental benchmarks are themselves noisy. Third, it recommends specification-sensitivity reporting when benchmarks are unavailable, using summaries such as the componentwise median RoAS vector as descriptive consensus diagnostics rather than causal substitutes.
The argument is not that predictive fit is irrelevant for MMM. Predictive diagnostics remain useful for assessing whether a model captures broad sales patterns. The claim is narrower: when the target quantity is channel-level causal RoAS, predictive fit alone is not a sufficient model-selection criterion. The benchmarked evaluation framework is therefore a calibration procedure for settings where experimental or otherwise credible causal RoAS estimates are available. It is not a universal solution to causal identification from observational data.
The remainder of this paper is organized as follows. § 3 reviews related literature on MMM methodology, causal inference in marketing, and open-source frameworks. § 4 presents a motivating example in which a misspecified model achieves superior yet produces substantially worse RoAS estimates. § 5 details the experimental-benchmark calibration framework. § 6 presents simulation evidence: 32 single-draw comparisons spanning four saturation function types, four complexity levels, and two adstock conditions, followed by replicated studies of selection accuracy under repeated sampling, media-spend collinearity, noise, and noisy experimental benchmarks. § 7 presents a real-world calibration illustration using observational marketing data and experimental RoAS benchmarks. § 8 summarizes managerial implications, and § 9 concludes with limitations and directions for future research.
Related Literature
Experiments, including geo-experiments, are widely regarded as credible tools for measuring the incremental impact of advertising [9, 28, 20], but they are costly and resource-intensive [2], so they are impractical for continuous measurement. They are nonetheless frequently used as external benchmarks for MMM-derived RoAS [26]. Our focus on causal parameter recovery also connects to the econometric literature on identification in marketing: instrumental variables for endogenous price and promotion effects [25], double/debiased machine learning, which formalizes the prediction–causal tension motivating our work [5], and synthetic control methods for regional counterfactuals [1].
MMM is a specialized area of marketing analytics [17, 7]. Building on foundational work from the early 1990s [14], Hanssens et al. [15] and Wang et al. [29] consolidated the use of MMM for decomposing sales into marketing contributions, typically with frequentist regression and predetermined adstock and saturation transforms [6]; more recent work includes hierarchical Bayesian models with sign constraints [4]. A persistent challenge is multicollinearity: Ebbes et al. [10] showed that highly correlated marketing variables can yield different parameter values with similar predictions, and Dew et al. [8] examined its negative implications for causal estimation. Practitioners have recently raised the same concern for carryover: Palu [24] reports that adstock kernels of different shapes fit the same data almost equally well yet imply channel multipliers that differ several-fold, and argues for richer, transfer-function representations of carryover. Carryover, saturation, and attribution have also been studied extensively [23, 21, 12], with industry perspectives highlighting the gap between academic methods and practice [3]. Comparative studies of MMM estimators have focused on prediction accuracy [31], while the importance of RoAS metrics has been emphasized in digital marketing [19] and more broadly in campaigns [11].
Open-source frameworks have democratized MMM. Meta’s Robyn [22] offers automated hyperparameter optimization, multi-objective model selection, and budget allocation, and Google’s Meridian [13] is fully Bayesian, building on earlier Bayesian hierarchical work and geo-experiment research [30, 18, 27]. These workflows improve access but also illustrate the need to distinguish predictive from causal diagnostics. Bayesian posterior predictive checks assess whether a model reproduces observed sales; used alone, they share the limitation of -based selection, evaluating predictive adequacy rather than causal parameter recovery. Posterior distributions over RoAS do quantify estimation uncertainty, and a Bayesian analog of our criterion would compare posterior RoAS with experimental benchmarks. Existing work has expanded the available estimators, transformations, and software, but less attention has been given to the evaluation problem: how should competing MMM specifications be judged when the target is causal RoAS rather than sales prediction? That gap is the focus here.
Motivating Example: When Better Predictions Lead to Worse Decisions
We illustrate the importance of RoAS-focused model evaluation through a motivating example. Consider a MMM for a product sold across retail locations over weeks (4 years), with marketing activities in channels. The data-generating process follows:
where denotes sales units at location in week , the superscripts (1) and (2) index the sine and cosine components of the annual seasonality cycle, respectively, and the transformed media variable is constructed through a two-stage process:
Adstock Transformation (Geometric Decay):
with initialization for each location.
Saturation Transformation (Hill Function):
where represents the adstocked media exposure.
Because the outcome is modeled on the log-sales scale, RoAS must be computed from counterfactual predictions transformed back to the sales level. Let denote the fitted linear predictor with all channels active, and let denote the fitted linear predictor under the counterfactual in which channel is set to zero while all other covariates remain at their observed values. Under the Gaussian log-error assumption, the corresponding level predictions are
We then define channel-level return on ad spend as
where denotes predicted sales with all channels active, and denotes predicted sales with channel spending set to zero (while maintaining all other variables at observed levels). The RoAS estimand in (5) is an average incremental return over the observed spend path and evaluation window. Without redefining the counterfactual perturbation, it is not the marginal return to an additional dollar of spend. For budget allocation, average RoAS is informative, but marginal RoAS or finite-difference returns around the current budget are the more direct allocation quantities.
We partition the data into a training set (weeks 1–156, observations) and a test set (weeks 157–208, observations). Two specifications are estimated on the training data: Model A (correct), with adstock (Equation (3)) and saturation (Equation (4)), and Model B (misspecified), a pure linear model with . On the test set, both are evaluated on sales prediction (out-of-sample , MAPE, RMSE) and on RoAS recovery (MAE and MAPE against the known RoAS values implied by the data-generating parameters).
Table A.2 (Appendix § 10) lists the known parameter values and Table A.1 (Appendix § 10) lists all variables. The known simulation RoAS values are computed from these parameters via counterfactual predictions: for each channel, the difference in total revenue between all channels active and that channel’s spend set to zero, divided by its total spend. The question is whether a misspecified model with superior sales prediction can still provide reliable RoAS estimates, or whether response-specification credibility matters more than predictive fit.
Table 1 and Figure 1 (with Figure A.1 in Appendix § 10) reveal a paradox: the model with better sales prediction produces worse RoAS estimates. Model B (misspecified) has superior out-of-sample fit, with versus 0.90 for Model A, MAPE of 9.07% versus 10.38%, and RMSE of 138.55 versus 169.13, because its trend term acts as a flexible approximation to cumulative adstock effects. Yet Model A (correctly specified) recovers RoAS substantially better: RoAS MAE of 3.12 versus 4.40 and RoAS MAPE of 141.92% versus 209.59%. Model B overestimates RoAS in all four channels, with errors from +172% to +241%, and its estimates lie systematically above the 45-degree recovery line in panel (d) of Figure 1, whereas Model A’s estimates, though still biased upward, lie closer to it. By omitting adstock dynamics, Model B’s linear trend term absorbs long-term sales growth and credits it to concurrent spend. Thus Model B’s 3.3% advantage in coincides with a 41% disadvantage in RoAS recovery (MAE ratio 4.40/3.12 = 1.41): a modest gain in predictive fit can be accompanied by a materially larger deterioration in RoAS recovery, since a misspecified model can exploit trends, seasonality, and autocorrelation without capturing the adstock and saturation mechanisms that determine incremental RoAS.

Figure 1. RoAS Recovery Performance. (a-b) Model A achieves 29-32% lower RoAS estimation errors despite inferior predictive accuracy. (c) Channel-level comparison shows Model B systematically overestimates RoAS across all channels. (d) Scatter plot reveals Model A’s estimates cluster closer to the perfect recovery line (dashed diagonal), while Model B exhibits larger systematic deviations from known simulation RoAS values. Both models exhibit substantial absolute RoAS error; the figure illustrates relative RoAS recovery rather than adequate absolute recovery.
| Performance Metric | Model A (Correct) | Model B (Misspecified) |
| Sales Prediction Metrics (Test Set) | ||
| 0.90 | 0.93 | |
| MAPE (%) | 10.38 | 9.07 |
| RMSE | 169.13 | 138.55 |
| RoAS Recovery Metrics (Test Set) | ||
| Mean Absolute Error | 3.12 | 4.40 |
| MAPE (%) | 141.92 | 209.59 |
| Relative Performance | 1.0\times | 1.4\times worse |
| Channel-Level RoAS Estimates | ||
| Channel 1 (Known Sim. RoAS: 2.48) | 7.88 | 8.45 |
| Channel 2 (Known Sim. RoAS: 2.44) | 5.34 | 6.64 |
| Channel 3 (Known Sim. RoAS: 2.06) | 4.84 | 6.24 |
| Channel 4 (Known Sim. RoAS: 1.46) | 2.87 | 4.73 |
Table 1. Comparison of Sales Prediction Accuracy and RoAS Recovery Accuracy
The absolute RoAS errors remain large even for the structurally correct model, which is informative: correct functional form does not guarantee precise RoAS recovery in finite samples when nonlinear transformation parameters, channel coefficients, location heterogeneity, and time-series controls must be estimated jointly. The example therefore concerns relative RoAS recovery, not satisfactory absolute recovery. The remainder of the paper formalizes this evaluation principle and examines it in simulation scenarios and a real-world calibration exercise.
Experimental-Benchmark Calibration Framework
Marketing Mix Models used for RoAS reporting should be evaluated against the causal quantity they are intended to estimate. The framework below is a calibration procedure for settings in which experimental or otherwise credible causal RoAS benchmark estimates are available; it is not a substitute for identification. We first specify the model structure and transformation functions, then describe the parameter estimation procedure, followed by RoAS calculation and benchmarked evaluation.
Model Specification
We consider a multiplicative sales response model with location-specific effects. For location and time period , the model takes the form:
where represents sales units, denotes the number of marketing channels, is the transformed media variable for channel (described below), and contains control variables including price (log), promotional discounts, macroeconomic indicators, holiday effects, and seasonality terms. The error term captures unexplained variation. The transformed media variable is constructed through a two-stage process that captures both carryover (adstock) and diminishing returns (saturation) effects:
where is the raw media spend in channel at location and time .
Transformation Functions
Adstock Transformation
To capture the carryover effect of advertising, we employ a geometric decay adstock function. The adstocked media exposure at time is given by:
with initialization for each channel. The parameter controls the decay rate of advertising effectiveness, with higher values indicating longer-lasting effects.
Saturation Transformation
Each adstocked exposure is passed through one of two saturation families,
with scale and shape . For both curves are everywhere concave (C-shape); for both are sigmoidal (S-shape), with a convex region at low spend followed by saturation. This yields four candidate specifications (Hill C, Hill S, Weibull C, Weibull S) that are all economically plausible but imply different average and marginal returns, particularly at low spend. Figure 2 illustrates the four forms; Appendix § 11 gives their inflection points and a comparison of the two families.

Figure 2. The four candidate saturation specifications at a fixed scale and varying shape . Top: Hill S-shape (, sigmoidal) and Hill C-shape (, concave). Bottom: Weibull S-shape and Weibull C-shape. S-shapes have a convex low-spend region followed by saturation; C-shapes give strong initial returns that diminish progressively.
Parameter Estimation with Sign Constraints
Writing for the right-hand side of Equation (6) excluding the error, and assuming with , we estimate by bound-constrained maximum likelihood subject to economically motivated sign and shape restrictions: nonnegative channel effects ( and ), , , and for C-shape and for S-shape specifications. Because the recursive adstock and nonlinear saturation make the problem non-convex, we use multi-start L-BFGS-B and retain the solution with the highest attained likelihood. The full likelihood and constraint set are given in Appendix § 11.
Evaluation Framework
We distinguish two applied evaluation settings depending on whether experimental RoAS benchmarks are available. The first supports benchmarked calibration; the second supports sensitivity reporting, not definitive causal model selection.
Scenario 1: Experimental RoAS Benchmark Available (Primary Framework)
When causal inference methods such as geo-experiments have been conducted, experimental RoAS benchmark estimates can serve as external calibration targets. The data are divided into training (the first weeks) and test ( weeks) sets; for each candidate specification (Hill-S, Hill-C, Weibull-S, Weibull-C in the primary setting), the parameters are estimated on the training data by solving the constrained problem in Equation B.10; the estimated RoAS for each channel is computed on the test set according to Equation (5); and the specification minimizing the RoAS recovery error is selected, where
is the known simulation RoAS value or the experimental benchmark estimate in applications, and is the estimate from the fitted model. Algorithm 1 summarizes the procedure.
Scenario 2: No Experimental RoAS Benchmark Available
In practice, causal inference is costly and may not always be feasible. When no experimental RoAS benchmark is available, the RoAS-best specification cannot be identified directly from observational fit metrics alone. In that setting, we do not propose a definitive selection rule. Instead, the analyst should treat the distribution of
Algorithm 1 RoAS-Focused Model Evaluation Framework
Require: Training data , test data , benchmark values (known simulation values or experimental estimates), candidate model set
Ensure: Selected model
BestMAE ;
for each model do
Estimate on by solving Equation B.10
Compute on for (Equation 5)
if then
BestMAE ;
return
RoAS estimates across plausible specifications as a sensitivity diagnostic. Section 5.5 illustrates one simple consensus diagnostic based on proximity to the componentwise median RoAS vector, while emphasizing that such summaries are descriptive and not causal substitutes.
Comparison to Traditional Evaluation
Traditional MMM evaluation focuses on sales prediction accuracy, using out-of-sample , MAPE , and RMSE , where is the number of test observations. As the motivating example (§ 4) shows, a model with better sales prediction (higher , lower MAPE/RMSE) can produce severely biased RoAS estimates, because these metrics evaluate overall fit to observed data while RoAS recovery depends on correctly estimating the causal structure of marketing effects, namely the adstock and saturation transformations. In several scenarios in § 6, models with materially lower nonetheless achieved better RoAS recovery. The proposed framework therefore separates two tasks that are often conflated: predictive metrics diagnose whether a model captures sales patterns, whereas RoAS diagnostics assess whether the same model recovers the incremental quantities used for marketing evaluation. When experimental benchmarks exist, the latter can be evaluated directly; when they do not, RoAS dispersion across plausible specifications should be reported instead of being hidden behind a single predictive-fit-selected model.
Performance Evaluation
We compare predictive-fit ranking with RoAS-recovery ranking in two layers of simulation evidence. Sections 5.1–5.2 report a set of single-draw scenarios that span four saturation forms, four complexity levels, and two adstock conditions. Section 5.3 then replicates the design over hundreds of independent datasets and stresses it along three dimensions that are central to MMM identification: media-spend collinearity, noise, and the shape of carryover, and it also evaluates selection against noisy experimental benchmarks.
| Step | Analyst action | Output |
| 1 | Fit substantively plausible MMM specifications | Candidate RoAS estimates and fit metrics |
| 2 | Compare predictive fit | , MAPE, RMSE |
| 3 | If an experimental benchmark exists, compare MMM-implied RoAS with the benchmark | RoAS-MAE or an uncertainty-weighted discrepancy |
| 4 | If no benchmark exists, summarize RoAS dispersion | Median, interquartile range, and range across specifications |
| 5 | Report decision risk | Stable versus specification-sensitive channel conclusions |
| 6 | Use results for decision support | Calibrated or sensitivity-qualified RoAS recommendations |
Table 2. Applied Workflow for MMM Specification Evaluation
Simulation Design
Each DGP follows Equation (1), combining geometric adstock with one of the four saturation forms (Hill C, Hill S, Weibull C, Weibull S). Four complexity scenarios vary the number of channels and locations: S1 (4 channels, 5 locations), S2 (6, 8), S3 (10, 12), and S4 (12, 15). All use 156 training weeks and 52 test weeks. Adstock decay rates are drawn from Uniform(0.5, 0.8); shape parameters from Uniform(0.3, 0.6) for C-shape and Uniform(2.0, 4.0) for S-shape DGPs; half-saturation points are linearly spaced from 8,000 to 4,000; media coefficients are linearly spaced from 1.5 to 0.3 with location-level deviations floored at 0.01; and the remaining coefficients follow Table A.2, with . Weekly spend is drawn from a multivariate normal distribution with pairwise channel correlation (floored at $100).
For each DGP we fit the four candidate saturation specifications under two conditions: adstock-included candidates contain the carryover structure of the DGP (so exactly one candidate is fully correctly specified), while adstock-omitted candidates omit adstock entirely, so that every candidate is structurally wrong. In the simulations, the estimator adds a mild Gaussian shrinkage penalty that pulls location-specific media effects towards their channel mean. For each fitted model we compute out-of-sample sales metrics (, MAPE, RMSE) and RoAS recovery metrics (RoAS-MAE, RoAS-MAPE, RoAS-RMSE) against the known simulation RoAS. The traditional criterion selects the highest- candidate; the benchmark criterion selects the lowest-RoAS-MAE candidate. With noiseless simulation RoAS, the benchmark criterion is an oracle, and its role is to measure how often, and by how much, predictive-fit ranking departs from RoAS-recovery ranking. The scenarios are deliberately difficult (many parameters relative to sample size, nonlinear and non-convex estimation), so absolute error magnitudes are not intended as benchmarks for typical MMM performance.
Single-Draw Scenario Results
Table 3 reports one simulated dataset per DGP and complexity scenario for adstock-included candidates. Even though the true saturation family is among the candidates, the highest- specification frequently differs from the specification with the lowest RoAS error. Averaged over scenarios, the RoAS-best specification has 1.33× (Weibull S) to 1.57× (Weibull C) lower RoAS-MAE than the highest- specification, and it typically does so with a markedly lower : in Hill C S1, for example, the -selected model attains and RoAS-MAE , whereas the RoAS-best model attains and RoAS-MAE . This is the predictive-fit paradox of the motivating example: higher sales fit does not reliably correspond to better recovery of incremental returns.
| DGP | Scenario | Traditional ( Max) | Benchmark (RoAS-MAE Min) | ||||
| RoAS-MAE | RoAS-MAPE | RoAS-MAE | RoAS-MAPE | ||||
| Hill C | S1 | 0.618 | 0.554 | 72.82% | 0.312 | 0.446 | 44.77% |
| S2 | 0.376 | 1.947 | 67.65% | 0.376 | 1.947 | 67.65% | |
| S3 | 0.598 | 25.114 | 57.84% | 0.598 | 20.502 | 47.25% | |
| S4 | 0.564 | 33.424 | 49.09% | 0.439 | 20.114 | 32.96% | |
| Average | 0.539 | 15.260 | 61.85% | 0.431 | 10.752 | 48.16% | |
| Improvement | — | 1.42× | |||||
| Hill S | S1 | 0.801 | 2.235 | 68.99% | 0.756 | 1.407 | 36.57% |
| S2 | 0.638 | 6.497 | 42.64% | 0.616 | 5.790 | 40.51% | |
| S3 | 0.784 | 47.968 | 34.71% | 0.678 | 28.568 | 22.35% | |
| S4 | 0.709 | 75.979 | 37.84% | 0.351 | 53.564 | 29.01% | |
| Average | 0.733 | 33.170 | 46.05% | 0.601 | 22.332 | 32.11% | |
| Improvement | — | 1.49× | |||||
| Weibull C | S1 | 0.690 | 1.228 | 78.81% | 0.521 | 0.853 | 48.77% |
| S2 | 0.642 | 4.213 | 33.24% | 0.381 | 3.089 | 24.94% | |
| S3 | 0.538 | 50.187 | 37.27% | 0.285 | 28.894 | 18.97% | |
| S4 | 0.614 | 60.347 | 28.89% | 0.220 | 41.123 | 23.70% | |
| Average | 0.621 | 28.993 | 44.55% | 0.352 | 18.490 | 29.10% | |
| Improvement | — | 1.57× | |||||
| Weibull S | S1 | 0.654 | 1.624 | 34.19% | 0.621 | 1.308 | 27.35% |
| S2 | 0.672 | 11.041 | 42.85% | 0.612 | 6.092 | 19.86% | |
| S3 | 0.561 | 66.831 | 33.78% | 0.522 | 58.419 | 24.38% | |
| S4 | 0.620 | 98.129 | 30.84% | 0.584 | 67.733 | 21.22% | |
| Average | 0.627 | 44.406 | 35.42% | 0.585 | 33.388 | 23.20% | |
| Improvement | — | 1.33× |
Table 3. Notes: Traditional selection is based on highest ; benchmark selection is based on lowest RoAS-MAE against known simulation RoAS and therefore functions as an oracle benchmark for assessing disagreement with predictive-fit selection. Improvement factor = Traditional RoAS-MAE / Benchmark RoAS-MAE. Average rows show mean performance across the four scenarios for each DGP type.
When all candidates omit adstock (Appendix Table C.1), the disagreement persists but narrows, with average improvement factors between 1.27× and 1.35× (1.30× overall): when every candidate is a poor approximation of the DGP, less signal is available to either criterion. Across the 32 single-draw comparisons, the highest- specification had a higher RoAS-MAE than the RoAS-best specification in 30 cases.
Replicated Simulation Evidence
A single draw per scenario cannot separate systematic disagreement from the luck of one dataset. We therefore replicate the design and extend it in four directions; Appendix § 13 gives cell-level results. In every replication, the DGP parameters, media spend, controls, and noise are redrawn independently, and all four candidate specifications are re-estimated.
Monte Carlo replication. The main design is replicated 40 times for each DGP, for S1 and S2, and for both adstock conditions (320 datasets per condition, 2,560 model fits).
Media-spend collinearity. The pairwise spend correlation is varied over (baseline 0.3), holding everything else fixed and reusing the same random seeds across (S2, adstock-included candidates, 60 datasets per value).
Noise level. The error standard deviation is varied over (baseline 0.02), again with common random seeds (S2, adstock-included, 60 datasets per value).
Adstock form. Sales are generated with a delayed adstock whose effect peaks one or two weeks after spend (kernel , ), while all candidates keep geometric adstock, so carryover is misspecified for every candidate (S2, 60 datasets).
In all four studies we also evaluate benchmark selection with noisy experiments. The analyst observes with and a coefficient of variation per channel, selects the candidate closest to in RoAS-MAE, and the selected model is scored against the true RoAS (averaging over
500 benchmark draws per dataset). This removes the oracle element of the benchmark criterion and asks whether realistically imprecise experiments still improve on predictive-fit selection. Table 4 summarizes the results; Appendix Figure D.1 shows the Monte Carlo distribution of the RoAS-error penalty from -based selection.
| Study | Datasets | Pr(agree) [95% CI] | MAE ratio | Exp-10 | Exp-25 | Exp-50 | |
| Monte Carlo, S1, adstock-included | 160 | 0.18 [0.13, 0.25] | -0.05 | 1.57 | 0.73 | 0.77 | 0.83 |
| Monte Carlo, S2, adstock-included | 160 | 0.17 [0.12, 0.23] | 0.01 | 1.36 | 0.80 | 0.84 | 0.89 |
| Monte Carlo, S1, adstock-omitted | 160 | 0.54 [0.47, 0.62] | 0.62 | 1.21 | 0.89 | 0.93 | 1.09 |
| Monte Carlo, S2, adstock-omitted | 160 | 0.56 [0.49, 0.64] | 0.63 | 1.11 | 0.93 | 0.96 | 1.08 |
| Collinearity, | 60 | 0.33 [0.23, 0.46] | -0.04 | 1.26 | 0.85 | 0.90 | 0.95 |
| Collinearity, | 60 | 0.30 [0.20, 0.43] | 0.05 | 1.34 | 0.82 | 0.86 | 0.92 |
| Collinearity, | 60 | 0.23 [0.14, 0.35] | 0.01 | 1.39 | 0.79 | 0.83 | 0.88 |
| Collinearity, | 60 | 0.20 [0.12, 0.32] | -0.11 | 1.36 | 0.80 | 0.83 | 0.88 |
| Noise, | 60 | 0.23 [0.14, 0.35] | 0.04 | 1.27 | 0.83 | 0.87 | 0.92 |
| Noise, | 60 | 0.32 [0.21, 0.44] | 0.06 | 1.25 | 0.85 | 0.89 | 0.94 |
| Noise, | 60 | 0.30 [0.20, 0.43] | 0.10 | 1.27 | 0.85 | 0.88 | 0.93 |
| Noise, | 60 | 0.30 [0.20, 0.43] | 0.18 | 1.23 | 0.86 | 0.91 | 0.96 |
| Adstock form, delayed-adstock DGP | 60 | 0.27 [0.17, 0.39] | 0.09 | 1.28 | 0.83 | 0.87 | 0.93 |
Table 4. Predictive-Fit Selection versus RoAS Recovery Across Replicated Simulation Studies
Notes: Each dataset is an independent draw of DGP parameters, media spend, controls and noise; four candidate saturation specifications are fitted to each. Pr(agree): share of datasets in which the highest out-of-sample candidate is also the lowest-RoAS-MAE candidate (Wilson 95% interval; random choice among four candidates gives 0.25). : mean Kendall rank correlation between the ranking and the RoAS-accuracy ranking. MAE ratio: mean RoAS-MAE of the -selected model divided by that of the RoAS-best model. Exp-c: mean RoAS-MAE (against the true RoAS) of the model selected against a noisy experimental benchmark with coefficient of variation per channel, divided by the RoAS-MAE of the -selected model; values below one favour benchmark-based selection. Collinearity and noise studies use S2 with adstock-included candidates. The adstock-form study uses S2 with a delayed-adstock DGP and geometric-adstock candidates.
Finding 1: When candidates differ only in saturation form, carries essentially no information about RoAS accuracy. With adstock-included candidates, the highest- model coincides with the RoAS-best model in only 17.5% of the 320 datasets (95% CI 13.7–22.0%), below the 25% expected from choosing one of the four candidates at random. The mean Kendall correlation between the ranking and the RoAS-accuracy ranking is −0.02, and selecting on out-of-sample MAPE instead of gives the same picture (agreement 17.8%). The -selected model has, on average, 1.47× the RoAS-MAE of the RoAS-best model (median 1.30×), equivalent to an average channel-level RoAS error of 41% of mean RoAS versus 29% for the RoAS-best model, while its is 0.20 higher. The pattern holds in every DGP-by-scenario cell (agreement between 7.5% and 37.5%; Appendix Table D.1). The single-draw results of § 6.2 are therefore not artifacts of particular random draws.
Finding 2: Under structural misspecification, predictive fit is more informative, and the gap narrows. When every candidate omits adstock, agreement rises to 55.3% (49.8–60.7%) and the rank correlation to 0.62; the mean RoAS-MAE penalty from selection falls to 1.16× (median 1.00×). Omitting carryover degrades sales fit and RoAS recovery jointly, so in that regime partly tracks causal accuracy. This replicates the narrowing documented in the single-draw results, and it qualifies the paper’s claim: predictive fit is least reliable precisely in the common applied situation in which several structurally sound specifications fit the data comparably well.
Finding 3: Noisy experimental benchmarks still outperform predictive-fit selection. Selecting against an imperfect experiment reduces the RoAS-MAE of the selected model relative to selection by 23%, 19%, and 14% for benchmark coefficients of variation of 10%, 25%, and 50% with adstock-included candidates, and with 25% benchmark noise the benchmark-selected model is at least as accurate as the -selected model in 90% of datasets. With adstock-omitted candidates, precise benchmarks still help (9% and 6% reductions at and 0.25), but a benchmark with 50% noise is slightly worse than (+9%). Benchmark-based calibration is therefore valuable well beyond the oracle setting, with gains that shrink as experimental precision falls.
Finding 4: Collinearity and noise do not rescue predictive-fit selection. As the spend correlation rises from to 0.9, agreement falls from 33% to 20%, the mean RoAS-MAE penalty from selection rises from 1.26× to 1.36×, and the range across candidates narrows from 0.62 to 0.38: correlated channels constrain the total media response more tightly than its allocation across channels, so specifications that fit sales similarly can attribute returns very differently ([10]). The value of calibration grows accordingly (a 25%-noise benchmark reduces RoAS-MAE relative to selection by 10% at and 17% at ). A tenfold increase in noise, from to 0.20, changes little: agreement stays between 23% and 32%, near the random-choice rate, the penalty between 1.23× and 1.27×, and 25%-noise benchmarks reduce RoAS-MAE by 9–13% at every level; the rank correlation rises only to 0.18. The disagreement is thus not an artifact of a particularly clean or particularly collinear design (Appendix Figure D.2).
Finding 5: A misspecified carryover shape does not make informative. When sales are generated with a delayed adstock that peaks one or two weeks after spend while every candidate assumes geometric carryover, the highest- model is the RoAS-best model in 26.7% of datasets (95% CI 17.1–39.0%), indistinguishable from random choice; the rank correlation is 0.09, and the -selected model has 1.28× the RoAS-MAE of the RoAS-best model (median 1.22×; Appendix Table D.4). Unlike omitting carryover altogether (Finding 2), getting its shape wrong degrades RoAS recovery without making sales fit a better guide, consistent with the practitioner concern raised by Palu [24]. Noisy benchmarks still help, reducing RoAS-MAE relative to selection by 17%, 13%, and 7% at , 0.25, and 0.50.
Discussion
The two layers of evidence lead to the same conclusion: predictive-fit and RoAS-recovery rankings often disagree, the disagreement is systematic rather than an artifact of particular draws, and a modest gain in sales fit can coincide with a material loss in RoAS accuracy. Two qualifications matter for practice. RoAS-MAE is reported on the original RoAS scale, so the relevant comparisons are within-dataset rather than across scenarios. The value of benchmark-based selection also depends on the precision of the experiments, on media-spend collinearity, and on how far all candidates are from the truth, which argues for reporting experimental uncertainty alongside the calibration result.
When No Benchmark Is Available: RoAS Sensitivity and Consensus Diagnostics
Without an experimental benchmark, the RoAS-best specification cannot be identified, and predictive-fit metrics do not resolve this problem. One useful diagnostic is the distribution of RoAS estimates across plausible specifications. The componentwise median RoAS vector is a simple consensus summary: we select the specification whose RoAS vector is closest to it, using the known simulation RoAS only retrospectively to evaluate the choice. In the single-draw scenarios (Appendix Table C.2) this diagnostic chose a model with lower RoAS-MAE than the highest- model in 14 of 16 adstock-included and 13 of 16 adstock-omitted comparisons. The replicated evidence is more sobering: with adstock-included candidates the median-consensus model is only marginally more accurate than the -selected model on average (mean RoAS-MAE ratio 0.96, better in 45% of datasets), and with adstock-omitted candidates it is substantially worse (1.69×, better in only 13%), because the median of a set of uniformly biased specifications is itself biased. Consensus summaries therefore cannot substitute for causal validation. When no benchmark is available, analysts should report the median, interquartile range, and full range of RoAS across plausible specifications as a sensitivity statement, not as a selected causal estimate.
Real-world Calibration Illustration for Applied MMM Practice
The empirical application illustrates the proposed evaluation logic in an applied MMM workflow, using anonymized weekly sales and marketing data from a consumer packaged goods advertiser selling through retail channels. Several plausible specifications produce similar predictive fit but materially different RoAS estimates, while experimental RoAS benchmarks provide an external calibration target. The objectives are to quantify specification uncertainty across saturation forms, to examine the relationship between predictive fit and RoAS recovery, and to illustrate the decision implications of specification uncertainty. Because the data are anonymized, some details of the experiments and raw data cannot be disclosed, and because the benchmarks are used as point estimates without uncertainty intervals, the exercise is a calibration illustration; it does not establish statistical dominance of one specification over another.
Data and Business Context
We analyze 156 weekly observations (3 years) across three digital channels: Paid Search, Social Media, and Display Advertising. The dependent variable is normalized log-transformed sales (log sales volume divided by average sales volume per client); the regressors are weekly spend in dollars for each channel, together with controls (Fourier seasonality terms, promotional indicators, pricing variables) and an intercept. Experimental RoAS benchmark estimates for each channel were obtained through causal inference experiments over the same period and serve as calibration targets, consistent with § 5.4.1. Unlike the simulations, the application uses the full dataset for estimation, a common practice when history is limited and the objective is RoAS quantification rather than out-of-sample prediction.
Model Specifications and Estimation
We estimate four candidate specifications (Model 1 = Hill C-shape, Model 2 = Hill S-shape, Model 3 = Weibull C-shape, Model 4 = Weibull S-shape), all sharing the same geometric adstock and control variables and differing only in the saturation form. Each is estimated via constrained maximum likelihood as in § 5, with non-negativity constraints on marketing coefficients.
Results and Model Comparison
Table 5 presents the estimated RoAS for each of the three channels across the four model specifications, along with goodness-of-fit metrics.
| Model Spec | Saturation Function | Paid Search RoAS | Social Media RoAS | Display RoAS | Avg RoAS | |
| Model 1 | Hill C-shape | 0.782 | 2.13 | 2.47 | 3.81 | 2.80 |
| Model 2 | Hill S-shape | 0.778 | 1.63 | 2.77 | 3.81 | 2.74 |
| Model 3 | Weibull C-shape | 0.780 | 2.21 | 2.65 | 3.73 | 2.86 |
| Model 4 | Weibull S-shape | 0.762 | 1.97 | 1.58 | 3.30 | 2.28 |
| Experimental Benchmark | — | — | 2.24 | 2.63 | 3.31 | 2.73 |
Table 5. Real-World Application: Model Comparison Across Specifications
Notes: All models estimated on full 156-week dataset. Experimental RoAS benchmark estimates are obtained from causal inference experiments conducted over the same period. Model 1 achieves highest (0.782) but Model 3 achieves best RoAS recovery under the benchmark criterion.
Model Selection and RoAS Recovery
Using the experimental RoAS benchmark estimates, we calculate recovery metrics analogous to the simulation studies. Table 6 reports them for each specification, together with the outcomes of three selection criteria: -based, benchmark RoAS-MAE-based, and the median-based heuristic of § 6.5.
| Model Specification | RoAS-MAE | RoAS-RMSE | RoAS-MAPE | |
| Model 1 (Hill C-shape) | 0.255 | 0.308 | 8.63% | 0.782 |
| Model 2 (Hill S-shape) | 0.417 | 0.464 | 15.92% | 0.778 |
| Model 3 (Weibull C-shape) | 0.159 | 0.243 | 5.04% | 0.780 |
| Model 4 (Weibull S-shape) | 0.444 | 0.624 | 17.46% | 0.762 |
| Best by | Model 1 | RoAS-MAE = 0.255 | RoAS-MAPE = 8.63% | |
| Best by RoAS-MAE | Model 3 | RoAS-MAE = 0.159 | RoAS-MAPE = 5.04% | |
| Median-Based Selection | Model 3 | RoAS-MAE = 0.159 | RoAS-MAPE = 5.04% | |
| MAE Improvement Factor | 1.60 | |||
| Median Improvement Factor | 1.60 |
Table 6. RoAS Recovery Performance Against Experimental RoAS Benchmarks
The results mirror the ranking-disagreement pattern observed in simulation. The model with the highest (Model 1: 0.782) is not the model with the best RoAS recovery under the benchmark criterion. Model 3 has a marginally lower (0.780 vs. 0.782) but a substantially lower RoAS-MAE (0.159 vs. 0.255), a reduction that would be economically meaningful in media investment decisions and falls within the range observed in the low-complexity simulation scenarios (S1–S2), consistent with the predictive-fit paradox in § 6. The median-based consensus diagnostic (§ 6.5) also selects Model 3; this agreement does not validate the median rule, whose role remains descriptive.
Model 3’s advantage is consistent across channels. Its estimates (Paid Search: 2.21, Social Media: 2.65, Display: 3.73) are close to the experimental benchmark (2.24, 2.63, 3.31), with deviations of 1.3%, 0.8%, and 12.7%, respectively. By contrast, the -selected Model 1 overestimates Display RoAS by 15.1%, which could materially affect investment recommendations.
Notes: RoAS-MAE = Mean Absolute Error against experimental RoAS benchmark estimates. RoAS-MAPE = Mean Absolute Percentage Error. Model 1 achieves highest (0.782) but Model 3 achieves best RoAS recovery under the benchmark criterion. The median-based row is retained as an exploratory consensus diagnostic; in this application it selects the same specification as the benchmark RoAS-MAE criterion.
Managerial Implications
Several implications follow. Predictive accuracy alone is insufficient for media investment decisions. A model can fit historical sales while assigning incremental revenue to the wrong channels. Experimental benchmarks should enter calibration after estimand alignment is checked; our replicated simulations indicate that even imprecise experiments are more informative for specification choice than sales fit, so the absence of a perfect experiment is not a reason to fall back on . Without benchmarks, RoAS should be reported across plausible specifications rather than anchored to one predictive-fit-selected model. Forecasting and causal diagnostics should be reported separately: , MAPE, and RMSE are useful, but not evidence of causal validity.
Concluding Remarks
The results document a practical disconnect between predictive accuracy and causal RoAS recovery in MMM. In the scenarios considered here, the best-fitting sales model is often not the model closest to the causal RoAS benchmark, and replication over hundreds of independent datasets shows that this disagreement is systematic: among structurally sound specifications that differ only in saturation form, out-of-sample is essentially uninformative about RoAS accuracy, and the disagreement persists across levels of media-spend collinearity and noise and under a misspecified carryover shape. Predictive diagnostics remain useful, but they are not sufficient evidence of causal validity for media-investment decisions.
Evaluation criteria should match the model’s use. Predictive metrics such as , MAPE, and RMSE remain appropriate for forecasting. For causal RoAS interpretation, candidate MMM specifications should be compared with experimental benchmarks after checking estimand alignment. Without benchmarks, observational fit cannot identify the RoAS-optimal specification; analysts should report specification sensitivity, including ranges and consensus summaries across plausible specifications.
The evidence has limits. The replicated simulations quantify operating characteristics only for the data-generating processes, candidate sets, and spend processes considered; the numerical magnitudes should not be read as universal benchmarks. When all candidates share a severe structural omission, such as missing carryover, predictive fit becomes more informative and the advantage of benchmark-based selection narrows, disappearing when experiments are very imprecise. All candidate models use geometric carryover, and the adstock-form study covers a single alternative kernel; richer carryover representations, such as the rational transfer functions advocated by Palu [24], are a complementary route, but whatever carryover model is used, experimental calibration remains the external check on RoAS. The real-world application treats experimental benchmarks as point estimates and does not report experimental uncertainty intervals. The RoAS estimand used in the paper is an average incremental return over the observed spend path, not a marginal return to the next dollar of spend. The median-consensus diagnostic is exploratory and descriptive; it does not replace experimental calibration. Future research should extend the operating-characteristic analysis to larger channel sets, experiments that cover only a subset of channels, endogenous spend processes, and marginal rather than average RoAS estimands. Other promising extensions include uncertainty-weighted benchmark loss functions, spline-based or machine-learning response curves, cross-channel interactions, multi-product portfolios, and Bayesian posterior calibration against experimental benchmarks.
Data and Code Availability: The Python codes (including the replication code for all simulation studies) and the simulated datasets are available upon request. The real-world dataset is anonymized and cannot be publicly disclosed because of client confidentiality.
Disclosure of interest: The authors declare no competing interests. The views expressed are the authors’ own and do not represent those of their affiliated organizations.
Declaration of funding: No external grants, institutional funding, or sponsorship of any kind supported the preparation of this manuscript.
Details of the Motivating Example
Table A.1 lists the variables of the data-generating process in Equation (1), Table A.2 reports the parameters used to generate the motivating-example data, and Figure A.1 compares the two models on out-of-sample sales metrics.
| Variable | Description | Type | Dimension |
| Response Variable | |||
| Sales units | Response | ||
| Media Variables | |||
| Media spend in channel (dollars) | Predictor | ||
| Transformed media (adstock + saturation) | Derived | ||
| Pricing & Promo Variables | |||
| Price (dollars) | Predictor | ||
| Discount percentage | Predictor | ||
| Macroeconomic Variables | |||
| Unemployment rate | Predictor | ||
| Consumer Confidence Index | Predictor | ||
| Holiday Indicators | |||
| Independence Day indicator | Predictor | ||
| Thanksgiving indicator | Predictor | ||
| Christmas indicator | Predictor | ||
| Seasonality, Trend and Location Variables | |||
| Time trend (weeks) | Predictor | ||
| Annual seasonality (sine component) | Predictor | ||
| Annual seasonality (cosine component) | Predictor | ||
| Location indicator | Predictor |
Table A.1. Variable Definitions and Descriptions.
Saturation Functions and Estimation Details
Hill and Weibull Saturation Families
Hill Saturation Functions. The Hill function, originally developed in biochemistry to model enzyme kinetics, provides flexible saturation behavior controlled by two parameters:
where is the half-saturation point (i.e., ) and controls the curve shape.
| Parameter | Ch 1 | Ch 2 | Ch 3 | Ch 4 |
| Media Channel Parameters | ||||
| Media coefficient () | 1.15 | 0.85 | 0.90 | 0.55 |
| Adstock decay () | 0.40 | 0.50 | 0.30 | 0.60 |
| Saturation half-point () | 8000 | 6000 | 5000 | 4000 |
| Saturation shape () | 2.5 | 3.0 | 2.2 | 3.5 |
| Known simulation RoAS (computed) | 2.48 | 2.44 | 2.06 | 1.46 |
| Base and Location Parameters | ||||
| Intercept: | ||||
| Pricing and Economic Parameters | ||||
| Price elasticity: | Discount: | |||
| Unemployment: | Consumer confidence: | |||
| Temporal Parameters | ||||
| Time trend: | ||||
| Seasonality: , | ||||
| Holiday effects: (Independence), (Thanksgiving), (Christmas) | ||||
| Error Term | ||||
| Standard deviation: |
Table A.2. Benchmark Parameters for Data Generation

Figure A.1. Sales Prediction Accuracy Comparison. Model B (misspecified) outperforms Model A (correct) on all out-of-sample metrics: (0.93 vs. 0.90), MAPE (9.07% vs. 10.38%), and RMSE (138.55 vs. 169.13). The comparison concerns sales prediction only and should not be interpreted as evidence of causal validity.
Hill S-shape (): Sigmoidal saturation curve
This specification produces accelerating returns initially, followed by saturation. Larger values of increase the sharpness of the transition between the low-spend and high-spend regimes. Common in brand-building campaigns where awareness must reach critical mass.
Hill C-shape (): C-shaped saturation curve
This specification produces strong initial returns that diminish progressively. Smaller values of increase concavity, representing rapidly saturating channels where marginal effectiveness declines sharply with spending. Typical in direct response channels with audience saturation dynamics.
The parameter determines whether the response is purely concave or sigmoidal. For the Hill function, when , the curve is everywhere concave. When , the curve is sigmoidal: it is locally convex at low spend, locally concave at high spend, and has inflection point
Weibull Saturation Functions. The Weibull cumulative distribution function, widely used in reliability engineering and survival analysis, offers an alternative parameterization of saturation:
where is the scale parameter (the point at which ) and controls the shape.
Weibull S-shape (): S-shaped saturation curve
This specification produces slow initial response, accelerating growth, then saturation. Larger values of create sharper transitions at the inflection point. The Weibull S-shape differs mathematically from the Hill S-shape, offering an alternative functional form for threshold-driven response patterns.
Weibull C-shape (): Concave saturation curve
This specification produces strong initial returns that diminish progressively. Smaller values of increase concavity, representing rapidly saturating channels where marginal effectiveness declines sharply with spending. Common in mature, efficiency-focused channels like search advertising.
For the Weibull function, when , the curve is everywhere concave. When , the curve is sigmoidal with inflection point
Comparative Properties. While both Hill and Weibull functions can produce concave or sigmoidal response curves, they differ in several respects:
Mathematical origin: Hill functions arise from rational polynomials, whereas Weibull functions arise from exponential transformations.
Half-saturation vs. scale: For the Hill function, , whereas for the Weibull function, .
Inflection points: For , the Hill and Weibull sigmoidal curves have different inflection-point locations, given above.
Low-spend behavior: The two families can differ materially in sensitivity near zero spend, implying different marginal-RoAS profiles in the low-spend region.
These differences reflect different assumptions about marketing dynamics. Specification choice between these forms should be guided by alignment with observed data patterns and, when available, by agreement with estimand-aligned RoAS benchmarks. Figure 2 in § 5 illustrates the four saturation functions.
Likelihood and Constrained Estimation
To keep the estimation procedure aligned with the model specification in Equation (6), we estimate the model by bound-constrained maximum likelihood. Let
and define the linear predictor
where .
We assume
Hence, the conditional density of given is
The sample log-likelihood is therefore
We maximize subject to economically motivated sign and shape constraints:
The optimization problem is nonlinear and non-convex because of the recursive adstock transformation and the nonlinear saturation functions. We therefore use multi-start bound-constrained optimization, initialized from several plausible starting values, and retain the solution with the highest attained log-likelihood. The nonnegativity constraints on total location-specific media effects, , are handled by reparameterization, so that the constrained effects are nonnegative by construction. In our implementation, we use L-BFGS-B as the primary optimizer for the resulting bound-constrained problem and check the solution with Sequential Quadratic Programming (SQP). In practice, initializing transformation parameters near empirically plausible values (e.g., , near 1.0) and regression coefficients from an unconstrained ordinary least squares fit (with negative coefficients set to small positive values) provides stable starting points for the optimization.
Additional Results for the Single-Draw Simulation Scenarios
| DGP | Scenario | Traditional ( Max) | Benchmark (RoAS-MAE Min) | ||||
| RoAS-MAE | RoAS-MAPE | RoAS-MAE | RoAS-MAPE | ||||
| Hill C | S1 | 0.622 | 0.722 | 54.83% | 0.234 | 0.636 | 46.71% |
| S2 | 0.183 | 1.435 | 47.55% | 0.143 | 1.196 | 38.24% | |
| S3 | 0.264 | 10.956 | 49.00% | 0.264 | 9.243 | 41.59% | |
| S4 | 0.317 | 36.178 | 52.37% | 0.289 | 27.418 | 43.28% | |
| Average | 0.347 | 12.323 | 50.94% | 0.232 | 9.623 | 42.45% | |
| Improvement | — | 1.28× | |||||
| Hill S | S1 | 0.662 | 0.835 | 20.34% | 0.662 | 0.760 | 20.83% |
| S2 | 0.245 | 7.797 | 49.71% | 0.064 | 5.823 | 36.31% | |
| S3 | 0.463 | 68.423 | 34.07% | 0.312 | 36.585 | 20.80% | |
| S4 | 0.456 | 82.340 | 23.38% | 0.456 | 82.340 | 23.38% | |
| Average | 0.457 | 39.849 | 31.88% | 0.373 | 31.377 | 25.33% | |
| Improvement | — | 1.27× | |||||
| Weibull C | S1 | 0.472 | 0.693 | 37.85% | 0.472 | 0.513 | 29.43% |
| S2 | 0.397 | 4.418 | 35.60% | 0.392 | 3.247 | 28.74% | |
| S3 | 0.243 | 40.756 | 28.68% | 0.243 | 29.834 | 22.57% | |
| S4 | 0.314 | 72.384 | 36.24% | 0.271 | 54.217 | 28.36% | |
| Average | 0.356 | 29.563 | 34.59% | 0.345 | 21.953 | 27.27% | |
| Improvement | — | 1.35× | |||||
| Weibull S | S1 | 0.481 | 2.577 | 45.55% | 0.379 | 1.692 | 26.36% |
| S2 | 0.129 | 8.853 | 32.81% | 0.129 | 6.413 | 24.57% | |
| S3 | 0.263 | 62.347 | 31.67% | 0.263 | 44.823 | 24.83% | |
| S4 | 0.141 | 89.214 | 31.15% | 0.141 | 71.538 | 25.41% | |
| Average | 0.254 | 40.748 | 35.30% | 0.228 | 31.116 | 25.29% | |
| Improvement | — | 1.31× |
Table C.1. Model Selection Performance: Adstock-Omitted Candidate Models
Notes: All models omit the adstock transformation present in the DGP. Improvement factor = Traditional RoAS-MAE / Benchmark RoAS-MAE.
| Spec Condition | DGP | Scenario | Traditional ( Max) Selected Model | Traditional ( Max) RoAS-MAE | Median-Based Selected Model | Median-Based RoAS-MAE | Improv. Factor |
| Adstock-incl. | Hill C | S1 | Weibull C-shape | 0.554 | Hill C-shape | 0.683 | 0.81× |
| Adstock-incl. | Hill C | S2 | Hill C-shape | 1.947 | Weibull C-shape | 1.523 | 1.28× |
| Adstock-incl. | Hill C | S3 | Hill C-shape | 25.114 | Weibull C-shape | 9.487 | 2.65× |
| Adstock-incl. | Hill C | S4 | Weibull C-shape | 33.424 | Hill C-shape | 24.837 | 1.35× |
| Adstock-incl. | Hill S | S1 | Weibull S-shape | 2.235 | Weibull C-shape | 2.418 | 0.92× |
| Adstock-incl. | Hill S | S2 | Hill C-shape | 6.497 | Hill S-shape | 4.983 | 1.30× |
| Adstock-incl. | Hill S | S3 | Weibull C-shape | 47.968 | Hill S-shape | 43.517 | 1.10× |
| Adstock-incl. | Hill S | S4 | Weibull C-shape | 75.979 | Hill S-shape | 67.284 | 1.13× |
| Adstock-incl. | Weibull C | S1 | Weibull C-shape | 1.228 | Hill S-shape | 0.921 | 1.33× |
| Adstock-incl. | Weibull C | S2 | Hill C-shape | 4.213 | Hill C-shape | 3.284 | 1.28× |
| Adstock-incl. | Weibull C | S3 | Weibull C-shape | 50.187 | Weibull C-shape | 37.418 | 1.34× |
| Adstock-incl. | Weibull C | S4 | Hill C-shape | 60.347 | Hill C-shape | 59.873 | 1.01× |
| Adstock-incl. | Weibull S | S1 | Weibull S-shape | 1.624 | Weibull S-shape | 1.274 | 1.27× |
| Adstock-incl. | Weibull S | S2 | Weibull C-shape | 11.041 | Hill C-shape | 8.763 | 1.26× |
| Adstock-incl. | Weibull S | S3 | Hill C-shape | 66.831 | Weibull C-shape | 54.917 | 1.22× |
| Adstock-incl. | Weibull S | S4 | Weibull C-shape | 98.129 | Weibull C-shape | 68.334 | 1.44× |
| Adstock-omit. | Hill C | S1 | Hill C-shape | 0.722 | Hill C-shape | 0.574 | 1.26× |
| Adstock-omit. | Hill C | S2 | Hill C-shape | 1.435 | Hill S-shape | 1.847 | 0.78× |
| Adstock-omit. | Hill C | S3 | Hill C-shape | 10.956 | Hill C-shape | 8.437 | 1.30× |
| Adstock-omit. | Hill C | S4 | Hill C-shape | 36.178 | Hill C-shape | 27.384 | 1.32× |
| Adstock-omit. | Hill S | S1 | Weibull C-shape | 0.835 | Hill S-shape | 0.647 | 1.29× |
| Adstock-omit. | Hill S | S2 | Weibull C-shape | 7.797 | Hill C-shape | 5.706 | 1.37× |
| Adstock-omit. | Hill S | S3 | Hill C-shape | 68.423 | Weibull S-shape | 49.318 | 1.39× |
| Adstock-omit. | Hill S | S4 | Hill C-shape | 82.340 | Hill S-shape | 73.284 | 1.12× |
| Adstock-omit. | Weibull C | S1 | Hill C-shape | 0.693 | Hill C-shape | 0.537 | 1.29× |
| Adstock-omit. | Weibull C | S2 | Weibull C-shape | 4.418 | Hill S-shape | 5.183 | 0.85× |
| Adstock-omit. | Weibull C | S3 | Hill C-shape | 40.756 | Hill C-shape | 30.847 | 1.32× |
| Adstock-omit. | Weibull C | S4 | Hill C-shape | 72.384 | Weibull C-shape | 58.724 | 1.23× |
| Adstock-omit. | Weibull S | S1 | Weibull C-shape | 2.577 | Weibull S-shape | 3.184 | 0.81× |
| Adstock-omit. | Weibull S | S2 | Weibull C-shape | 8.853 | Hill C-shape | 6.847 | 1.29× |
| Adstock-omit. | Weibull S | S3 | Hill C-shape | 62.347 | Hill C-shape | 54.837 | 1.14× |
| Adstock-omit. | Weibull S | S4 | Weibull C-shape | 89.214 | Hill S-shape | 67.483 | 1.32× |
| Adstock-included (16 scenarios) | — | Median better: 14/16 | 1.29× | ||||
| Adstock-omitted (16 scenarios) | — | Median better: 13/16 | 1.19× |
Table C.2. Exploratory Comparison of -Based Selection and Median-RoAS Consensus Proximity
Notes: The median-based diagnostic is one example of a specification-consensus rule. It selects the model whose channel-level RoAS vector is closest to the componentwise median RoAS vector across candidate specifications. The median vector is a descriptive summary of model dispersion. It is neither an experimental benchmark nor a substitute for a causal benchmark. Known simulation RoAS values are used only retrospectively to evaluate the selected models in the simulation setting. Improvement factor = -based RoAS-MAE / median-consensus RoAS-MAE; values above one indicate that the median-consensus diagnostic selected a model with lower retrospective RoAS-MAE than the highest- model.
Replicated Simulation Studies: Cell-Level Results
This appendix reports the cell-level results of the replicated studies summarized in § 6.3. All studies reuse the DGP distributions, candidate models, optimizer settings (multi-start L-BFGS-B with five starts), 156/52-week split, and RoAS definition of § 6.1; only the replicated quantities are redrawn. Code and raw results are in the additional_runs folder of the replication package. Table D.1 and Figure D.1 report the Monte Carlo replication by DGP and complexity scenario, Tables D.2 and D.3 report the collinearity and noise studies by DGP, and Figure D.2 plots the agreement rate and the RoAS-error penalty of selection against and . Table D.4 reports the adstock-form study by DGP.
| Candidates | Scen. | DGP | Pr(agree) [95% CI] | MAE ratio (mean) | MAE ratio (median) | Exp-25 / | Median / | |||
| Included | S1 | Hill C | 40 | 0.10 [0.04, 0.23] | -0.01 | 1.90 | 1.85 | 0.302 | 0.66 | 0.77 |
| Included | S1 | Hill S | 40 | 0.15 [0.07, 0.29] | -0.20 | 1.57 | 1.45 | 0.107 | 0.75 | 0.97 |
| Included | S1 | Weibull C | 40 | 0.10 [0.04, 0.23] | -0.01 | 1.48 | 1.26 | 0.188 | 0.81 | 0.94 |
| Included | S1 | Weibull S | 40 | 0.38 [0.24, 0.53] | 0.02 | 1.34 | 1.20 | 0.111 | 0.87 | 1.09 |
| Included | S2 | Hill C | 40 | 0.20 [0.10, 0.35] | 0.10 | 1.46 | 1.23 | 0.386 | 0.82 | 0.97 |
| Included | S2 | Hill S | 40 | 0.20 [0.10, 0.35] | -0.08 | 1.29 | 1.26 | 0.093 | 0.86 | 0.97 |
| Included | S2 | Weibull C | 40 | 0.20 [0.10, 0.35] | 0.07 | 1.32 | 1.19 | 0.320 | 0.87 | 1.01 |
| Included | S2 | Weibull S | 40 | 0.07 [0.03, 0.20] | -0.02 | 1.39 | 1.32 | 0.116 | 0.82 | 0.94 |
| Omitted | S1 | Hill C | 40 | 0.53 [0.37, 0.67] | 0.59 | 1.25 | 1.00 | 0.073 | 0.90 | 1.81 |
| Omitted | S1 | Hill S | 40 | 0.53 [0.37, 0.67] | 0.65 | 1.15 | 1.00 | 0.023 | 0.97 | 1.54 |
| Omitted | S1 | Weibull C | 40 | 0.57 [0.42, 0.71] | 0.62 | 1.16 | 1.00 | 0.036 | 0.94 | 2.12 |
| Omitted | S1 | Weibull S | 40 | 0.55 [0.40, 0.69] | 0.61 | 1.27 | 1.00 | 0.039 | 0.89 | 1.68 |
| Omitted | S2 | Hill C | 40 | 0.75 [0.60, 0.86] | 0.71 | 1.07 | 1.00 | 0.026 | 0.99 | 1.76 |
| Omitted | S2 | Hill S | 40 | 0.53 [0.37, 0.67] | 0.60 | 1.12 | 1.00 | 0.026 | 0.96 | 1.45 |
| Omitted | S2 | Weibull C | 40 | 0.53 [0.37, 0.67] | 0.59 | 1.10 | 1.00 | 0.030 | 0.95 | 1.80 |
| Omitted | S2 | Weibull S | 40 | 0.45 [0.31, 0.60] | 0.61 | 1.17 | 1.05 | 0.035 | 0.92 | 1.39 |
Table D.1. Monte Carlo Replication of the Main Design: Results by Cell
Notes: = number of independent replications (each redraws DGP parameters, spend, controls and noise). Pr(agree) = share of replications in which the highest- candidate is also the lowest-RoAS-MAE candidate (Wilson 95% interval). = mean Kendall rank correlation between the ranking and the RoAS-accuracy ranking of the four candidates. MAE ratio = RoAS-MAE of the -selected model / RoAS-MAE of the RoAS-best model (). = mean of the -selected model minus that of the RoAS-best model. Exp-25 / = mean ratio of the RoAS-MAE obtained when selecting against a noisy experimental benchmark (25% coefficient of variation per channel) to that of selection; values below one favour the benchmark. Median / = same ratio for the benchmark-free median-consensus diagnostic.

Figure D.1. Monte Carlo distribution of the RoAS-error penalty from predictive-fit selection: RoAS-MAE of the highest- candidate divided by that of the RoAS-best candidate (log scale; means selected the RoAS-best model). Each point is one of 40 independent datasets per cell; black bars are medians.
| DGP | [95% CI] | MAE ratio (mean) | MAE ratio (median) | Exp-25 / | Median / | ||||
| 0 | Hill C | 15 | 0.53 [0.30, 0.75] | 0.09 | 1.17 | 1.00 | 0.320 | 0.96 | 1.05 |
| 0 | Hill S | 15 | 0.20 [0.07, 0.45] | -0.13 | 1.21 | 1.15 | 0.135 | 0.90 | 0.99 |
| 0 | Weibull C | 15 | 0.40 [0.20, 0.64] | -0.02 | 1.26 | 1.10 | 0.367 | 0.90 | 1.05 |
| 0 | Weibull S | 15 | 0.20 [0.07, 0.45] | -0.09 | 1.40 | 1.36 | 0.122 | 0.85 | 1.00 |
| 0 | Pooled | 60 | 0.33 [0.23, 0.46] | -0.04 | 1.26 | 1.12 | 0.236 | 0.90 | 1.02 |
| 0.3 | Hill C | 15 | 0.47 [0.25, 0.70] | 0.16 | 1.37 | 1.06 | 0.236 | 0.87 | 1.01 |
| 0.3 | Hill S | 15 | 0.20 [0.07, 0.45] | -0.09 | 1.30 | 1.21 | 0.104 | 0.85 | 1.01 |
| 0.3 | Weibull C | 15 | 0.27 [0.11, 0.52] | 0.24 | 1.34 | 1.15 | 0.269 | 0.87 | 1.02 |
| 0.3 | Weibull S | 15 | 0.27 [0.11, 0.52] | -0.11 | 1.35 | 1.10 | 0.093 | 0.87 | 1.00 |
| 0.3 | Pooled | 60 | 0.30 [0.20, 0.43] | 0.05 | 1.34 | 1.18 | 0.175 | 0.86 | 1.01 |
| 0.6 | Hill C | 15 | 0.47 [0.25, 0.70] | 0.07 | 1.26 | 1.10 | 0.327 | 0.90 | 0.96 |
| 0.6 | Hill S | 15 | 0.07 [0.01, 0.30] | -0.24 | 1.54 | 1.51 | 0.084 | 0.74 | 0.98 |
| 0.6 | Weibull C | 15 | 0.33 [0.15, 0.58] | 0.13 | 1.31 | 1.03 | 0.185 | 0.90 | 0.97 |
| 0.6 | Weibull S | 15 | 0.07 [0.01, 0.30] | 0.07 | 1.43 | 1.32 | 0.172 | 0.80 | 0.95 |
| 0.6 | Pooled | 60 | 0.23 [0.14, 0.35] | 0.01 | 1.39 | 1.30 | 0.192 | 0.83 | 0.97 |
| 0.9 | Hill C | 15 | 0.33 [0.15, 0.58] | 0.04 | 1.30 | 1.06 | 0.212 | 0.88 | 0.98 |
| 0.9 | Hill S | 15 | 0.20 [0.07, 0.45] | -0.20 | 1.37 | 1.37 | 0.079 | 0.80 | 0.97 |
| 0.9 | Weibull C | 15 | 0.20 [0.07, 0.45] | 0.00 | 1.39 | 1.21 | 0.174 | 0.85 | 0.98 |
| 0.9 | Weibull S | 15 | 0.07 [0.01, 0.30] | -0.27 | 1.37 | 1.31 | 0.269 | 0.81 | 1.06 |
| 0.9 | Pooled | 60 | 0.20 [0.12, 0.32] | -0.11 | 1.36 | 1.30 | 0.184 | 0.83 | 0.99 |
Table D.2. Robustness to Media-Spend Collinearity: Results by DGP (S2, adstock-included candidates). Notes: Columns as in Table D.1. The same random seeds are used at every , so differences across rows reflect only the spend correlation; the baseline design of § 6 uses .
| DGP | Pr(agree) [95% CI] | MAE ratio (mean) | MAE ratio (median) | Exp-25 / | Median / | ||||
| 0.02 | Hill C | 15 | 0.47 [0.25, 0.70] | 0.04 | 1.19 | 1.11 | 0.390 | 0.91 | 1.05 |
| 0.02 | Hill S | 15 | 0.20 [0.07, 0.45] | 0.04 | 1.23 | 1.12 | 0.077 | 0.88 | 0.97 |
| 0.02 | Weibull C | 15 | 0.13 [0.04, 0.38] | 0.18 | 1.34 | 1.36 | 0.281 | 0.84 | 1.04 |
| 0.02 | Weibull S | 15 | 0.13 [0.04, 0.38] | −0.11 | 1.30 | 1.30 | 0.138 | 0.86 | 0.98 |
| 0.02 | Pooled | 60 | 0.23 [0.14, 0.35] | 0.04 | 1.27 | 1.25 | 0.222 | 0.87 | 1.01 |
| 0.05 | Hill C | 15 | 0.47 [0.25, 0.70] | 0.20 | 1.20 | 1.12 | 0.225 | 0.91 | 1.00 |
| 0.05 | Hill S | 15 | 0.33 [0.15, 0.58] | 0.09 | 1.19 | 1.08 | 0.059 | 0.91 | 0.99 |
| 0.05 | Weibull C | 15 | 0.27 [0.11, 0.52] | 0.07 | 1.27 | 1.17 | 0.274 | 0.88 | 1.05 |
| 0.05 | Weibull S | 15 | 0.20 [0.07, 0.45] | −0.13 | 1.32 | 1.33 | 0.085 | 0.86 | 0.95 |
| 0.05 | Pooled | 60 | 0.32 [0.21, 0.44] | 0.06 | 1.25 | 1.16 | 0.161 | 0.89 | 1.00 |
| 0.1 | Hill C | 15 | 0.20 [0.07, 0.45] | 0.09 | 1.38 | 1.20 | 0.361 | 0.84 | 0.88 |
| 0.1 | Hill S | 15 | 0.47 [0.25, 0.70] | 0.18 | 1.20 | 1.03 | 0.050 | 0.93 | 1.06 |
| 0.1 | Weibull C | 15 | 0.20 [0.07, 0.45] | 0.11 | 1.29 | 1.21 | 0.252 | 0.86 | 1.02 |
| 0.1 | Weibull S | 15 | 0.33 [0.15, 0.58] | 0.02 | 1.21 | 1.07 | 0.079 | 0.92 | 1.09 |
| 0.1 | Pooled | 60 | 0.30 [0.20, 0.43] | 0.10 | 1.27 | 1.14 | 0.185 | 0.88 | 1.01 |
| 0.2 | Hill C | 15 | 0.33 [0.15, 0.58] | 0.20 | 1.20 | 1.08 | 0.255 | 0.93 | 0.93 |
| 0.2 | Hill S | 15 | 0.27 [0.11, 0.52] | 0.00 | 1.26 | 1.25 | 0.073 | 0.87 | 1.02 |
| 0.2 | Weibull C | 15 | 0.27 [0.11, 0.52] | 0.31 | 1.26 | 1.15 | 0.151 | 0.91 | 0.99 |
| 0.2 | Weibull S | 15 | 0.33 [0.15, 0.58] | 0.20 | 1.20 | 1.06 | 0.072 | 0.93 | 1.06 |
| 0.2 | Pooled | 60 | 0.30 [0.20, 0.43] | 0.18 | 1.23 | 1.14 | 0.137 | 0.91 | 1.00 |
Table D.3. Robustness to Noise Level: Results by DGP (S2, adstock-included candidates). Notes: Columns as in Table D.1. The same random seeds are used at every , so differences across rows reflect only the noise level; the baseline design of § 6 uses .
| DGP | Pr(agree) [95% CI] | MAE ratio (mean) | MAE ratio (median) | Exp-25 / | Median / | |||
| Hill C | 15 | 0.33 [0.15, 0.58] | 0.16 | 1.34 | 1.18 | 0.183 | 0.85 | 1.03 |
| Hill S | 15 | 0.27 [0.11, 0.52] | 0.11 | 1.28 | 1.31 | 0.045 | 0.87 | 1.02 |
| Weibull C | 15 | 0.27 [0.11, 0.52] | 0.09 | 1.23 | 1.25 | 0.266 | 0.91 | 1.12 |
| Weibull S | 15 | 0.20 [0.07, 0.45] | 0.00 | 1.26 | 1.21 | 0.107 | 0.86 | 0.97 |
| Pooled | 60 | 0.27 [0.17, 0.39] | 0.09 | 1.28 | 1.22 | 0.150 | 0.87 | 1.04 |
Table D.4. Adstock-Form Misspecification: Results by DGP (S2; delayed-adstock DGP, geometric-adstock candidates). Notes: Columns as in Table D.1. Sales are generated with a delayed adstock kernel (), peak lag drawn per channel and total carryover matched to the geometric kernel; all candidates use geometric adstock, so carryover is misspecified for every candidate while the true saturation family remains among them.

Figure D.2. Collinearity (left) and noise (right) studies, S2 with adstock-included candidates. Top: share of datasets in which the highest- candidate is also the RoAS-best candidate (pooled line with 95% Wilson band; dashed line = random choice among four candidates). Bottom: mean RoAS-MAE of the -selected model relative to the RoAS-best model. Colored lines show individual DGPs; black lines pool the four DGPs.
References
- [1]Abadie, A., Diamond, A., Hainmueller, J., 2010. Synthetic control methods for comparative case studies: Estimating the effect of california’s tobacco control program. Journal of the American Statistical Association 105, 493–505.
- [2]Barajas, J., Zidar, T., Bay, M., 2020. Advertising incrementality measurement using controlled geo-experiments: The universal app campaign case study. ACM: Washington, DC, USA .
- [3]Chan, D., Perry, M., 2017. Challenges and opportunities in media mix modeling. Google Inc 16.
- [4]Chen, H., Zhang, M., Han, L., Lim, A., 2021. Hierarchical marketing mix models with sign constraints. Journal of Applied Statistics 48, 2944–2960.
- [5]Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., Robins, J., 2018. Double/debiased machine learning for treatment and structural parameters.
- [6]Chivukula, V., 2024. The role of adstock and saturation curves in marketing mix models: Implications for accuracy and decision-making. International Journal of Advanced Research in Computer Science & Technology (IJARCST) 7, 10002–10007.DOI
- [7]Contreras-Pena, M.F., Victoria-Mas, J.S., Martin-Barreiro, C., Cabezas, X., 2026. A statistical software framework for marketing analytics: Methodology, simulations, case study, and a Python library. Journal of Marketing Analytics , 1–42.
- [8]Dew, R., Padilla, N., Shchet kina, A., 2024. Your MMM is broken: Identification of nonlinear and time-varying effects in marketing mix models. arXiv preprint arXiv:2408.07678 .arxiv.org/abs/2408.07678
- [9]Ding, P., Li, F., 2018. Causal inference. Statistical Science 33, 214–237.
- [10]Ebbes, P., Papies, D., van Heerde, H.J., 2021. Dealing with endogeneity: A nontechnical guide for marketing researchers, in: Handbook of market research. Springer, pp. 181–217.
- [11]Farris, P.W., Bendle, N., Pfeifer, P., Reibstein, D., 2010. Marketing metrics: The definitive guide to measuring marketing performance. Pearson Education.DOI
- [12]Gaur, J., Bharti, K., 2020. Attribution modelling in marketing: Literature review and research agenda. Academy of Marketing Studies Journal 24, 1–21.
- [13]Google, 2024. Meridian. https://github.com/google/meridian. Accessed: 2026-02-28.
- [14]Hanssens, D.M., Parsons, L.J., Schultz, R.L., 1990. Market Response Models: Econometric and Time Series Analysis. Kluwer Academic Publishers, Boston, MA.DOI
- [15]Hanssens, D.M., Parsons, L.J., Schultz, R.L., 2001. Market response models: Econo-metric and time series analysis. Springer.
- [16]Huang, H.C., Xu, J., Lim, A., 2024. Marketing mix optimisation with practical constraints. International Journal of Operational Research 51, 128–149.DOI
- [17]Iacobucci, D., Petrescu, M., Krishen, A., Bendixen, M., 2019. The state of marketing analytics in research and practice. Journal of Marketing Analytics 7, 152–181.DOI
- [18]Jin, Y., Wang, Y., Sun, Y., Chan, D., Koehler, J., 2017. Bayesian methods for media mix modeling with carryover and shape effects. Google Research , 1–34.
- [19]Katiaj, P., Koukოპულos, A., Farmakis, T., Fra idaki, K., 2024. Increasing roas on performance marketing: Leveraging cgc and video content on social media, in: Proceedings of the International Conference on Contemporary Marketing Issues.
- [20]Kerman, J., Wang, P., Vaver, J., 2017. Estimating Ad Effectiveness Using Geo Experiments in a Time-Based Regression Framework. Technical Report. Google.
- [21]Liu, Y., Laguna, J., Wright, M., He, H., 2014. Media mix modeling—a Monte Carlo simulation study. Journal of Marketing Analytics 2, 173–186.
- [22]Meta, 2022. Robyn. https://github.com/facebookexperimental/Robyn. Accessed: 2026-02-28.
- [23]Newell, J., Pilotta, J.J., Thomas, J.C., 2008. Mass media displacement and saturation. The International Journal on Media Management 10, 131–138.DOI
- [24]Palu, S., 2026. Marketing mix modeling adstock identification is just guesswork. LinkedIn article, 2 November 2026. https://www.linkedin.com/pulse/marketing-mix-modeling-adstock-parameter-just-guesswork-sione-palu-zeppe. Accessed: 2026-11-04.
- [25]Rossi, P.E., 2014. Even the rich can make themselves poor: A critical examination of IV methods in marketing applications. Marketing Science 33, 655–672.
- [26]Rukh, S., Oziri, S.T., Seyi-Lande, O.B., 2023. Framework for enhancing marketing strategy through predictive and prescriptive analytics. Shodhshauryam, International Scientific Refereed Research Journal 6, 531–569.DOI
- [27]Sun, Y., Wang, Y., Jin, Y., Chan, D., Koehler, J., 2017. Geo-level bayesian hierarchical media mix modeling. Google Research technical report.
- [28]Vaver, J., Koehler, J., 2011. Measuring ad effectiveness using geo experiments. Google white paper.
- [29]Wang, K., Wang, Y., Yao, J., 2005. A comparative study on marketing mix models for digital products, in: International Workshop on Internet and Network Economics, Springer. pp. 660–669.DOI
- [30]Wang, Y., Jin, Y., Sun, Y., Chan, D., Koehler, J., 2017. A hierarchical bayesian approach to improve media mix models using category data. Google Inc., research. google. com .
- [31]Wigren, R., Cornell, F., 2019. Marketing mix modelling: A comparative study of statistical models.