The model selection process

Last updated: September 9, 2026

How Paramark’s MMM is set up — and why that matters

Customers often want to go one level deeper than “we use MMM” and understand what kind of model Paramark runs, how it is structured, and why that approach is powerful in practice. This article explains that layer.

The short version: Paramark does not rely on one black-box model or one analyst’s subjective view. We build multiple modern MMMs, compare how they behave, and use that model ensemble to identify where the story is stable versus where uncertainty remains.


What type of model is Paramark using?

Paramark uses modern marketing mix models (MMMs) built on leading open-source frameworks. In practice, these are statistical time-series models that estimate how changes in media activity relate to changes in business outcomes over time.

These models are designed to handle several realities of real-world marketing:

  • Lagged effects: marketing often influences outcomes after a delay, not just in the same week it ran.

  • Diminishing returns: the tenth dollar in a channel usually does not perform like the first.

  • Baseline versus incrementality: the model separates outcomes that likely would have happened anyway from the lift associated with marketing activity.

  • Multiple drivers at once: channels, seasonality, and other business patterns are evaluated together instead of in isolation.

So while “MMM” can sound like a single model category, Paramark’s implementation is better thought of as a family of modern statistical models evaluated together rather than a single static formula.

How the model is set up

At a high level, Paramark starts with historical time-series data such as media inputs and business outcomes, then tests multiple valid model specifications against that history.

That setup typically includes:

  1. Preparing the outcome and channel inputs so the model can evaluate how marketing activity relates to sales, revenue, conversions, or other target metrics over time.

  2. Applying transformations that reflect marketing reality, such as carryover/adstock and saturation effects.

  3. Testing multiple parameter choices rather than assuming one decay rate, one baseline structure, or one prior setting is always correct.

  4. Comparing outputs across model runs to see whether channels tell a similar story under different reasonable assumptions.

  5. Selecting a representative model and confidence framing based on fit, recent behavior, convergence across models, and business reasonableness.

This is an important difference from simpler approaches. A single-model workflow can produce a clean answer quickly, but it can also hide how sensitive that answer is to assumptions. Paramark’s setup is meant to expose that sensitivity rather than conceal it.

Why this approach is powerful

The power of this setup comes from the fact that marketing measurement is noisy, imperfect, and rarely has a single obvious ground truth.

By building an ensemble instead of relying on one model, Paramark can:

  • See where results are robust: if several reasonable models point to the same answer, confidence increases.

  • See where results are fragile: if estimates swing dramatically across models, that is a signal to use caution.

  • Reduce black-box risk: the goal is not to defend one magical specification, but to understand which conclusions survive scrutiny.

  • Make better decisions under uncertainty: teams can act on stable findings and investigate lower-confidence areas with experiments or further analysis.

In other words, the model is powerful not just because it is statistically sophisticated, but because it is built to be decision-useful. It helps distinguish signal from noise and gives teams a more realistic view of what they can trust.


Open Source Foundation

Paramark uses exclusively open-source MMM packages—no proprietary "black box" models:

  • LightweightMMM (Google)

  • Robyn (Meta)

  • Meridian (Google - actively being integrated)

Ensemble Modeling Approach

Rather than running a single model, Paramark builds an ensemble of models using multiple packages and configurations. This includes:

  • Running both Robyn and LightweightMMM models

  • Testing different configurations varying adstock, seasonality, fixed cost priors, and baseline coefficients

  • Identifying where models converge or diverge to find consensus

This approach is strictly better than running a single model because it reveals where estimates are robust versus uncertain.

What type of model is Paramark using?

Paramark uses a modern ensemble-based marketing mix modeling (MMM) approach built on leading open-source Bayesian and machine-learning frameworks. In practice, that means we do not rely on a single model or a single set of assumptions. We build multiple plausible models across packages and parameter settings, then compare where they agree, where they differ, and which specification best explains the business.

This matters because marketing performance is noisy, non-linear, and affected by lag, seasonality, baseline demand, and channel saturation. A single model can produce a neat answer, but it may hide how sensitive that answer is to the assumptions underneath it. Our approach is designed to surface that uncertainty instead of masking it.

Why this approach is powerful

  • It avoids black-box overconfidence: because we compare multiple credible models, we can distinguish between results that are truly robust and results that depend heavily on one modeling assumption.

  • It captures real marketing behavior: we explicitly test assumptions around adstock, seasonality, baseline behavior, priors, and other factors that shape how marketing works in the real world.

  • It makes uncertainty decision-useful: rather than pretending there is one perfectly precise answer, we look for convergence across models and use estimate ranges and confidence levels to communicate how actionable a result really is.

  • It improves trust in the final readout: when multiple model families and configurations point to the same conclusion, marketers can have much more confidence that the signal is real and not a modeling artifact.

Model Selection Criteria

To determine the "most representative" model, we evaluate:

  1. Model fit with emphasis on recent history - We prioritize accuracy in the most recent months over average historical accuracy

  2. Residual distribution - How much the model predictions deviate above and below actuals in the pre-period

  3. Visual inspection - Comparing model outputs and layer cakes across configurations

  4. Model consensus - When results across parameters and packages are consistent, we have higher confidence

We do not rely heavily on traditional metrics like R-squared or MAPE alone. These can be flawed for time-series data because they reflect average accuracy rather than the accuracy of recent months, which matters most for marketing decisions.

Credibility Intervals & Confidence Levels

Instead of building a single model and expressing uncertainty through confidence intervals, we build multiple models. Each model makes different assumptions, so there isn't one "correct" interval to report.

We provide estimate ranges that reflect variation across models, offering a more realistic view of uncertainty. Channels are assigned relative confidence levels:

Confidence Level

Meaning

High Confidence

Results are reliable and actionable

Medium Confidence

Require situational consideration; may need additional testing

Low Confidence

Preliminary; require validation through experiments

Minimal Analyst Intervention

Our models have upwards of 50 parameters, but analysts typically influence only 3 or fewer:

  • Negative baseline corrections

  • Extremely low CPA adjustments

  • Seasonality tuning

For parameters set by analysts, we look at what makes business sense—for example, a negative baseline doesn't make logical sense even if that's what a model outputs. We do not ask which channel the marketer thinks is performing best.

Validation Approach

We validate models through:

  • Running experiments to check results (there is no absolute ground truth in marketing)

  • Monitoring data refreshes to ensure models haven't drastically changed their conclusions

  • Building many models to see where they converge—if results are consistent, confidence increases

We do not routinely perform traditional backtesting (holding out recent data) because recency is critical in marketing time-series modeling, and holding out recent data would starve the model of its most important inputs. In specific situations, such as when a customer needs formal validation documentation, we can produce a backtesting report on request.


Want to learn more about marketing mix modeling? Check out other Paramark marketing mix modeling articles here