Marketing Mix Modeling

It is a paradox of statistics that experiments with small sample sizes are more likely to find larger effects of an intervention, when they find anything at all. This happens because smaller samples produce noisier estimates. For a result to clear the significance bar in a noisy environment, the observed […]

Data can show you what happened and be used to project into the future with some degree of confidence, but it can never tell you why things are the way they are. No matter how massive your dataset, how sophisticated your pipeline, or how tight your confidence intervals, raw data

There are two types of “accuracy” under media mix modeling, and it’s easy to confuse them, which leads to many marketing teams not having an aligned measurement program.  The first is attribution accuracy: how the model assigns credit across channels in historical data. This is the world of decompositions and

A brand we were working with missed its forecast by $10M. Immediately, you’d think that Recast made a bad forecast but, when we looked into what happened, the planned mix was $15M TV / $25M Facebook vs the executed mix which was $5M TV / $50M Facebook.  That’s a fundamentally

Media mix modeling is a waste of money unless you do something with it. A great model sitting on a shelf is a model that has failed. And this happens too often – the leadership team signs the contract, the analysts get the recommendations, they share them in a meeting,

A redditor recently asked us how to break into causal inference when their current company doesn’t offer opportunities to work on it. This is a common roadblock for data professionals trying to build expertise in a new area, so we’re sharing our response publicly for anyone facing the same challenge.

Every planning cycle ends with the exec team asking questions like the above, and most marketing teams have no hard data to answer them. That’s because most teams plan one budget and execute another – not because they’re sloppy, but because, well, reality forces them to. CPMs spike: maybe a

The math and science part of media mix modeling is extremely hard to get right. But even when you do, many MMMs will still fail because the system around them rewards the wrong outcomes.  There is enormous pressure in marketing measurement to show that things worked. Marketers want to prove

One of the most overloaded concepts in media mix modeling right now is “model refresh.” Most senior marketers hear that word and reasonably assume it means the model has been updated to reflect reality. New data went in. Old assumptions were challenged. Channel performance was re‑estimated. That’s what a refresh