In-housing your Marketing Mix Modeling (MMM) can seem like it gives you more control over your data and insights, but building and maintaining an MMM in-house is far more complex than many organizations anticipate – seriously, we know from personal experience. If you think it’s the right move for your …
7 Things to Look Out for When In-Housing Marketing Mix Modeling (MMM) Read More »
The goal of MMM is not just prediction—it’s understanding causality. When marketers ask how much each channel contributed to sales, they’re asking about the true causal impact of their marketing efforts. But how do you know if your model has actually picked up true causation? This article will cover 3 …
The Importance of Out-of-Sample Goodness of Fit Metrics in Marketing Mix Modeling (MMM) Read More »
Building a Marketing Mix Model (MMM) that actually works and you can trust isn’t easy. A great model can radically change your company – how you forecast, where you allocate your budget, how you think about incrementality…– but a bad one can lead you to make very biased decisions. As …
10 Ways to Build a Bad MMM (Marketing Mix Model) Read More »
In marketing, every forecast comes with some level of uncertainty – whether you’re predicting sales growth, estimating the impact of a new campaign, or adjusting your media mix. There’s no crystal ball and, too often, marketers fall into the trap of treating forecasts as absolute, when in fact, they represent …
“I ran an experiment showing positive lift but didn’t see the results in the bottom line.” Sounds familiar? I think we’ve all had this experience: we set up a nice, clean A/B test to check the value of a feature or a creative. We get the results back: 5% lift, …
The Hidden Pitfall in Marketing Experiments: Understanding Uncertainty Read More »
Does the carry-over effect problem mean you can’t refresh your media mix model more than once a quarter? No. Sadly, I’ve seen a number of “experts” claiming that because marketing effects have long carry-over periods you can’t refresh a media mix model frequently. This is simply wrong and just doesn’t …
Carry-Over Effects: Why They Don’t Limit Media Mix Model Updates Read More »
Is your incrementality testing partner hiding something from you? We’ve seen it too many times: brands come to us very proud of running an incrementality study and they share the results with us and say something like: “Look, we ran an incrementality study and there was a 3% lift and …
The Hidden Truth Behind Incrementality Testing Results Read More »
“There is nothing so stable as change” – Bob Dylan Why Measure Model Stability? Media mix models (MMMs) need to be actionable for marketers. If an MMM produces wild swings in output every time it receives new information, it indicates that there is something wrong with the model and it …
MMMs are powerful models and that means they’re subject to what modelers call “over-fitting”. The idea is that you can build a model that fits really, really well to the data that the model is trained on, but that hasn’t found the actual underlying causal relationships in the data. Over-fitting …
Understanding Overfitting in Media Mix Modeling: Risks, Metrics, and Validation Read More »
Correlation vs causation is a huge marketing measurement problem that traditional methods often fail to account for and can lead to biased conclusions and misguided budget allocation. This is where Directed Acyclic Graphs (DAGs) come into play. DAGs offer a powerful, visual approach to mapping out and clarifying causal relationships …
How do Causal Directed Acyclic Graphs (DAGs) work in Marketing Mix Modeling: Read More »
