Pseudo-Incrementality Testing: Measuring Advertising Lift from Naturally Occurring Interventions

2026-09-16

AI Summary

本文提出一种在无随机实验条件下通过自然发生的营销干预来测量广告增量效果的方法，采用两阶段程序，包括发现干预和因果影响分析。

Abstract

We develop a method for measuring the incremental effect of advertising when randomized exper- iments are unavailable. Firms generate abrupt interventions in their own marketing as a byproduct of operations: budgets are cut, channels launch, programs pause. We propose a two-stage proce- dure that treats these events as quasi-experiments. The first stage discovers and dates interventions by exact Bayesian run-length inference on marketing activity series. The second stage runs a causal impact analysis against a variance-constrained structural time series counterfactual, with simulation-based inference, five qualification conditions, and a closed-form power bound. We validate the procedure on the two experimental benchmarks that Meta released with its GeoLift framework. The method identifies the day of intervention exactly in both cases. On the experiment where advertising was removed, it recovers the effect within 6.2 percent of the experimental esti- mate (implied return of 1.50 versus 1.60). On the experiment where advertising was added, its 90 percent interval covers the experimental estimate and excludes zero. Of six estimators evaluated on the same released data, ours is the only one that requires no geographic panel and produces intervals that are both correct on both experiments and narrow enough to act on.

Problem

• Pseudo-Incrementality Testing
• Advertising Lift
• Naturally Occurring Interventions

Innovation

• Pseudo-Incrementality Testing
• Bayesian run-length inference
• causal impact analysis
• quasi-experiments
• marketing interventions