Hierarchical Clustering As a Novel Solution to the Notorious Multicollinearity Problem in Observational Causal Inference

📅 2026-06-29
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the challenge of identifying independent causal effects in observational causal inference when explanatory variables exhibit high multicollinearity. To mitigate this issue, the authors propose a novel approach that integrates hierarchical clustering with a Bayesian marketing mix model. The method first groups geographic units into clusters based on the correlation structure of marketing expenditures, thereby constructing cluster-level data that eliminate shared temporal trends. Causal effects of individual marketing channels are then estimated at the cluster level. This work represents the first application of hierarchical clustering specifically designed to alleviate multicollinearity in causal inference, achieving substantially improved identification accuracy while preserving the interpretability of causal estimates. Empirical results demonstrate that the proposed framework effectively disentangles and accurately quantifies the distinct causal impacts of different advertising channels.
📝 Abstract
Multicollinearity is a long lasting challenge in observational causal inference, especially in regressions -- highly correlated independent variables make it hard to isolate their individual impacts on outcomes of interest. While common solutions such as shrinkage estimators and principal component regressions are helpful in prediction problems, a crucial limitation hinders their applicability to causal inference problems -- they cannot provide the original causal relationships. To fill the gap, we present an innovative and intuitive solution, by employing hierarchical clustering to aggregate data in a way that effectively alleviates collinearity. This method is generally applicable to causal problems featuring multicollinearity. We use a marketing application to demonstrate how and why it works. Expenditures on different advertising channels often exhibit correlations, making it exceedingly difficult to separately measure their impact. Many previous studies proposed to leverage granular cross-sectional data for better identification but, to our knowledge, none explicitly addressed multicollinearity, which undermines causal identification even with granular data. We propose to hierarchically cluster geographic units based on marketing spend correlation to reduce collinearity, and to implement a Bayesian Marketing Mix Model with cluster-level data. Such clustering happens in two steps -- we first normalize and demean geo-level data to establish a common scale and to eliminate the common trends; we then calculate pairwise distance to summarize marketing spend correlation between geos and cluster the ones with moderate to strong correlation. Both descriptive evidence and regression analysis affirm that such hierarchical clustering effectively mitigates collinearity and facilitates the separate identification of the impact of different marketing channels.
Problem

Research questions and friction points this paper is trying to address.

multicollinearity
observational causal inference
causal identification
regression analysis
marketing mix modeling
Innovation

Methods, ideas, or system contributions that make the work stand out.

hierarchical clustering
multicollinearity
causal inference
Bayesian Marketing Mix Model
observational data
🔎 Similar Papers
No similar papers found.
Y
Yufei Wu
Airbnb, Inc., San Francisco, California, USA
Z
Zhiying Gu
Airbnb, Inc., San Francisco, California, USA
A
Alex Deng
Airbnb, Inc., San Francisco, California, USA
J
Jacob Zhu
Airbnb, Inc., San Francisco, California, USA
L
Linsha Chen
Airbnb, Inc., San Francisco, California, USA