Semiparametric Efficient Fusion of Individual Data and Summary Statistics

📅 2022-10-01
📈 Citations: 4
Influential: 1
📄 PDF
🤖 AI Summary
This study addresses the problem of efficiently integrating internal individual-level data with external aggregate statistics to improve estimation accuracy for population-level functional parameters under weak transportability assumptions. To overcome bias and efficiency loss arising from model misspecification in conventional approaches, we first derive the semiparametric efficiency bound for this fusion setting. Methodologically, we propose two novel estimators: (i) an efficient semiparametric estimator achieving the derived bound, and (ii) an adaptive fusion estimator with oracle properties—ensuring double robustness and automatic bias correction. We establish its asymptotic efficiency and unbiasedness theoretically. Simulation studies and real-data analysis of *Helicobacter pylori* infection demonstrate that our methods significantly enhance estimation precision and statistical power compared to using internal data alone or simple weighted aggregation.
📝 Abstract
Suppose we have individual data from an internal study and various summary statistics from relevant external studies. External summary statistics have the potential to improve statistical inference for the internal population; however, it may lead to efficiency loss or bias if not used properly. We study the fusion of individual data and summary statistics in a semiparametric framework to investigate the efficient use of external summary statistics. Under a weak transportability assumption, we establish the semiparametric efficiency bound for estimating a general functional of the internal data distribution, which is no larger than that using only internal data and underpins the potential efficiency gain of integrating individual data and summary statistics. We propose a data-fused efficient estimator that achieves this efficiency bound. In addition, an adaptive fusion estimator is proposed to eliminate the bias of the original data-fused estimator when the transportability assumption fails. We establish the asymptotic oracle property of the adaptive fusion estimator. Simulations and application to a Helicobacter pylori infection dataset demonstrate the promising numerical performance of the proposed method.
Problem

Research questions and friction points this paper is trying to address.

Efficient fusion of individual data with external summary statistics
Semiparametric framework for integrating internal and external studies
Addressing potential bias and efficiency loss in data integration
Innovation

Methods, ideas, or system contributions that make the work stand out.

Semiparametric efficient fusion of individual and summary data
Data-fused efficient estimator achieving semiparametric efficiency bound
Adaptive fusion estimator eliminating bias when assumptions fail
🔎 Similar Papers
No similar papers found.
W
Wenjie Hu
Department of Probability and Statistics, Peking University, Beijing, China
R
Ruoyu Wang
Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
W
Wei Li
Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing, China
Wang Miao
Wang Miao
University of Exeter
Future Internet5GB/6G CommunicationsMachine LearningPerformance Analysis and Optimisation