Institution profile

Heidelberg Institute for Theoretical Studies

Academic institutioneurope · de
Official website
Research library9linked papers
Opportunities0open roles
Selected work

Representative Papers

Information leakage from data revisions in retrospective forecasts

Aug 06, 2026

This study addresses a critical yet often overlooked source of information leakage in retrospective evaluations of AI-driven forecasting systems: the failure to account for data revisions. The authors systematically demonstrate how this oversight leads to inflated performance estimates and present, for the first time, a cross-domain cautionary framework to mitigate such biases. Through retrospective predictive analysis, explicit modeling of data revision processes, and rigorous evaluation protocols, they reveal that a previously reported AI system’s purported superiority over the CDC ensemble model stems not from genuine predictive gains but from information leakage introduced by unadjusted historical data revisions. These findings establish essential methodological corrections and evaluation standards for future research in AI-based forecasting, ensuring more reliable and reproducible assessments of predictive performance.

0 citationsRead paper
Recent publications

Latest Papers

Information leakage from data revisions in retrospective forecasts

Aug 06, 2026

This study addresses a critical yet often overlooked source of information leakage in retrospective evaluations of AI-driven forecasting systems: the failure to account for data revisions. The authors systematically demonstrate how this oversight leads to inflated performance estimates and present, for the first time, a cross-domain cautionary framework to mitigate such biases. Through retrospective predictive analysis, explicit modeling of data revision processes, and rigorous evaluation protocols, they reveal that a previously reported AI system’s purported superiority over the CDC ensemble model stems not from genuine predictive gains but from information leakage introduced by unadjusted historical data revisions. These findings establish essential methodological corrections and evaluation standards for future research in AI-based forecasting, ensuring more reliable and reproducible assessments of predictive performance.

0 citationsRead paper