TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction under Lossy Compression

2026-08-27

AI Summary

针对损失压缩下的量度不确定性问题，提出TOPIQ框架，通过压缩元数据预测下游量度偏差与不确定性，实现快速准确的误差传播。

Abstract

Lossy compression is essential for managing massive scientific data, but per-element error bounds do not translate into bounds on downstream quantities of interest (QoIs) such as regional averages, neural network predictions, or multi-field derived quantities. We present TOPIQ, a statistical error-propagation framework that predicts QoI-level bias and uncertainty from compact compression metadata (less than 0.1% of original data). TOPIQ decomposes QoIs into primitive operators with closed-form propagation rules accounting for spatial error correlation and data-error coupling; new QoIs are supported by composition at runtime with no per-QoI derivation or retraining. Across 552 evaluations spanning 4 datasets, 3 compressors, 4 QoI families, and 8 error bounds, 93.1% of configurations achieve well-calibrated predictions. Pre-computed metadata enables post-hoc uncertainty quantification for arbitrary query regions at 56x-402x speedup over direct computation. A case study demonstrates integration into an AI-driven analysis pipeline with end-to-end confidence intervals for dynamically composed queries.

Problem

• Lossy Compression
• Quantity of Interest
• Error Propagation
• Data Compression
• Uncertainty Quantification

Innovation

• Lossy Compression
• Statistical Error Propagation
• Quantity-of-Interest Prediction
• Compression Metadata
• Uncertainty Quantification