Machine Learning under Imperfect Data: Challenges and Methods

2026-09-12

AI Summary

本文探讨了在数据不完美条件下的机器学习挑战，并通过信息损失、经验风险偏差等机制组织代表性方法，如重建生成、再平衡与表示校准等。

Abstract

Machine-learning models are commonly developed under an assumption that training and test data are sufficiently complete, balanced, labelled, and drawn from compatible distributions. In practice, one or more of these conditions is often violated. Measurements may be missing or corrupted, rare classes may be poorly represented, supervision may be weak, and the deployment environment may differ from the training environment. These imperfections are usually treated as separate technical problems, although they alter learning through a small number of shared mechanisms: loss of information, biased empirical risk, ambiguous supervision, and unstable representations. This short survey organises representative methods around these mechanisms. It reviews reconstruction and generation, rebalancing and representation calibration, learning with limited supervision, adaptation across domains and modalities, and reliability under distribution change. The discussion highlights the limits of plausible reconstruction, benchmark-specific correction, and adaptation without trustworthy feedback. It concludes with directions for evidence-aware learning, uncertainty-preserving prediction, and evaluation that separates visual plausibility from decision utility.

Problem

• imperfect data
• machine learning
• data distribution
• supervision
• information loss

Innovation

• information loss
• empirical risk bias
• ambiguous supervision
• unstable representations
• evidence-aware learning