When is Test-Time Adaptation Identifiable From Unlabeled Evidence?

2026-09-10

AI Summary

研究探讨了无标签测试数据是否足以确定最佳测试时适应方法，发现即使有完美选择器，信息不足也可能导致无法可靠选择。

Abstract

Test-time adaptation (TTA) offers many ways to update a deployed model without labels, but choosing the wrong update can make a strong source model worse. Recent methods therefore try to predict which adaptation will work from unlabeled test data. We ask a prior question: does the evidence given to the selector contain enough information to determine the best action at all? We show that this is not guaranteed, even with a perfect selector. If an observation channel makes two deployments look the same while their TTA rankings differ, reliable selection is impossible from that channel; richer evidence can restore the decision only when it resolves the relevant ambiguity. We make this boundary exact in a finite-batch Gaussian TTA model, where doing nothing beats mean recentering for small shifts, recentering wins beyond a unique critical shift, and the boundary shrinks as $1/\sqrt n$. Public benchmark studies on CIFAR-100-C and DomainNet-126 show the same failure mode with modern TTA methods: changing only deployment structure can reverse the oracle action while global order-blind evidence remains unchanged. The result is a practical way to separate two failure modes that are usually mixed together: a weak selector versus an information channel that cannot support the desired decision in the first place.

Problem

• Test-time Adaptation
• Unlabeled Evidence
• Selector
• Deployment Structure
• Gaussian TTA Model

Innovation

• Test-Time Adaptation
• Unlabeled Data
• Gaussian TTA Model
• Deployment Structure
• Decision Boundary