VIScore: Diagnosing Planning-Relevant Quality in Latent World Models
Existing evaluation metrics struggle to effectively link latent space characteristics with planning success, particularly lacking diagnostic capability on out-of-distribution data. This work proposes VIScore, the first unified, quantifiable metric that jointly models the three stages of encoding, prediction, and search-based planning through three dimensions: Veracity, Influence, and Sobriety, comprehensively assessing a world model’s support for planning tasks. Experimental results demonstrate that VIScore achieves a Spearman correlation exceeding 0.75 across a cross-task success pool and exhibits significantly lower calibration error than constant fitting baselines. It attains state-of-the-art performance on both seen and unseen models and datasets, thereby transcending traditional evaluation paradigms that focus solely on latent representations.