PsychePass: Calibrating LLM Therapeutic Competence via Trajectory-Anchored Tournaments
Existing evaluation methods struggle to effectively assess the therapeutic capabilities of large language models, often compromised by process drift and criterion drift. To address this, this work proposes a framework integrating trajectory-anchored client simulation with a Swiss-system dynamic tournament, coupled with an Elo rating mechanism to transform interaction trajectories into stable, comparable reward signals for policy gradient reinforcement learning. This approach enables unified calibration and efficient optimization of models’ therapeutic skills. Experimental results demonstrate that the framework’s evaluations align closely with human expert judgments and significantly enhance model performance in psychotherapeutic tasks.