Human-AI Co-design for Clinical Prediction Models
This work addresses the limitations of traditional clinical prediction models, which rely heavily on expert involvement and struggle to effectively leverage unstructured clinical text, hindering real-world deployment. To overcome this, the authors propose HACHI, a novel framework that deeply integrates human feedback with AI agent exploration. Through iterative human–AI collaboration, HACHI extracts interpretable clinical concepts from free-text notes using simple yes/no queries and leverages expert feedback to construct transparent, verifiable linear prediction models. Evaluated on acute kidney injury and traumatic brain injury prediction tasks, HACHI not only outperforms existing methods but also discovers novel clinically relevant concepts, substantially improving generalizability across institutions and time. Furthermore, the framework effectively identifies data biases and leakage issues, enhancing model reliability and trustworthiness.