AI Can Be Easily Persuaded in Clinical Decision Making

📅 2026-08-29
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过控制实验探讨了AI在临床决策中被说服的容易程度,发现权威、背景等因素可影响AI决策,强调了确保AI在高风险医疗决策中保持客观判断的重要性。
📝 Abstract
As AI becomes increasingly integrated into clinical practice, it is playing a growing role in medical decision making. Medicine, however, is a high stakes and evidence based field, where decisions can directly affect patients' lives. It is therefore important to understand whether AI can maintain objective judgment when others try to persuade it. In this paper, we study how easily AI can be persuaded through controlled experiments. We find that professional authority, national background, institutional affiliation, claimed past performance, multiple physicians, supported clinician views, and repeated pressure can all affect AI decisions. Surprisingly, the same persuasive input changes about 10% more cases when it comes from a senior clinician than from a medical student. Simply claiming a better performance history consistently makes the physician more persuasive. More strikingly, a plausible clinician view can persuade AI away from a correct decision even when it is fabricated to support an incorrect answer. This indicates that AI can be strongly influenced by convincing support without reliably determining whether this view from the clinician is correct. Together, these findings suggest that AI can be easily persuaded by what people say, who says it, and how the opinion is presented. Therefore, it is essential for AI to maintain sound judgment under persuasion, enabling its safe and reliable use in high stakes medical decision making.
Problem

Research questions and friction points this paper is trying to address.

AI
Clinical Decision Making
Persuasion
Objective Judgment
Medical Practice
Innovation

Methods, ideas, or system contributions that make the work stand out.

professional authority
claimed past performance
persuasive input
🔎 Similar Papers
No similar papers found.