SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessment

📅 2026-08-31
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文通过构建包含视频、评分和文本评论的SurgSkill-Bench数据集,采用视觉骨干网络与文本注意力机制结合的方法,解决手术技能自动化评估问题。
📝 Abstract
Objective assessment of surgical technical skill is important for surgical training and structured feedback, but current workflows remain dependent on labor-intensive expert review. Existing automated approaches primarily focus on visual inputs and provide limited support for jointly studying operative performance, structured skill scores, and evaluator feedback. We introduce SurgSkill-Bench, an initial video-score-text benchmark-style dataset containing 214 surgical training simulation videos, six-dimensional OSATS scores, and expert free-text comments. We define two evaluation settings: video-only OSATS prediction for automated assessment and post hoc expert-comment-assisted prediction, where evaluator comments are available as auxiliary information. We provide controlled baseline experiments using representative frozen visual backbones, content-adaptive key-frame sampling, and a simple video-text co-attention fusion module. Under internal video-level validation, content-adaptive sampling improves video-only performance in this dataset, while evaluator comments provide additional score-related signal in the assisted setting. The best mean AUROC reaches 0.88 under dataset-specific median dichotomization. We further discuss evaluation constraints related to dataset scale, metadata completeness, and the interpretation of comment-assisted prediction. Code will be released publicly at a later date.
Problem

Research questions and friction points this paper is trying to address.

surgical skill assessment
automated assessment
expert review
multimodal analysis
Innovation

Methods, ideas, or system contributions that make the work stand out.

Surgical Skill Assessment
Multimodal Benchmark
Content-Adaptive Sampling
Video-Text Co-Attention
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
C
Chaohui Dang
Department of Electronic, Electrical and Systems Engineering, School of Engineering, University of Birmingham, Birmingham, UK
Z
Zheheng Jiang
School of Computing and Mathematical Science, University of Leicester, Leicester, UK
J
James Glasbey
Department of Applied Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK
D
David Luke
Surgical Division, University Hospitals North Midlands, Stoke-on-Trent, UK
T
Theodoros Arvanitis
Department of Electronic, Electrical and Systems Engineering, School of Engineering, University of Birmingham, Birmingham, UK
L
Le Zhang
Department of Electronic, Electrical and Systems Engineering, School of Engineering, University of Birmingham, Birmingham, UK