Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

📅 2026-09-12
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究使用参数高效微调方法(如LoRA、QLoRA、Conv-Adapter和DiSCo)优化Segment Anything Model,以提高CT图像中肝肿瘤分割的准确性与效率。
📝 Abstract
We evaluated parameter-efficient fine-tuning (PEFT) of the Segment Anything Model (SAM) for liver tumor segmentation in abdominal CT of colorectal liver metastases. We compared Low-Rank Adaptation (LoRA), 4-bit Quantized LoRA (QLoRA), a convolutional adapter (Conv-Adapter), and our Directional Spectral Top-K adapter (DiSCo), training only adapters while freezing the SAM backbone. DiSCo derives spectral bases from singular value decomposition of row-normalized weights and learns rank-gated spectral coefficients, per-output magnitude offsets, and a spectral gain, with optional Top-K rank selection at inference and 0.14 M trainable parameters. We benchmarked five prompting regimes: no prompt, single-point, multi-point, and bounding boxes at intersection over union 0.50 and 0.75. Conv-Adapter and LoRA achieved the highest accuracy (overall Dice 0.793 and 0.792; single-point Dice 0.795 and 0.792; 95th-percentile Hausdorff distance (HD95) 32 mm). QLoRA was close (overall Dice 0.766; single-point Dice 0.768; HD95 36.41 mm), with 0.91 M trainable parameters, 120 ms latency, and 4.9 GB peak memory. DiSCo achieved the highest Dice per million trainable parameters (4.66), with overall Dice 0.653, single-point Dice 0.698, and HD95 49.53 mm. These results show an accuracy-efficiency trade-off and support PEFT for liver tumor segmentation with reduced adaptation costs when compute and labeled data are limited. Code: https://github.com/Ramtin-Mojtahedi/PEFT-SAM-Liver-CT
Problem

Research questions and friction points this paper is trying to address.

Parameter-Efficient Fine-Tuning
Liver Tumor Segmentation
CT
Adapters
Efficiency
Innovation

Methods, ideas, or system contributions that make the work stand out.

Parameter-Efficient Fine-Tuning
DiSCo
Spectral Bases
Liver Tumor Segmentation
SAM
R
Ramtin Mojtahedi
School of Computing, Queen’s University, Kingston, ON, Canada; Toronto General Research Institute, University Health Network, Toronto, ON, Canada
M
Mohammad Hamghalam
School of Computing, Queen’s University, Kingston, ON, Canada; Department of Electrical Engineering, Qa.C., Islamic Azad University, Qazvin, Iran
J
Jacob J. Peoples
Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
R
Richard K. G. Do
Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
A
Amber L. Simpson
Department of Radiology and Diagnostic Imaging, University of Alberta, Edmonton, AB, Canada; Alberta Machine Intelligence Institute, Edmonton, AB, Canada