A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection
This work addresses the longstanding disconnect between defect localization and structured reporting in industrial inspection, which has traditionally relied on manual intervention. The authors propose a decoupled three-stage pipeline: the Eyes module leverages YOLOv8-x-obb for high-precision oriented defect detection; the Bridge module maps detection outputs to structured prompts via parameter-free spatial encoding; and the Brain module employs a 4-bit quantized Qwen-2.5-1.5B model, fine-tuned with QLoRA and retrieval-augmented fine-tuning (RAFT), to generate standardized JSON reports. Evaluated on a small-scale synthetic dataset, the approach significantly outperforms generic end-to-end large models, achieving a BLEU-4 score of 0.41, a hallucination rate of only 4%, an expert rating of 8.6/10, and an inference speed of 47 tokens per second on a single T4 GPU—surpassing a 671B-parameter API baseline in overall performance.