SOV-CAD: Stepwise Orthographic Views Guided CAD Modeling Sequence Reconstruction

2026-07-05

AI Summary

Reconstructing CAD modeling sequences from images often fails to capture the iterative, feedback-driven nature of human design. This work formulates the task as a sequential decision-making problem and introduces a novel mechanism that combines stepwise orthographic view supervision with geometric alignment rewards. At each step, continuous visual feedback—comprising orthographic views, incremental model projections, and the current sketch—guides action selection. Built upon offline reinforcement learning and the Decision Transformer architecture, the proposed method significantly outperforms existing approaches in both reconstruction accuracy and data efficiency, achieving state-of-the-art performance while better reflecting authentic design workflows.

Abstract

Reconstructing Computer-Aided Design (CAD) modeling sequences from images is crucial for preserving design intent and supporting parametric editing. However, existing methods typically generate full CAD sequences holistically, overlooking the iterative, feedback-driven nature of human design workflows. We address this limitation by introducing the rich stepwise visual supervision: at each modeling step, the system observes the target's orthographic projections, the projections of the incrementally constructed model, and the active sketch, enabling informed action selection. To effectively leverage this on-the-fly feedback, we propose SOV-CAD, a framework that formulates CAD reconstruction as a sequential decision-making task and employs offline reinforcement learning with a Decision Transformer architecture. This design incorporates continuous visual feedback guided by geometric alignment rewards, resulting in a more accurate and human-like modeling process. Extensive experiments show that SOV-CAD surpasses state-of-the-art methods in CAD sequence reconstruction while exhibiting strong data efficiency. Code of SOV-CAD is available at: https://github.com/LukePhong/SOV-CAD

Problem

• CAD modeling sequence reconstruction
• design intent preservation
• parametric editing
• iterative design workflow
• visual feedback

Innovation

• stepwise orthographic views
• CAD sequence reconstruction
• offline reinforcement learning
• Decision Transformer
• geometric alignment rewards