Compos3D: Interactive Part-Based Composition for Creative Control in Generative 3D Models

2026-07-13

AI Summary

Existing generative 3D modeling approaches rely on iterative regeneration, which suffers from limited controllability and unpredictable outcomes. This work proposes a compositional modeling workflow that introduces, for the first time, a part-level mixing mechanism supporting hybrid 2D/3D interaction: users assemble 3D models by selecting 2D regions or 3D mesh fragments from multiple candidate generations. The system then automatically synthesizes geometrically consistent models aligned with high-level user intent through a pipeline integrating text- or image-based guidance, geometric segmentation, seamless fusion, and detail refinement. User studies demonstrate that this approach significantly outperforms conventional regeneration paradigms in terms of creative control, alignment with user intent, and overall user satisfaction.

Abstract

While generative AI has unlocked new opportunities for 3D content creation, current workflows often rely on multiple regenerations, which provides limited control and unpredictable outcomes. We present Compos3D, a system that introduces a compositional workflow for generative 3D modeling through remixing. Instead of repeatedly regenerating models, users generate multiple candidates from text or image prompts, select parts of interest via 2D image regions or 3D mesh segments, and assemble them into a coherent design. The system synthesizes these compositions into a refined 3D model, preserving high-level intent while resolving low-level geometry. To evaluate this approach, we conducted a controlled user study comparing remixing and regeneration workflows across both 2D and 3D modalities. Results show that the remixing workflow provides participants with greater creative control, stronger alignment with their intent, and higher satisfaction. We conclude with design recommendations for future AI-assisted 3D modeling workflows.

Problem

• generative 3D models
• creative control
• composition
• remixing
• 3D content creation

Innovation

• compositional modeling
• generative 3D
• interactive remixing
• part-based composition
• creative control