ResemBrick: Brick Reconstruction from Photographs with Perceptual Fidelity and Buildability

2026-08-10

AI Summary

This work addresses the challenge of generating visually realistic and physically constructible colored brick models from a small set of casually captured photographs, under constraints of physical assemblability and a fixed discrete voxel budget. To this end, the authors propose an end-to-end method that formulates voxel discretization as an optimizable resource allocation problem for the first time. Their approach employs a resolution-conditioned network for budget-aware voxel occupancy prediction, followed by a support-aware greedy placement strategy and a deterministic repair algorithm to guarantee structural stability and eliminate unsupported bricks. Under identical voxel budgets, the method achieves significantly higher perceptual fidelity compared to prior approaches and produces zero unsupported or unstable components on an unfiltered test set.

Abstract

Producing a hand-buildable, colored brick model of a 3D object from a few casual photographs is a clean testbed for a broader challenge: generating 3D content that meets hard physical-assembly constraints under a discrete, budget-limited voxel grid. On a coarse lattice, visual resemblance and structural stability pull against each other, yet prior brick pipelines address only one side and treat voxelization as fixed preprocessing rather than a variable to optimize. We present ResemBrick, which couples the two. Budgeted occupancy completion reframes discretization as allocation: given a target occupied-voxel count, a single resolution-conditioned network decides in one feed-forward pass which surface voxels to fill for best appearance, one weight set spanning 13 resolutions. Buildability by construction then combines support- and look-ahead-aware greedy placement with a deterministic, provably terminating repair that grounds every floating component. Under a matched budget, ResemBrick surpasses existing voxel selectors in perceptual fidelity while uniquely reaching zero floating and zero unstable bricks on unfiltered held-out objects; as a complete pipeline, it attains the best perceptual fidelity among prior brick-construction systems. Our results point to treating discretization and assembly as tightly coupled stages rather than independent ones.

Problem

• brick reconstruction
• perceptual fidelity
• buildability
• voxel grid
• physical-assembly constraints

Innovation

• brick reconstruction
• perceptual fidelity
• buildability
• budgeted voxelization
• resolution-conditioned network