Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

📅 2026-09-12
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出Mind2Cloud框架,通过双粒度扩散解码方法从脑电信号生成点云,解决了现有方法忽视信号和去噪过程语义粒度变化的问题。
📝 Abstract
Reconstructing 3D objects from brain signals offers a promising avenue for understanding human visual cognition. While prior work has shown initial success using EEG signals for 3D reconstruction, existing methods typically employ a uniform diffusion decoder, overlooking the evolving semantic granularity of both EEG representations and the diffusion denoising process. In this paper, we propose Mind2Cloud, a novel EEG-to-point-cloud generation framework based on two-granularity diffusion decoding. The core of Mind2Cloud is a time-aware decoder that integrates a global Transformer branch and a local Point-Voxel CNN (PVCNN) branch across diffusion timesteps through a learnable fusion mask. Specifically, Transformer layers are incorporated into the early upsampling stages to capture global object structure under high uncertainty, while PVCNN modules are used in later stages to refine local geometric details. Inspired by the hierarchical nature of EEG-based visual representations, this design dynamically adapts its spatial granularity in accordance with the coarse-to-fine trajectory of diffusion denoising. We further introduce an adversarial refinement module to enhance geometric realism and semantic consistency. Extensive experiments on the EEG-3D dataset across all 12 subjects demonstrate that Mind2Cloud outperforms prior work in both geometric accuracy and semantic alignment, setting a new benchmark for EEG-to-point-cloud generation. Our source code is available at https://github.com/duasoi/Mind2Cloud.
Problem

Research questions and friction points this paper is trying to address.

EEG-to-Point-Cloud
Diffusion Decoding
Semantic Granularity
3D Reconstruction
Innovation

Methods, ideas, or system contributions that make the work stand out.

two-granularity diffusion decoding
time-aware decoder
learnable fusion mask
adversarial refinement module
💼 Related Jobs
No related jobs found.
Y
Yongyi Lu
Guangdong University of Technology, Guangzhou, China
X
Xiongfeng Huang
Guangdong University of Technology, Guangzhou, China
Z
Zhijing Yang
Guangdong University of Technology, Guangzhou, China