Deep learning for 3D point cloud processing - from approaches, tasks to its implications on urban and environmental applications

2025-09-15

AI Summary

Current deep learning methods for 3D point clouds face significant deployment challenges in urban and environmental applications: existing research overemphasizes architectural innovation while neglecting practical constraints—including ultra-large scale, non-uniform density, multimodality, and scene diversity. This paper pioneers a reverse survey paradigm (“application scenario → algorithmic requirement”) to systematically evaluate the adaptability and limitations of representative architectures—PointNet, PointCNN, and graph neural networks—across key tasks: point cloud completion, registration, semantic segmentation, and reconstruction. We benchmark their performance on mainstream datasets, identifying insufficient generalization as a root cause. Furthermore, we explicitly characterize the gap between algorithmic innovation and engineering deployment. Finally, we propose a co-design pathway that jointly optimizes model lightweighting, cross-density robustness, and multimodal fusion—thereby providing both theoretical foundations and practical guidelines for deployable point cloud intelligence.

Technology Category

• Machine Learning: Deep Neural Architectures and Foundation Models
• Computer Vision: 3D Computer Vision
• Search and Optimization: Sampling/Simulation-based Search

Application Category

• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs
• Systems and Infrastructure for Web, Mobile and WoT: Experiences and lessons learnt from Web-based algorithms and system deployments
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

Point cloud processing as a fundamental task in the field of geomatics and computer vision, has been supporting tasks and applications at different scales from air to ground, including mapping, environmental monitoring, urban/tree structure modeling, automated driving, robotics, disaster responses etc. Due to the rapid development of deep learning, point cloud processing algorithms have nowadays been almost explicitly dominated by learning-based approaches, most of which are yet transitioned into real-world practices. Existing surveys primarily focus on the ever-updating network architecture to accommodate unordered point clouds, largely ignoring their practical values in typical point cloud processing applications, in which extra-large volume of data, diverse scene contents, varying point density, data modality need to be considered. In this paper, we provide a meta review on deep learning approaches and datasets that cover a selection of critical tasks of point cloud processing in use such as scene completion, registration, semantic segmentation, and modeling. By reviewing a broad range of urban and environmental applications these tasks can support, we identify gaps to be closed as these methods transformed into applications and draw concluding remarks in both the algorithmic and practical aspects of the surveyed methods.

Problem

• Addressing gaps in deep learning for real-world point cloud processing applications
• Reviewing practical values of learning-based approaches in urban and environmental contexts
• Identifying challenges in transitioning point cloud algorithms to practice

Innovation

• Deep learning for 3D point cloud processing
• Meta review on approaches and datasets
• Focus on urban and environmental applications