HyperDet: 3D Object Detection with Hyper 4D Radar Point Clouds

2026-02-12

AI Summary

This work addresses the significant performance gap between 4D radar and LiDAR in 3D object detection, primarily caused by the sparsity, irregularity, and multipath noise inherent in 4D radar point clouds. To bridge this gap, the authors propose a task-aware super-resolution 4D radar point cloud construction framework that enhances point density and structural completeness through multi-frame, multi-view fusion, geometric consistency verification, and a foreground-focused diffusion module. Notably, the approach operates without modifying existing LiDAR-based detector architectures. By integrating cross-sensor consistency checks and a hybrid radar–LiDAR supervised diffusion mechanism, the method achieves substantial improvements in detection performance on the MAN TruckScenes dataset, effectively narrowing the performance disparity between radar and LiDAR sensing modalities.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Computer Vision: Multi-modal Vision
• Machine Learning: Multimodal Learning

Application Category

• Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAG
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications

Abstract

4D mmWave radar provides weather-robust, velocity-aware measurements and is more cost-effective than LiDAR. However, radar-only 3D detection still trails LiDAR-based systems because radar point clouds are sparse, irregular, and often corrupted by multipath noise, yielding weak and unstable geometry. We present HyperDet, a detector-agnostic radar-only 3D detection framework that constructs a task-aware hyper 4D radar point cloud for standard LiDAR-oriented detectors. HyperDet aggregates returns from multiple surround-view 4D radars over consecutive frames to improve coverage and density, then applies geometry-aware cross-sensor consensus validation with a lightweight self-consistency check outside overlap regions to suppress inconsistent returns. It further integrates a foreground-focused diffusion module with training-time mixed radar-LiDAR supervision to densify object structures while lifting radar attributes (e.g., Doppler, RCS); the model is distilled into a consistency model for single-step inference. On MAN TruckScenes, HyperDet consistently improves over raw radar inputs with VoxelNeXt and CenterPoint, partially narrowing the radar-LiDAR gap. These results show that input-level refinement enables radar to better leverage LiDAR-oriented detectors without architectural modifications.

Problem

• 4D radar
• 3D object detection
• point cloud sparsity
• multipath noise
• radar-LiDAR gap

Innovation

• Hyper 4D radar
• radar-only 3D detection
• cross-sensor consensus
• diffusion-based densification
• detector-agnostic framework