SimD3: A Synthetic drone Dataset with Payload and Bird Distractor Modeling for Robust Detection

2026-01-21

AI Summary

This work addresses the challenges of drone detection, including scarce real-world annotated data, high visual variability of drones, and interference from birds and other visual distractors. To this end, the authors propose SimD3, a high-fidelity synthetic dataset built using Unreal Engine 5 that encompasses diverse environments, weather conditions, lighting scenarios, and flight trajectories. SimD3 is the first to explicitly model heterogeneous payload-carrying drones alongside multiple bird species as visual interferents, leveraging a 360-degree six-camera system to generate high-quality training data in complex scenes. The authors train YOLOv5 and an attention-enhanced variant, YOLOv5m+C3b (which replaces the standard C3 module with a C3b block). Experiments demonstrate that models trained on SimD3 significantly improve small-object drone detection, with YOLOv5m+C3b consistently outperforming baseline models across synthetic, mixed, and multiple unseen real-world datasets.

Technology Category

• Computer Vision: Diffusion Models for Vision
• Search and Optimization: Sampling/Simulation-based Search
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Web Mining and Content Analysis: Web data generation and simulation
• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets

Abstract

Reliable drone detection is challenging due to limited annotated real-world data, large appearance variability, and the presence of visually similar distractors such as birds. To address these challenges, this paper introduces SimD3, a large-scale high-fidelity synthetic dataset designed for robust drone detection in complex aerial environments. Unlike existing synthetic drone datasets, SimD3 explicitly models drones with heterogeneous payloads, incorporates multiple bird species as realistic distractors, and leverages diverse Unreal Engine 5 environments with controlled weather, lighting, and flight trajectories captured using a 360 six-camera rig. Using SimD3, we conduct an extensive experimental evaluation within the YOLOv5 detection framework, including an attention-enhanced variant termed Yolov5m+C3b, where standard bottleneck-based C3 blocks are replaced with C3b modules. Models are evaluated on synthetic data, combined synthetic and real data, and multiple unseen real-world benchmarks to assess robustness and generalization. Experimental results show that SimD3 provides effective supervision for small-object drone detection and that Yolov5m+C3b consistently outperforms the baseline across in-domain and cross-dataset evaluations. These findings highlight the utility of SimD3 for training and benchmarking robust drone detection models under diverse and challenging conditions.

Problem

• drone detection
• visual distractors
• appearance variability
• annotated data scarcity
• bird interference

Innovation

• synthetic dataset
• drone detection
• visual distractors
• payload modeling
• attention-enhanced YOLO