Non Line-of-Sight Optical Wireless Communication using Neuromorphic Cameras

2025-03-14

AI Summary

This study addresses the challenge of non-line-of-sight (NLoS) passive visible light communication (VLC), where conventional VLC systems fail due to their reliance on direct line-of-sight paths. We propose a novel NLoS-OVC scheme leveraging neuromorphic cameras—exploiting their asynchronous event-driven operation and ultra-high temporal resolution—to passively capture subtle dynamic modulations embedded in diffuse reflections from everyday objects, enabling data decoding without a direct optical link. To enhance robustness and spectral efficiency, we introduce an adaptive *N*-pulse modulation scheme that dynamically optimizes both the number and temporal distribution of optical pulses per bit according to the input bit sequence. Experimental validation confirms the feasibility of NLoS VLC, identifying light-colored, highly reflective surfaces as optimal relay planes. Compared to fixed-pulse modulation, our approach achieves an average 37.2% reduction in bit error rate and a 2.1× improvement in data rate across diverse NLoS scenarios.

Technology Category

• Computer Vision: Multi-modal Vision
• Search and Optimization: Learning to Search
• Cognitive Modeling & Cognitive Systems: Neural Spike Coding

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Energy management for devices in mobile Web and WoT environments
• User Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendation
• Security and Privacy: Data transparency and provenance

Abstract

Neuromorphic or event cameras, inspired by biological vision systems, capture changes in illumination with high temporal resolution and efficiency, producing streams of events rather than traditional images. In this paper, we explore the use of neuromorphic cameras for passive optical wireless communication (OWC), leveraging their asynchronous detection of illumination changes to decode data transmitted through reflections of light from objects. We propose a novel system that utilizes neuromorphic cameras for passive visible light communication (VLC), extending the concept to Non Line-of-Sight (NLoS) scenarios through passive reflections from everyday objects. Our experiments demonstrate the feasibility and advantages of using neuromorphic cameras for VLC, characterizing the performance of various modulation schemes, including traditional On-Off Keying (OOK) and advanced N-pulse modulation. We introduce an adaptive N-pulse modulation scheme that dynamically adjusts encoding based on the packet's bit composition, achieving higher data rates and robustness in different scenarios. Our results show that lighter-colored, glossy objects are better for NLoS communication, while larger objects and those with matte finishes experience higher error rates due to multipath reflections.

Problem

• Explores neuromorphic cameras for passive optical wireless communication.
• Proposes system for visible light communication in non-line-of-sight scenarios.
• Introduces adaptive modulation for higher data rates and robustness.

Innovation

• Neuromorphic cameras for passive optical communication
• Adaptive N-pulse modulation for higher data rates
• NLoS communication using reflections from everyday objects