Physically-Guided Optical Inversion Enable Non-Contact Side-Channel Attack on Isolated Screens

📅 2026-04-14
📈 Citations: 0
Influential: 0
📄 PDF

career value

200K/year
🤖 AI Summary
This work addresses the challenge of non-intrusive screen content eavesdropping, where reconstruction is typically degraded by the ill-posed instability of projection mapping and irreversible compression in light transport. To overcome these limitations, the authors propose an optical projection side-channel attack paradigm that leverages passive speckle patterns generated via diffuse reflection. The approach integrates a physics-guided neural network (IR4Net) based on the radiative transfer equation, a physically regularized irradiance approximation (PRIrr), and a cross-scale contour-to-detail reconstruction mechanism. Furthermore, an Irreversible Constraint Semantic Reprojection (ICSR) module is introduced to recover global structural coherence. This framework effectively suppresses noise propagation, enhances reconstruction stability, and significantly outperforms existing neural methods across four diverse scenarios, achieving high-fidelity screen content recovery with strong robustness against illumination perturbations.

Technology Category

Application Category

📝 Abstract
Noncontact exfiltration of electronic screen content poses a security challenge, with side-channel incursions as the principal vector. We introduce an optical projection side-channel paradigm that confronts two core instabilities: (i) the near-singular Jacobian spectrum of projection mapping breaches Hadamard stability, rendering inversion hypersensitive to perturbations; (ii) irreversible compression in light transport obliterates global semantic cues, magnifying reconstruction ambiguity. Exploiting passive speckle patterns formed by diffuse reflection, our Irradiance Robust Radiometric Inversion Network (IR4Net) fuses a Physically Regularized Irradiance Approximation (PRIrr-Approximation), which embeds the radiative transfer equation in a learnable optimizer, with a contour-to-detail cross-scale reconstruction mechanism that arrests noise propagation. Moreover, an Irreversibility Constrained Semantic Reprojection (ICSR) module reinstates lost global structure through context-driven semantic mapping. Evaluated across four scene categories, IR4Net achieves fidelity beyond competing neural approaches while retaining resilience to illumination perturbations.
Problem

Research questions and friction points this paper is trying to address.

side-channel attack
optical inversion
screen content exfiltration
irreversible compression
Hadamard stability
Innovation

Methods, ideas, or system contributions that make the work stand out.

Physically-Guided Inversion
Side-Channel Attack
Radiative Transfer Equation
Semantic Reprojection
Speckle-Based Imaging
🔎 Similar Papers
2024-08-13International Conferences on Information Science and SystemCitations: 0
Z
Zhiwen Zheng
Hangzhou Dianzi University, Hangzhou 310018, China
Y
Yuheng Qiao
Hangzhou Dianzi University, Hangzhou 310018, China
Xiaoshuai Zhang
Xiaoshuai Zhang
Research Scientist, Hillbot
3D VisionScene UnderstandingRepresentation LearningEmbodied AIComputer Vision
Z
Zhao Huang
School of Natural and Computing Sciences, University of Aberdeen, Aberdeen AB24 3UE, Great Britain
Tao Zhang
Tao Zhang
Associate Professor, Beijing Jiaotong University, Beijing, China
Network SecurityMoving Target DefenseBlockchainFederated Learning
Huiyu Zhou
Huiyu Zhou
Professor of Machine Learning, University of Leicester, UK
Machine learningcomputer visionmedical image analysishuman-computer interface
S
Shaowei Jiang
Hangzhou Dianzi University, Hangzhou 310018, China
J
Jin Liu
Hangzhou Dianzi University, Hangzhou 310018, China
W
Wenwen Tang
Johns Hopkins University, Baltimore, MD 21218, USA
Xingru Huang
Xingru Huang
University of Liverpool
Machine learningMedical imaging