Neural Electromagnetic Fields for High-Resolution Material Parameter Reconstruction

2026-03-02

AI Summary

Existing digital twin approaches struggle to non-invasively and accurately reconstruct the physical material properties of scenes—such as permittivity and conductivity—limiting their functional fidelity. To address this, this work proposes NEMF, a novel framework that decouples geometry and electromagnetic fields by integrating high-fidelity geometric priors from neural radiance fields with radio-frequency signals. This strategy transforms the ill-posed inverse problem of material parameter estimation into a well-posed, physics-supervised learning task. By incorporating a differentiable electromagnetic reflection model and a physics-constrained depth decoder, NEMF enables end-to-end, high-precision reconstruction of spatially continuous material parameter fields. Experiments demonstrate that NEMF significantly outperforms purely vision-based methods on synthetic datasets, yielding functional digital twins capable of high-fidelity physical simulation.

Technology Category

• Intelligent Robots: State Estimation
• Computer Vision: Low Level & Physics-based Vision
• Natural Language Processing: Language Grounding & Multi-modal NLP

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Web applications in cross-disciplinary domains and verticals such as mixed reality, smart cities, and digital health
• User Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendation
• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs

Abstract

Creating functional Digital Twins, simulatable 3D replicas of the real world, is a central challenge in computer vision. Current methods like NeRF produce visually rich but functionally incomplete twins. The key barrier is the lack of underlying material properties (e.g., permittivity, conductivity). Acquiring this information for every point in a scene via non-contact, non-invasive sensing is a primary goal, but it demands solving a notoriously ill-posed physical inversion problem. Standard remote signals, like images and radio frequencies (RF), deeply entangle the unknown geometry, ambient field, and target materials. We introduce NEMF, a novel framework for dense, non-invasive physical inversion designed to build functional digital twins. Our key insight is a systematic disentanglement strategy. NEMF leverages high-fidelity geometry from images as a powerful anchor, which first enables the resolution of the ambient field. By constraining both geometry and field using only non-invasive data, the original ill-posed problem transforms into a well-posed, physics-supervised learning task. This transformation unlocks our core inversion module: a decoder. Guided by ambient RF signals and a differentiable layer incorporating physical reflection models, it learns to explicitly output a continuous, spatially-varying field of the scene's underlying material parameters. We validate our framework on high-fidelity synthetic datasets. Experiments show our non-invasive inversion reconstructs these material maps with high accuracy, and the resulting functional twin enables high-fidelity physical simulation. This advance moves beyond passive visual replicas, enabling the creation of truly functional and simulatable models of the physical world.

Problem

• material parameter reconstruction
• digital twins
• non-invasive sensing
• physical inversion
• electromagnetic fields

Innovation

• Neural Electromagnetic Fields
• material parameter reconstruction
• functional digital twins
• physics-supervised learning
• non-invasive inversion