Institution profile

Ji Hua Laboratory

Academic institutionasia · cn
Official website
Research library3linked papers
Opportunities0open roles
Selected work

Representative Papers

Unraveling the Black-box Magic: An Analysis of Neural Networks' Dynamic Local Extrema

Jul 04, 2025

This paper addresses the “black-box” nature and poorly understood generalization mechanisms of neural networks by proposing the Local Extrema Dynamic Mapping Hypothesis: generalization arises from a model’s ability to adaptively map training data onto local extrema of the loss landscape. Theoretical analysis reveals that the number of local extrema scales positively with the number of trainable parameters. Leveraging this insight, we design the Extrema Incremental Algorithm (EIA), which replaces conventional backpropagation with local-extremum tracking—eliminating explicit gradient computation while mitigating vanishing gradients and overfitting. We provide theoretical guarantees for EIA’s convergence and empirically validate its efficacy across multiple benchmark tasks. Results demonstrate that EIA achieves comparable or superior convergence rates and generalization performance relative to standard optimization methods. This work offers a novel perspective on the intrinsic mechanisms of neural networks and establishes a foundation for developing gradient-free, extremum-driven optimization paradigms.

0 citationsRead paper
Recent publications

Latest Papers

Unraveling the Black-box Magic: An Analysis of Neural Networks' Dynamic Local Extrema

Jul 04, 2025

This paper addresses the “black-box” nature and poorly understood generalization mechanisms of neural networks by proposing the Local Extrema Dynamic Mapping Hypothesis: generalization arises from a model’s ability to adaptively map training data onto local extrema of the loss landscape. Theoretical analysis reveals that the number of local extrema scales positively with the number of trainable parameters. Leveraging this insight, we design the Extrema Incremental Algorithm (EIA), which replaces conventional backpropagation with local-extremum tracking—eliminating explicit gradient computation while mitigating vanishing gradients and overfitting. We provide theoretical guarantees for EIA’s convergence and empirically validate its efficacy across multiple benchmark tasks. Results demonstrate that EIA achieves comparable or superior convergence rates and generalization performance relative to standard optimization methods. This work offers a novel perspective on the intrinsic mechanisms of neural networks and establishes a foundation for developing gradient-free, extremum-driven optimization paradigms.

0 citationsRead paper