Institution profile

Zhejiang University-University of Illinois

Academic institutionnorthamerica · us
Official website
Research library3linked papers
Opportunities0open roles
Selected work

Representative Papers

Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training

Oct 04, 2025

To address the limitations of backpropagation through time (BPTT) and surrogate gradient methods for spiking neural network (SNN) training—including suboptimal accuracy, high temporal computational overhead, and excessive memory consumption—this paper proposes an enhanced self-distillation framework. Methodologically, it introduces: (1) a lightweight artificial neural network (ANN) branch that takes intermediate-layer spike rates of the SNN as input, enabling cross-modal knowledge transfer; (2) the first decomposition of teacher signals into reliable and unreliable components, where only the reliable component guides SNN optimization to improve convergence stability; and (3) the integration of rate-based backpropagation with self-distillation, eliminating temporal unrolling and gradient truncation. Evaluated on CIFAR-10/100, CIFAR10-DVS, and ImageNet, the method significantly reduces training complexity while surpassing state-of-the-art SNN training approaches in accuracy, validating the efficacy of this efficient co-optimization paradigm.

0 citationsRead paper
Recent publications

Latest Papers

Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training

Oct 04, 2025

To address the limitations of backpropagation through time (BPTT) and surrogate gradient methods for spiking neural network (SNN) training—including suboptimal accuracy, high temporal computational overhead, and excessive memory consumption—this paper proposes an enhanced self-distillation framework. Methodologically, it introduces: (1) a lightweight artificial neural network (ANN) branch that takes intermediate-layer spike rates of the SNN as input, enabling cross-modal knowledge transfer; (2) the first decomposition of teacher signals into reliable and unreliable components, where only the reliable component guides SNN optimization to improve convergence stability; and (3) the integration of rate-based backpropagation with self-distillation, eliminating temporal unrolling and gradient truncation. Evaluated on CIFAR-10/100, CIFAR10-DVS, and ImageNet, the method significantly reduces training complexity while surpassing state-of-the-art SNN training approaches in accuracy, validating the efficacy of this efficient co-optimization paradigm.

0 citationsRead paper