article · 2024
SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network
Cited by 0Abstract and details only
Abstract
The long-term memory (LTM) is generally considered as the unlimited and permanent storage of information in the human brain. This concept has spurred numerous researches focusing on associative memory models, such as Sparse Distributed Memory (SDM) in the past, as well as the increasing interest in brain-inspired Spiking Neural Networks (SNN). In this paper, we present an SDM-like SNN, which combines elements of both SDM and SNN for unsupervised training and inference processing. Despite the hardware-friendly nature of event-driven processing, SNN still faces criticism due to its large memory footprint and repetitive neuron operations. Therefore, the objective of this study is to demonstrate the complementary nature of SDM and SNN, with the aim of significantly reducing energy consumption while maintaining an acceptable level of accuracy loss on neuromorphic computing systems. As an integral part of the SDM-like design, we have developed and thoroughly tested an M-of-N code generation method. The experimental results on the MNIST dataset demonstrated that the proposed constant-weight Fibonacci code SDM-SNN achieves 87.4% accuracy with a simplified 2-bit unsupervised learning rule. In addition, with only 400 neurons, the proposed SDM-SNN hardware architecture reduces numerous energy consumption to 4.5-nJ/classification and 7.5 pJ/SOP with just a little performance degradation <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$(\sim 3.7\%)$</tex> compared to the SOTA full-connected SNN network.
Cite this paper
Zhou, Y., & Li, Y. (2024). SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network. https://doi.org/10.1109/vlsitsa60681.2024.10546346
Zhou, Yuxuan, and Youfu Li. “SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network.” 2024, pp. 1–4, https://doi.org/10.1109/vlsitsa60681.2024.10546346.
Zhou, Yuxuan, and Youfu Li. 2024. “SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network.” https://doi.org/10.1109/vlsitsa60681.2024.10546346.
Zhou, Y. and Li, Y. (2024) ‘SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network’. Available at: https://doi.org/10.1109/vlsitsa60681.2024.10546346.
@article{zhou2024sparse,
title = {{SDM-SNN: Sparse Distributed Memory Using Constant-Weight Fibonacci Code for Spiking Neural Network}},
author = {Zhou, Yuxuan and Li, Youfu},
pages = {1--4},
year = {2024},
doi = {10.1109/vlsitsa60681.2024.10546346}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.
Related papers
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks
Wei Fang, Zhaofei Yu, Yanqi Chen et al. · IEEE/CVF International Conference on Computer Vision (ICCV) · 2021
Cited by 737Open access
In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor
Amar Shrestha, Haowen Fang, Daniel Patrick Rider et al. · ACM/IEEE Design Automation Conference (DAC) · 2021
Cited by 35Open access
Spike trains encoding and threshold rescaling method for deep spiking neural networks
Xu Yang, Huajin Tang, Jinwei Xing et al. · IEEE Symposium Series on Computational Intelligence (SSCI) · 2017
Cited by 32