Beyond Weights: Deep learning in Spiking Neural Networks with pure synaptic-delay training

Edoardo Grappolini, Anand Subramoney

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Downloads (Pure)

Abstract

Biological evidence suggests that adaptation of synaptic delays on short to medium timescales plays an important role in learning in the brain. Inspired by biology, we explore the feasibility and power of using synaptic delays to solve challenging tasks even when the synaptic weights are not trained but kept at randomly chosen fixed values. We show that training ONLY the delays in feed-forward spiking networks using backpropagation can achieve performance comparable to the more conventional weight training. Moreover, further constraining the weights to ternary values does not significantly affect the networks' ability to solve the tasks using only the synaptic delays. We demonstrate the task performance of delay-only training on MNIST and Fashion-MNIST datasets in preliminary experiments. This demonstrates a new paradigm for training spiking neural networks and sets the stage for models that can be more efficient than the ones that use weights for computation.
Original languageEnglish
Title of host publicationProceedings of the International Conference on Neuromorphic Systems 2023
PublisherACM
Pages1-4
Number of pages4
ISBN (Electronic)9798400701757
DOIs
Publication statusPublished - 28 Aug 2023
EventInternational Conference on Neuromorphic Systems - Santa Fe, United States
Duration: 1 Aug 20233 Aug 2023
https://icons.ornl.gov/

Conference

ConferenceInternational Conference on Neuromorphic Systems
Country/TerritoryUnited States
CitySanta Fe
Period1/08/233/08/23
Internet address

Cite this