Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Rishav Mukherji; Mark Schöne; Khaleelulla Khan Nazeer; Christian Mayr; David Kappel; Anand Subramoney

doi:10.1109/ICONS62911.2024.00027

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Rishav Mukherji
, Mark Schöne
, Khaleelulla Khan Nazeer
, Christian Mayr
, David Kappel
, Anand Subramoney

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

21 Downloads (Pure)

Original language	English
Title of host publication	2024 International Conference on Neuromorphic Systems (ICONS)
Publisher	IEEE
Number of pages	8
ISBN (Electronic)	979-8-3503-6865-9
ISBN (Print)	979-8-3503-6866-6
DOIs	https://doi.org/10.1109/ICONS62911.2024.00027
Publication status	Published - 2 Dec 2024
Event	International Conference on Neuromorphic Systems - Arlington, United States Duration: 30 Jul 2024 → 2 Aug 2024 https://iconsneuromorphic.cc/

Conference

Conference	International Conference on Neuromorphic Systems
Abbreviated title	ICONS
Country/Territory	United States
City	Arlington
Period	30/07/24 → 2/08/24
Internet address	https://iconsneuromorphic.cc/

Access to Document

10.1109/ICONS62911.2024.00027

Accepted manuscriptAccepted author manuscript, 809 KB

Cite this

@inproceedings{2c7d54c8434f4a0fa36bad0bdf186f2b,

title = "Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models",

author = "Rishav Mukherji and Mark Sch{\"o}ne and Nazeer, \{Khaleelulla Khan\} and Christian Mayr and David Kappel and Anand Subramoney",

year = "2024",

month = dec,

day = "2",

doi = "10.1109/ICONS62911.2024.00027",

language = "English",

isbn = "979-8-3503-6866-6",

booktitle = "2024 International Conference on Neuromorphic Systems (ICONS)",

publisher = "IEEE",

note = "International Conference on Neuromorphic Systems<br/>, ICONS ; Conference date: 30-07-2024 Through 02-08-2024",

url = "https://iconsneuromorphic.cc/",

}

Mukherji, R, Schöne, M, Nazeer, KK, Mayr, C, Kappel, D & Subramoney, A 2024, Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models. in 2024 International Conference on Neuromorphic Systems (ICONS). IEEE, International Conference on Neuromorphic Systems
, Arlington, Virginia, United States, 30/07/24. https://doi.org/10.1109/ICONS62911.2024.00027

TY - GEN

T1 - Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

AU - Mukherji, Rishav

AU - Schöne, Mark

AU - Nazeer, Khaleelulla Khan

AU - Mayr, Christian

AU - Kappel, David

AU - Subramoney, Anand

PY - 2024/12/2

Y1 - 2024/12/2

UR - https://arxiv.org/abs/2405.00433

U2 - 10.1109/ICONS62911.2024.00027

DO - 10.1109/ICONS62911.2024.00027

M3 - Conference contribution

SN - 979-8-3503-6866-6

BT - 2024 International Conference on Neuromorphic Systems (ICONS)

PB - IEEE

T2 - International Conference on Neuromorphic Systems<br/>

Y2 - 30 July 2024 through 2 August 2024

ER -

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Conference

Access to Document

Other files and links

Cite this