RT Journal Article
T1 Blessing of dimensionality in spiking neural networks: the by-chance functional learning
A1 Makarov Slizneva, Valeriy
A1 Lobov, Sergey
AB Spiking neural networks (SNNs) have significant potential for a power-efficient neuromorphic AI. However, their training is challenging since most of the learning principles known from artificial neural networks are hardly applicable. Recently, the concept of “blessing of dimensionality” has successfully been used to treat high-dimensional data and representations of reality. It exploits the fundamental trade-off between the complexity and simplicity of statistical sets in high-dimensional spaces without relying on global optimization techniques. We show that the frequency encoding of memories in SNNs can leverage this paradigm. It enables detecting and learning arbitrary information items, given that they operate in high dimensions. To illustrate the hypothesis, we develop a minimalist model of information processing in layered brain structures and study the emergence of extreme selectivity to multiple stimuli and associative memories. Our results suggest that global optimization of cost functions may be circumvented at different levels of information processing in SNNs, and replaced by chance learning, greatly simplifying the design of AI devices.
PB Frontiers Media
YR 2025
FD 2025
LK https://hdl.handle.net/20.500.14352/130210
UL https://hdl.handle.net/20.500.14352/130210
LA eng
NO Ministerio de Ciencia e Innovación
NO Russian Science Foundation
DS Docta Complutense
RD 19 ene 2026