Document Type
Article
Publication Date
9-2022
Embargo Period
12-1-2022
Publication Title
Neural Computation
Abstract
Hebbian theory proposes that ensembles of neurons form a basis for neural processing. It is possible to gain insight into the activity patterns of these neural ensembles through a binary analysis, regarding neurons as either active or inactive. The framework of permitted and forbidden sets, introduced by Hahnloser, Seung, and Slotine (2003), is a mathematical model of such a binary analysis: groups of coactive neurons can be permitted or forbidden depending on the network's structure.
In order to widen the applicability of the framework of permitted sets, we extend the permitted set analysis from the original threshold-linear regime. Specifically, we generalize permitted sets to firing rate models in which [symbol] is a nonnegative continuous piecewise C1 activation function. In our framework, the focus is shifted from a neuron's firing rate to its responsiveness to inputs; if a neuron's firing rate is sufficiently sensitive to changes in its input, we say that the neuron is responsive. The algorithm for categorizing a neuron as responsive depends on thresholds that a user can select arbitrarily and that are independent of the dynamics.
Given a synaptic weight matrix W, we say that a set of neurons is permitted if it is possible to find a stimulus where those neurons, and no others, remain responsive. The main coding property we establish about P[symbol](W), the collection of all permitted sets of the network, is that P[symbol](W) is a convex code when W is almost rank one. This means that P[symbol](W) in the low-rank regime can be realized as a neural code resulting from the pattern of overlaps of receptive fields that are convex.
Volume
34
Issue
9
First Page
1978
Last Page
2008
DOI
https://doi.org/10.1162/neco_a_01523
ISSN
1530-888X
Rights
© 2022 Massachusetts Institute of Technology
Recommended Citation
Steven Collazos, Duane Nykamp; Permitted Sets and Convex Coding in Nonthreshold Linear Networks. Neural Comput 2022; 34 (9): 1978–2008. doi: https://doi.org/10.1162/neco_a_01523
Primo Type
Article
Comments
This is the final, published version of the work:
Steven Collazos, Duane Nykamp; Permitted Sets and Convex Coding in Nonthreshold Linear Networks. Neural Comput 2022; 34 (9): 1978–2008. doi: https://doi.org/10.1162/neco_a_01523
and is made available after a 3-month embargo period with permission from Neural Computation