Patterns of synchrony in neural networks with spike adaptation

We study the emergence of synchronized burst activity in networks of neurons with spike adaptation. We show that networks of tonically firing adapting excitatory neurons can evolve to a state where the neurons burst in a synchronized manner. The mechanism leading to this burst activity is analyzed in a network of integrate-and-fire neurons with spike adaptation. The dependence of this state on the different network parameters is investigated, and it is shown that this mechanism is robust against inhomogeneities, sparseness of the connectivity, and noise. In networks of two populations, one excitatory and one inhibitory, we show that decreasing the inhibitory feedback can cause the network to switch from a tonically active, asynchronous state to the synchronized bursting state. Finally, we show that the same mechanism also causes synchronized burst activity in networks of more realistic conductance-based model neurons.     

Effects of synaptic synchrony on the neuronal input-output relationship

The firing rate of individual neurons depends on the firing frequency of their distributed synaptic inputs, with linear and nonlinear relations subserving different computational functions. This letter explores the relationship between the degree of synchrony among excitatory synapses and the linearity of the response using detailed compartmental models of cortical pyramidal cells. Synchronous input resulted in a linear input-output relationship, while asynchronous stimulation yielded sub- and supraproportional outputs at low and high frequencies, respectively. The dependence of input-output linearity on synchrony was sigmoidal and considerably robust with respect to dendritic location, stimulus irregularity, and alteration of active and synaptic properties. Moreover, synchrony affected firing rate differently at lower and higher input frequencies. A reduced integrate-and-fire model suggested a mechanism explaining these results based on spatiotemporal integration, with fundamental implications relating synchrony to memory encoding.     

Increased synchrony with increase of a low-threshold calcium conductance in a model thalamic network: a phase-shift mechanism

A computer model of a thalamic network was used in order to examine the effects of an isolated augmentation in a low-threshold calcium current. Such an isolated augmentation has been observed in the reticular thalamic (RE) nucleus of the genetic absence epilepsy rat from the Strasbourg (GAERS) model of absence epilepsy. An augmentation of the low-threshold calcium conductance in the RE neurons (gTs) of the model thalamic network was found to lead to an increase in the synchronized firing of the network. This supports the hypothesis that the isolated increase in gTs may be responsible for epileptic activity in the GAERS rat. The increase of gTs in the RE neurons led to a slight increase in the period of the isolated RE neuron firing. In contrast, the low-threshold spike of the RE neuron remained relatively unchanged by the increase of gTs. This suggests that the enhanced synchrony in the network was primarily due to a phase shift in the firing of the RE neurons with respect to the thalamocortical neurons. The ability of this phase-shift mechanism to lead to changes in synchrony was further examined using the model thalamic network. A similar increase in the period of RE neuron oscillations was obtained through an increase in the conductance of the calcium-mediated potassium channel. This change was once again found to increase synchronous firing in the network.     

Stimulus competition by inhibitory interference

When two stimuli are present in the receptive field of a V4 neuron, the firing rate response is between the weakest and strongest response elicited by each of the stimuli when presented alone (Reynolds, Chelazzi, & Desimone, 1999). When attention is directed toward the stimulus eliciting the strongest response (the preferred stimulus), the response to the pair is increased, whereas the response decreases when attention is directed to the other stimulus (the poor stimulus). When attention is directed to either of the two stimuli presented alone, the firing rate remains the same or increases slightly, but the coherence between the neuron's spike train and the local field potential can increase (Fries, Reynolds, Rorie, & Desimone, 2001). These experimental results were reproduced in a model of a V4 neuron under the assumption that attention modulates the activity of local interneuron networks. The V4 model neuron received stimulus-specific excitation from V2 and synchronous inhibitory inputs from two local interneuron networks in V4. Each interneuron network was driven by stimulus-specific excitatory inputs from V2 and was modulated by the activity of the frontal eye fields. Stimulus competition was present because of a delay in arrival time of synchronous volleys from each interneuron network. For small delays, the firing rate was close to the rate elicited by the preferred stimulus alone, whereas for larger delays, it approached the firing rate of the poor stimulus. When either stimulus was presented alone, the neuron's response was not altered by the change in delay, but could change due to modulation of the degree of synchrony of the corresponding interneuron network. The model suggests that top-down attention biases the competition between V2 columns for control of V4 neurons primarily by changing the relative timing of inhibition, whereas changes in the degree of synchrony of interneuron networks modulate the response to a single stimulus. The new mechanism proposed here for attentional modulation of firing rate, gain modulation by inhibitory interference, is likely to have more general applicability to cortical information processing.     

Stochastic synchrony of chaos in a pulse-coupled neural network with both chemical and electrical synapses among inhibitory neurons

The synchronous firing of neurons in a pulse-coupled neural network composed of excitatory and inhibitory neurons is analyzed. The neurons are connected by both chemical synapses and electrical synapses among the inhibitory neurons. When electrical synapses are introduced, periodically synchronized firing as well as chaotically synchronized firing is widely observed. Moreover, we find stochastic synchrony where the ensemble-averaged dynamics shows synchronization in the network but each neuron has a low firing rate and the firing of the neurons seems to be stochastic. Stochastic synchrony of chaos corresponding to a chaotic attractor is also found.     

Synchrony in silicon: the gamma rhythm.

In this paper, we present a network of silicon interneurons that synchronize in the gamma frequency range (20-80 Hz). The gamma rhythm strongly influences neuronal spike timing within many brain regions, potentially playing a crucial role in computation. Yet it has largely been ignored in neuromorphic systems, which use mixed analog and digital circuits to model neurobiology in silicon. Our neurons synchronize by using shunting inhibition (conductance based) with a synaptic rise time. Synaptic rise time promotes synchrony by delaying the effect of inhibition, providing an opportune period for interneurons to spike together. Shunting inhibition, through its voltage dependence, inhibits interneurons that spike out of phase more strongly (delaying the spike further), pushing them into phase (in the next cycle). We characterize the interneuron, which consists of soma (cell body) and synapse circuits, fabricated in a 0.25-microm complementary metal-oxide-semiconductor (CMOS). Further, we show that synchronized interneurons (population of 256) spike with a period that is proportional to the synaptic rise time. We use these interneurons to entrain model excitatory principal neurons and to implement a form of object binding.     

The effects of pair-wise and higher order correlations on the firing rate of a post-synaptic neuron

Coincident firing of neurons projecting to a common target cell is likely to raise the probability of firing of this postsynaptic cell. Therefore, synchronized firing constitutes a significant event for postsynaptic neurons and is likely to play a role in neuronal information processing. Physiological data on synchronized firing in cortical networks are based primarily on paired recordings and cross-correlation analysis. However, pair-wise correlations among all inputs onto a postsynaptic neuron do not uniquely determine the distribution of simultaneous postsynaptic events. We develop a framework in order to calculate the amount of synchronous firing that, based on maximum entropy, should exist in a homogeneous neural network in which the neurons have known pair-wise correlations and higher-order structure is absent. According to the distribution of maximal entropy, synchronous events in which a large proportion of the neurons participates should exist even in the case of weak pair-wise correlations. Network simulations also exhibit these highly synchronous events in the case of weak pair-wise correlations. If such a group of neurons provides input to a common postsynaptic target, these network bursts may enhance the impact of this input, especially in the case of a high postsynaptic threshold. The proportion of neurons participating in synchronous bursts can be approximated by our method under restricted conditions. When these conditions are not fulfilled, the spike trains have less than maximal entropy, which is indicative of the presence of higher-order structure. In this situation, the degree of synchronicity cannot be derived from the pair-wise correlations.     

Dynamic gain changes during attentional modulation

Attention causes a multiplicative effect on firing rates of cortical neurons without affecting their selectivity (Motter, 1993; McAdams & Maunsell, 1999a) or the relationship between the spike count mean and variance (McAdams & Maunsell, 1999b). We analyzed attentional modulation of the firing rates of 144 neurons in the secondary somatosensory cortex (SII) of two monkeys trained to switch their attention between a tactile pattern recognition task and a visual task. We found that neurons in SII cortex also undergo a predominantly multiplicative modulation in firing rates without affecting the ratio of variance to mean firing rate (i.e., the Fano factor). Furthermore, both additive and multiplicative components of attentional modulation varied dynamically during the stimulus presentation. We then used a standard conductance-based integrate-and-fire model neuron to ascertain which mechanisms might account for a multiplicative increase in firing rate without affecting the Fano factor. Six mechanisms were identified as biophysically plausible ways that attention could modify the firing rate: spike threshold, firing rate adaptation, excitatory input synchrony, synchrony between all inputs, membrane leak resistance, and reset potential. Of these, only a change in spike threshold or in firing rate adaptation affected model firing rates in a manner compatible with the observed neural data. The results indicate that only a limited number of biophysical mechanisms can account for observed attentional modulation.     

Synchrony in heterogeneous networks of spiking neurons

The emergence of synchrony in the activity of large, heterogeneous networks of spiking neurons is investigated. We define the robustness of synchrony by the critical disorder at which the asynchronous state becomes linearly unstable. We show that at low firing rates, synchrony is more robust in excitatory networks than in inhibitory networks, but excitatory networks cannot display any synchrony when the average firing rate becomes too high. We introduce a new regime where all inputs, external and internal, are strong and have opposite effects that cancel each other when averaged. In this regime, the robustness of synchrony is strongly enhanced, and robust synchrony can be achieved at a high firing rate in inhibitory networks. On the other hand, in excitatory networks, synchrony remains limited in frequency due to the intrinsic instability of strong recurrent excitation.     

Synchrony-induced switching behavior of spike pattern attractors created by spike-timing-dependent plasticity

Although context-dependent spike synchronization among populations of neurons has been experimentally observed, its functional role remains controversial. In this modeling study, we demonstrate that in a network of spiking neurons organized according to spike-timing-dependent plasticity, an increase in the degree of synchrony of a uniform input can cause transitions between memorized activity patterns in the order presented during learning. Furthermore, context-dependent transitions from a single pattern to multiple patterns can be induced under appropriate learning conditions. These findings suggest one possible functional role of neuronal synchrony in controlling the flow of information by altering the dynamics of the network.     

Correlation between uncoupled conductance-based integrate-and-fire neurons due to common and synchronous presynaptic firing

We investigate the firing characteristics of conductance-based integrate-and-fire neurons and the correlation of firing for uncoupled pairs of neurons as a result of common input and synchronous firing of multiple synaptic inputs. Analytical approximations are derived for the moments of the steady state potential and the effective time constant. We show that postsynaptic firing barely depends on the correlation between inhibitory inputs; only the inhibitory firing rate matters. In contrast, both the degree of synchrony and the firing rate of excitatory inputs are relevant. A coefficient of variation CV > 1 can be attained with low inhibitory firing rates and (Poisson-modulated) synchronized excitatory synaptic input, where both the number of presynaptic neurons in synchronous firing assemblies and the synchronous firing rate should be sufficiently large. The correlation in firing of a pair of uncoupled neurons due to common excitatory input is initially increased for increasing firing rates of independent inhibitory inputs but decreases for large inhibitory firing rates. Common inhibitory input to a pair of uncoupled neurons barely induces correlated firing, but amplifies the effect of common excitation. Synchronous firing assemblies in the common input further enhance the correlation and are essential to attain experimentally observed correlation values. Since uncorrelated common input (i.e., common input by neurons, which do not fire in synchrony) cannot induce sufficient postsynaptic correlation, we conclude that lateral couplings are essential to establish clusters of synchronously firing neurons.     

Correlated firing improves stimulus discrimination in a retinal model

Synchronous firing limits the amount of information that can be extracted by averaging the firing rates of similarly tuned neurons. Here, we show that the loss of such rate-coded information due to synchronous oscillations between retinal ganglion cells can be overcome by exploiting the information encoded by the correlations themselves. Two very different models, one based on axon-mediated inhibitory feedback and the other on oscillatory common input, were used to generate artificial spike trains whose synchronous oscillations were similar to those measured experimentally. Pooled spike trains were summed into a threshold detector whose output was classified using Bayesian discrimination. For a threshold detector with short summation times, realistic oscillatory input yielded superior discrimination of stimulus intensity compared to rate-matched Poisson controls. Even for summation times too long to resolve synchronous inputs, gamma band oscillations still contributed to improved discrimination by reducing the total spike count variability, or Fano factor. In separate experiments in which neurons were synchronized in a stimulus-dependent manner without attendant oscillations, the Fano factor increased markedly with stimulus intensity, implying that stimulus-dependent oscillations can offset the increased variability due to synchrony alone.     

Mean-driven and fluctuation-driven persistent activity in recurrent networks

Spike trains from cortical neurons show a high degree of irregularity, with coefficients of variation (CV) of their interspike interval (ISI) distribution close to or higher than one. It has been suggested that this irregularity might be a reflection of a particular dynamical state of the local cortical circuit in which excitation and inhibition balance each other. In this "balanced" state, the mean current to the neurons is below threshold, and firing is driven by current fluctuations, resulting in irregular Poisson-like spike trains. Recent data show that the degree of irregularity in neuronal spike trains recorded during the delay period of working memory experiments is the same for both low-activity states of a few Hz and for elevated, persistent activity states of a few tens of Hz. Since the difference between these persistent activity states cannot be due to external factors coming from sensory inputs, this suggests that the underlying network dynamics might support coexisting balanced states at different firing rates. We use mean field techniques to study the possible existence of multiple balanced steady states in recurrent networks of current-based leaky integrate-and-fire (LIF) neurons. To assess the degree of balance of a steady state, we extend existing mean-field theories so that not only the firing rate, but also the coefficient of variation of the interspike interval distribution of the neurons, are determined self-consistently. Depending on the connectivity parameters of the network, we find bistable solutions of different types. If the local recurrent connectivity is mainly excitatory, the two stable steady states differ mainly in the mean current to the neurons. In this case, the mean drive in the elevated persistent activity state is suprathreshold and typically characterized by low spiking irregularity. If the local recurrent excitatory and inhibitory drives are both large and nearly balanced, or even dominated by inhibition, two stable states coexist, both with subthreshold current drive. In this case, the spiking variability in both the resting state and the mnemonic persistent state is large, but the balance condition implies parameter fine-tuning. Since the degree of required fine-tuning increases with network size and, on the other hand, the size of the fluctuations in the afferent current to the cells increases for small networks, overall we find that fluctuation-driven persistent activity in the very simplified type of models we analyze is not a robust phenomenon. Possible implications of considering more realistic models are discussed.     

The relationship between synchronization among neuronal populations and their mean activity levels.

In the past decade the importance of synchronized dynamics in the brain has emerged from both empirical and theoretical perspectives. Fast dynamic synchronous interactions of an oscillatory or nonoscillatory nature may constitute a form of temporal coding that underlies feature binding and perceptual synthesis. The relationship between synchronization among neuronal populations and the population firing rates addresses two important issues: the distinction between rate coding and synchronization coding models of neuronal interactions and the degree to which empirical measurements of population activity, such as those employed by neuroimaging, are sensitive to changes in synchronization. We examined the relationship between mean population activity and synchronization using biologically plausible simulations. In this article, we focus on continuous stationary dynamics. (In a companion article, Chawla (forthcoming), we address the same issue using stimulus-evoked transients.) By manipulation parameters such as extrinsic input, intrinsic noise, synaptic efficacy, density of extrinsic connections, the voltage-sensitive nature of postsynaptic mechanisms, the number of neurons, and the laminar structure within the populations, we were able to introduce variations in both mean activity and synchronization under a variety of simulated neuronal architectures. Analyses of the simulated spike trains and local field potentials showed that in nearly every domain of the model's parameter space, mean activity and synchronization were tightly coupled. This coupling appears to be mediated by an increase in synchronous gain when effective membrane time constants are lowered by increased activity. These observations show that under the assumptions implicit in our models, rate coding and synchrony coding in neural systems with reciprocal interconnections are two perspectives on the same underlying dynamic. This suggests that in the absence of specific mechanisms decoupling changes in synchronization from firing levels, indexes of brain activity that are based purely on synaptic activity (e.g., functional magnetic resonance imaging) may also be sensitive to changes in synchronous coupling.     

Unitary events in multiple single-neuron spiking activity: I. Detection and significance.

It has been proposed that cortical neurons organize dynamically into functional groups (cell assemblies) by the temporal structure of their joint spiking activity. Here, we describe a novel method to detect conspicuous patterns of coincident joint spike activity among simultaneously recorded single neurons. The statistical significance of these unitary events of coincident joint spike activity is evaluated by the joint-surprise. The method is tested and calibrated on the basis of simulated, stationary spike trains of independently firing neurons, into which coincident joint spike events were inserted under controlled conditions. The sensitivity and specificity of the method are investigated for their dependence on physiological parameters (firing rate, coincidence precision, coincidence pattern complexity) and temporal resolution of the analysis. In the companion article in this issue, we describe an extension of the method, designed to deal with nonstationary firing rates.     

How noise affects the synchronization properties of recurrent networks of inhibitory neurons

GABAergic interneurons play a major role in the emergence of various types of synchronous oscillatory patterns of activity in the central nervous system. Motivated by these experimental facts, modeling studies have investigated mechanisms for the emergence of coherent activity in networks of inhibitory neurons. However, most of these studies have focused either when the noise in the network is absent or weak or in the opposite situation when it is strong. Hence, a full picture of how noise affects the dynamics of such systems is still lacking. The aim of this letter is to provide a more comprehensive understanding of the mechanisms by which the asynchronous states in large, fully connected networks of inhibitory neurons are destabilized as a function of the noise level. Three types of single neuron models are considered: the leaky integrate-and-fire (LIF) model, the exponential integrate-and-fire (EIF), model and conductance-based models involving sodium and potassium Hodgkin-Huxley (HH) currents. We show that in all models, the instabilities of the asynchronous state can be classified in two classes. The first one consists of clustering instabilities, which exist in a restricted range of noise. These instabilities lead to synchronous patterns in which the population of neurons is broken into clusters of synchronously firing neurons. The irregularity of the firing patterns of the neurons is weak. The second class of instabilities, termed oscillatory firing rate instabilities, exists at any value of noise. They lead to cluster state at low noise. As the noise is increased, the instability occurs at larger coupling, and the pattern of firing that emerges becomes more irregular. In the regime of high noise and strong coupling, these instabilities lead to stochastic oscillations in which neurons fire in an approximately Poisson way with a common instantaneous probability of firing that oscillates in time.     

The combined effects of inhibitory and electrical synapses in synchrony

Recent experimental results have shown that GABAergic interneurons in the central nervous system are frequently connected via electrical synapses. Hence, depending on the area or the subpopulation, interneurons interact via inhibitory synapses or electrical synapses alone or via both types of interactions. The theoretical work presented here addresses the significance of these different modes of interactions for the interneuron networks dynamics. We consider the simplest system in which this issue can be investigated in models or in experiments: a pair of neurons, interacting via electrical synapses, inhibitory synapses, or both, and activated by the injection of a noisy external current. Assuming that the couplings and the noise are weak, we derive an analytical expression relating the cross-correlation (CC) of the activity of the two neurons to the phase response function of the neurons. When electrical and inhibitory interactions are not too strong, they combine their effect in a linear manner. In this regime, the effect of electrical and inhibitory interactions when combined can be deduced knowing the effects of each of the interactions separately. As a consequence, depending on intrinsic neuronal properties, electrical and inhibitory synapses may cooperate, both promoting synchrony, or may compete, with one promoting synchrony while the other impedes it. In contrast, for sufficiently strong couplings, the two types of synapses combine in a nonlinear fashion. Remarkably, we find that in this regime, combining electrical synapses with inhibition amplifies synchrony, whereas electrical synapses alone would desynchronize the activity of the neurons. We apply our theory to predict how the shape of the CC of two neurons changes as a function of ionic channel conductances, focusing on the effect of persistent sodium conductance, of the firing rate of the neurons and the nature and the strength of their interactions. These predictions may be tested using dynamic clamp techniques.     

Burst synchrony patterns in hippocampal pyramidal cell model networks

Types of. mechanisms for and stability of synchrony are discussed in the context of two-compartment CA3 pyramidal cell and interneuron model networks. We show how the strength and timing of inhibitory and excitatory synaptic inputs work together to produce either perfectly synchronized or nearly synchronized oscillations, across different burst or spiking modes of firing. The analysis shows how excitatory inputs tend to desynchronize cells, and how common, slowly decaying inhibition can be used to synchronize them. We also introduce the concept of 'equivalent networks' in which networks with different architectures and synaptic connections display identical firing patterns.