Source-linked AI summary

Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size

Tilo Schwalger, Moritz Deger, Wulfram Gerstner

arXiv:1611.00294v3q-bio.NC

TL;DR

The link between large-scale population models and underlying spiking neurons remains unclear, despite the need to describe finite-size fluctuations. This paper derives stochastic mesoscopic equations from microscopic neuron models and reports that they reproduce microscopic simulation statistics with a high speed-up factor.

Abstract

from arXiv · show

Neural population equations such as neural mass or field models are widely used to study brain activity on a large scale. However, the relation of these models to the properties of single neurons is unclear. Here we derive an equation for several interacting populations at the mesoscopic scale starting from a microscopic model of randomly connected generalized integrate-and-fire neuron models. Each population consists of 50 -- 2000 neurons of the same type but different populations account for different neuron types. The stochastic population equations that we find reveal how spike-history effects in single-neuron dynamics such as refractoriness and adaptation interact with finite-size fluctuations on the population level. Efficient integration of the stochastic mesoscopic equations reproduces the statistical behavior of the population activities obtained from microscopic simulations of a full spiking neural network model. The theory describes nonlinear emergent dynamics like finite-size-induced stochastic transitions in multistable networks and synchronization in balanced networks of excitatory and inhibitory neurons. The mesoscopic equations are employed to rapidly simulate a model of a local cortical microcircuit consisting of eight neuron types. Our theory establishes a general framework for modeling finite-size neural population dynamics based on single cell and synapse parameters and offers an efficient approach to analyzing cortical circuits and computations.

Author Summary

The author summary presents stochastic mesoscopic population equations as a link between spiking neurons and coarse population models, accounting for finite-neuron fluctuations and reproducing microscopic simulations efficiently.

  • The summary identifies an unresolved gap between phenomenological spiking-neuron models and coarse equations summarizing the activity of many thousands of neurons.Such population models are widely used to model EEG, MEG, and fMRI data; linking the scales is described as vital for rapid activity changes, fluctuations, and multiscale brain models.Source: Author Summary · p. 1
  • Stochastic population equations for 100–1000 neurons link microscopic spiking models to population activity and reproduce microscopic simulations with a high speed-up factor.The equations account for fluctuations arising from the finite number of neurons and can be efficiently integrated.Source: Author Summary · p. 2
  • The authors expect the mesoscopic population theory to help explain experimental data on brain information processing and link microscopic and macroscopic activity patterns.Source: Author Summary · p. 2

Introduction

The paper develops stochastic mesoscopic equations for interacting cortical populations by systematically connecting generalized integrate-and-fire neurons to finite-size population activity. The framework is designed to capture spike-history effects and finite-size fluctuations while enabling efficient, consistent simulation across scales.

Introduction

  • Neural mass models can match stationary activity to single-neuron gain but fail to reproduce rapid-input dynamics and use absent or ad hoc activity noise.The introduction argues that their missing systematic link to spiking models makes them phenomenological descriptions despite their success.Source: Introduction · p. 2
  • The paper derives stochastic equations for interacting populations of 50–2000 generalized integrate-and-fire neurons, linking single-neuron parameters to finite-size population activity.The authors describe this derivation as the paper’s main topic and expect the equations to reproduce characteristic fluctuations of the microscopic model.Source: Introduction · pp. 2–3
  • The framework aims to predict how neuronal-parameter or input changes in one population affect activity across populations, with potential applications to stimulation experiments and brain-signal models.The paper illustrates nontrivial stochastic switching between activity states, potentially linked to perceptual bistability or resting-state activity.Source: Introduction · p. 3
  • The approach also targets efficient, consistent multiscale simulation, replacing some microscopic populations with mesoscopic activity while preserving target-population membrane-potential patterns.The authors provide an eight-population cortical-column example and measure its simulation speed-up, but do not present a systematic performance comparison.Source: Introduction · p. 3
  • Finite populations and spike-history effects make activity fluctuations non-Poissonian, producing temporally correlated synaptic input that white-noise and Poisson assumptions neglect.The stated obstacles include populations of 50–2000 neurons, refractoriness, adaptation, and other spike-history dependencies.Source: Introduction · pp. 3–4
  • The theory treats strong refractoriness and finite population size non-perturbatively, without requiring weak self-coupling or expansion around the infinite-population solution.The authors state that it applies to relatively small populations, non-Gaussian fluctuations, and dynamics far from stationary states.Source: Introduction · p. 4

Results

The Results develop mesoscopic equations for interacting neural populations from spiking-neuron dynamics, incorporating single-neuron history effects and finite-size fluctuations. Comparisons with microscopic simulations assess their ability to capture population-activity statistics across network and cortical-column examples, including finite-size switching and mean-field behavior.

Results

  • Populations group similar neurons with random connectivity, using experimentally specified neuron, population-size, and synapse parameters.The target mesoscopic scale comprises populations of roughly 50–2,000 neurons.Source: Results · p. 4, Mesoscopic population equations · p. 6
  • The mesoscopic simulation reproduces the microscopic network’s population-activity temporal statistics under step stimulation.The microscopic activities are stochastic because of finite population size.Source: Results · p. 5, Figure 1 · p. 5

Mesoscopic population equations.

  • Because populations of roughly 50–2,000 neurons retain finite-size fluctuations, the goal is closed population equations that match microscopic activity statistics.Microscopic stochasticity is not averaged out in the finite sum defining population activity.Source: Mesoscopic population equations · p. 6
  • The quasi-renewal mean-field reduction tracks refractory density by last-spike time, retaining refractoriness while approximating random connectivity and spike-history-dependent thresholds.The effective threshold depends on the last spike time and past population activity.Source: Mesoscopic population equations · p. 7
  • Finite-size activity arises from stochastic survivor fractions; normalized holes and overshoots alter expected firing, so a positive fluctuation is followed by a short-lag negative one.The effect depends on refractoriness and the firing rates of neurons with different last-spike times.Source: Mesoscopic population equations · pp. 9–11
  • The theory seeks to reduce many microscopic survival processes to mesoscopic stochastic activity driven by rates determined from past population activity.Simulating survivor fractions for every small time bin would be as complex as simulating the original neurons.Source: Mesoscopic population equations · p. 10
  • The population equation combines the infinite-population integral with a finite-size correction that vanishes as N → ∞, recovering the macroscopic equation.The correction accounts for fluctuations in neuron counts across states of relative refractoriness; recent positive activity fluctuations reduce the free-neuron fraction and generate negative short-lag activity correlations.Source: Mesoscopic population equations · pp. 11–12, Two different consequences of finite N · p. 14
  • The coupled mesoscopic equations are the paper’s main result: population activity history determines their dynamics, and one stochastic input summarizes microscopic noise.Synaptic interactions enter through conditional intensity via membrane potential and synaptic current, and the formulation extends to multiple populations.Source: Mesoscopic population equations · p. 12

Comparison of microscopic and mesoscopic simulations

  • The mesoscopic equations capture refractory LIF population fluctuation spectra, including the pronounced low-frequency dip at high firing rates.The mesoscopic spectrum matches the theoretically predicted spectrum, including where it strongly departs from the flat spectrum of a Poisson process.Source: Comparison of microscopic and… · p. 15, Figure 3 · p. 15
  • Mesoscopic equations capture adaptation-related fluctuation statistics, including reduced low-frequency power, while the quasi-renewal approximation can cause small discrepancies.The approximation uses population-averaged rather than individual pre-last-spike history and is expected to work well when the threshold kernel changes slowly.Source: Comparison of microscopic and… · p. 15, Figure 4 · p. 16
  • With a fast biphasic threshold kernel, the mesoscopic equations qualitatively capture burstiness but systematically overestimate power across frequencies.The burst signature is strong power around 1 Hz, while adaptation reduces power at still lower frequencies.Source: Comparison of microscopic and… · p. 17
  • Mesoscopic population activities agree well with microscopic simulations in fully connected networks and in many randomly connected networks, but can diverge when both population size and connection probability are small or synaptic weights are strong.For fully connected excitatory–inhibitory networks, power spectra agree even for five neurons; for random networks, agreement holds at C = 200 and p = 0.05, while strong incoherent noise can produce deviations.Source: Comparison of microscopic and… · pp. 17, 19
  • Finite-size fluctuations in recurrent networks induce stochastic oscillations whose amplitude decreases with network size and vanishes in the large-N limit.In randomly connected networks, shared fluctuations yield correlated, partially synchronized activity that declines toward an asynchronous state as network size increases.Source: Comparison of microscopic and… · p. 17
  • The mesoscopic equations quantitatively reproduce finite-size-induced transitions between metastable states in spiking networks.Unlike phenomenological rate models with ad hoc noise, the noisy dynamics is systematically derived from the spiking network without free parameters.Source: Comparison of microscopic and… · p. 19
  • Although individual membrane potentials differed from mean-field estimates, population-averaged firing rates and excitatory-activity power spectra were well predicted.Source: Figure 6 · p. 20, Comparison of microscopic and… · p. 20
  • Finite-size fluctuations drove repeated switches between bistable excitatory states; without adaptation, exponential, uncorrelated residence times indicated Poissonian switching reproduced by the mesoscopic model.The activity power spectrum showed low-frequency power from switching and a high-frequency peak from rapid oscillations in the high-activity state.Source: Comparison of microscopic and… · pp. 20–22, Figure 7 · p. 21
  • Weak, slow adaptation regularized switching into slow stochastic oscillations with narrow dominance-time distributions, while deterministic large-N dynamics remained bistable.Adaptation first relaxes activity toward a lower stationary level; this deterministic stage reduces residence-time variability before noise-driven escape.Source: Comparison of microscopic and… · pp. 21–22, Figure 7 · p. 21
  • In the eight-population cortical-column model, mesoscopic simulations matched microscopic trial-averaged activities, variability, and spontaneous power spectra despite low connection probabilities.The stimulus-offset oscillatory peak was slightly underestimated, but mismatches occurred when across-trial variability was very high.Source: Comparison of microscopic and… · pp. 23–24, Figure 8 · p. 23, Figure 9 · p. 24
  • 6.6 s versus 811.2 s for 10 s of biological time yielded an approximately 120-fold speed-up for mesoscopic versus microscopic simulation.Both models used a 0.5 ms time step for this initial comparison; the authors expected a larger speed-up at matched accuracy.Source: Comparison of microscopic and… · p. 24

Discussion

The paper derives stochastic mesoscopic equations from spiking-neuron models with spike-history effects, capturing finite-size fluctuations and reproducing microscopic population statistics. It argues the framework can support cortical-circuit modeling and extensions across scales, while identifying assumptions and limitations.

Discussion

  • The theory derives mesoscopic dynamics from finite populations of spiking neurons with pronounced spike-history effects, and reproduces microscopic statistics across varied population sizes, coupling strengths, stimulation, connectivity, and neuron types.Activity depends on population history; independent random draws generate mesoscopic realizations whose power spectra and residence-time distributions closely match the microscopic model.Source: Discussion · pp. 24–25

Quantitative modeling of mesoscopic neural data: applications and experimental predictions

  • Mesoscopic populations can model genetically defined cortical cell classes and predict circuit responses to optogenetic stimulation, given estimates of neuron, connectivity, and synapse parameters.The framework permits subdivision of heterogeneous populations, but may fail when a few outlier neurons dominate; its mean-field and quasi-renewal approximations also assume weak synaptic heterogeneity and slow threshold dynamics, though examples show useful predictions for sparse connectivity and fast threshold dynamics.Source: Quantitative modeling of mesoscopic… · pp. 25–26
  • The equations correctly predict both mean activity and fluctuations in a detailed cortical microcircuit simulation under thalamic stimulation, and can help constrain unknown microscopic parameters.They also capture finite-size-induced stochastic oscillations, beyond the mean-activity predictions of a prior population-density study.Source: Quantitative modeling of mesoscopic… · p. 26
  • The framework could constrain connectivity in large-scale models and represent finite-size fluctuations in whole-brain, mesoscopic, and cultured-network activity.It also motivates multiscale models combining mesoscopic populations with microscopically simulated regions, and extensions to synaptic short-term plasticity in cultures.Source: Quantitative modeling of mesoscopic… · pp. 26–27

Theoretical aspects

  • Unlike earlier deterministic moment and cross-correlation equations [66–68], this theory generates single stochastic realizations for finite neuron populations without a perturbation expansion around N → ∞, capturing large, non-Gaussian fluctuations.It also accounts for interplay between fluctuations and refractoriness by correcting the missing normalization of the mesoscopic density.Source: Theoretical aspects · pp. 27–28
  • The age-based quasi-renewal approximation represents adaptation through population activity while keeping the density effectively one-dimensional, avoiding the computational burden of multidimensional state-space models.The effective fully connected formulation can yield reasonable results for randomly connected networks with p = 5%, but fixed in-degree excludes quenched connectivity variability, which remains to be studied.Source: Theoretical aspects · pp. 28–29

Extensions of the model

  • Extensions include current-noise hazards, conductance inputs, and a continuum stochastic neural field derived from finite-size spiking networks.Nonlinear voltage-dependent synaptic currents remain less straightforward, and the effectiveness of proposed approximations for finite-N theory is an open question.Source: Extensions of the model · pp. 29–30
  • Around 120× faster than microscopic simulation, the mesoscopic model could gain further speed with optimized integration; it moderately outperforms refractory-density simulation for N ≳ 100.A systematic comparison at matched accuracy is left for future work.Source: Extensions of the model · pp. 30–31

Methods

The methods derive mesoscopic population dynamics from randomly connected generalized integrate-and-fire neurons by tracking history-dependent spike counts and last-spike-time distributions. They use population-density dynamics, moments, and neuron conservation to construct activity equations driven by history-dependent noise.

Model

  • Populations contain randomly connected, same-type neurons modeled with generalized integrate-and-fire dynamics, spike-triggered adaptation and refractoriness, and stochastic escape-rate firing.Connections between populations are random with fixed in-degree; spikes reset the membrane potential and impose a 4 ms absolute refractory period.Source: Model · pp. 31–32

Mean-field approximation

  • The mean-field approximation represents refractory state by time since the last spike and reduces each neuron's firing rate to dependence on that time and population activity.It approximates synaptic input and uses a quasi-renewal approximation for prior spikes; for sufficiently large populations, incoherent noise averages out while common finite-size fluctuations persist.Source: Mean-field approximation · pp. 33–35

Discretized population density equations.

  • A discretized refractory density tracks neuron counts by last-spike interval, together with past population activities, as a Markov state that determines subsequent firing statistics.Time steps must be no longer than the absolute refractory period, and axonal plus synaptic delays must be at least one time step; neuron identities are not retained.Source: Discretized population density equations · p. 36
  • In discrete time, each past spike interval contributes an independent binomial spike count, but the number of random draws grows with the number of surviving intervals and approaches microscopic simulation complexity as the time step shrinks.Absolute refractoriness permits at most one spike per neuron per time step.Source: Discretized population density equations · pp. 37–38
  • In continuous time, the microscopic density of last-spike times follows a Langevin equation with Gaussian white noise, and population activity is obtained from changes across refractory states.These equations apply under Gaussian and quasi-renewal approximations.Source: Discretized population density equations · p. 38
  • A mesoscopic activity process cannot independently sample microscopic survival counts and total spike counts without risking neuron-conservation violations; unconstrained moments plus normalization yield expected activity from past activities.With sufficiently small time steps and stochastic, nonsynchronized neurons, the total count can be approximated by a single Poisson draw.Source: Discretized population density equations · pp. 38–39
  • The unconstrained process gives mesoscopic mean and variance equations conditioned on activity history, and its mean and variance approximate those in the neuron-conserving process.The mean evolution is fully determined by past activities.Source: Discretized population density equations · pp. 39–40
  • The survival-count variance is zero immediately after firing and at long times, so it reaches a maximum at an intermediate time and last-spike age.Its rugged dependence on last-spike time reflects discontinuities in the mean survival count from stochastic initial activity.Source: Discretized population density equations · p. 40

Mesoscopic population equations.

This section develops mesoscopic population equations for predicting spike counts from past activity and generating stochastic spikes, including continuous-time, multi-population, and age-density formulations. It also presents practical simulation schemes and safeguards, analyzes stationary activity fluctuations through their power spectrum, and describes modifications for modeling a cortical column.

Mesoscopic population equations.

  • Equation (59) computes the present mean spike count from past counts, then generates the count as a Poisson random number for sufficiently small time steps.The discrete-time equation is the mesoscopic population equation.Source: Mesoscopic population equations · p. 42

Mesoscopic population density equations in continuous time

  • Population activity is a history-dependent point process with conditional intensity NĀ(t); finite-size fluctuations scale as 1/√N and include correlated white and colored components.Refractoriness can produce negative short-lag autocorrelation and a low-frequency power-spectrum trough.Source: Mesoscopic population density… · pp. 42, 44

Several populations

  • The equations generalize to multiple populations by adding a population label, with each population’s expected activity depending on the history of population activities.The formulation includes history-parameterized differential equations and integrals for each population.Source: Several populations · p. 44

Refractory density representation

  • An age-density q(t, τ) reformulates the population equations as first-order partial differential equations for refractory density and associated state variables.The density is defined from survival probability and past activity and is not normalized because of finite-size fluctuations.Source: Refractory density representation · p. 45

Population equations for a finite history.

  • A finite-history scheme separates refractory neurons within a window T from free neurons whose last-spike effects are handled compactly, reducing past integrals to finite-range integrals and differential equations.The window length depends mainly on refractoriness and the spike-triggered adaptation kernel.Source: Population equations for a finite… · pp. 45–47

Numerical implementation

  • The time step must be small enough that each neuron fires at most once per step; the implementation also requires the absolute refractory period to be at least Δt.The finite history is represented by K bins with T = KΔt.Source: Numerical implementation · p. 48
  • Spike counts are bounded by population size N; binomial sampling preserves this bound when large time steps or synchrony make Poisson counts unsuitable.The Poisson approximation assumes the expected count per step is much smaller than N; for strongly synchronized neurons, similar firing probabilities make binomial sampling appropriate even when expected counts approach N.Source: Numerical implementation · pp. 48–49

Power spectrum

  • Stationary population-activity fluctuation power scales as 1/N and vanishes in the macroscopic limit N → ∞.The fluctuations are characterized by the power spectrum, with the population activity Fourier-transformed over a window of length T.Source: Power spectrum · p. 53

Modified Potjans-Diesmann model

  • For the Potjans-Diesmann cortical column, the model replaces background Poisson input with constant drive and adjusts escape noise and resting potentials to match target firing rates.Adaptation was added to excitatory cells, and resting potentials were readjusted to preserve stationary firing rates in its presence.Source: Modified Potjans-Diesmann model · p. 56, Table 2 · p. 56
Loading 1611.00294v3…