Abstract
Background
In the cerebral cortex, disinhibited activity is characterized by propagating waves that spread across neural tissue. In this pathological state, a widely reported form of activity are spiral waves that travel in a circular pattern around a fixed spatial locus termed the center of mass. Spiral waves exhibit stereotypical activity and involve broad patterns of co-fluctuations, suggesting that they may be of lower complexity than healthy activity.
Results
To evaluate this hypothesis, we performed dense multi-electrode recordings of cortical networks where disinhibition was induced by perfusing a pro-epileptiform solution containing 4-Aminopyridine as well as increased potassium and decreased magnesium. Spiral waves were identified based on a spatially delimited center of mass and a broad distribution of instantaneous phases across electrodes. Individual waves were decomposed into “snapshots” that captured instantaneous neural activation across the entire network. The complexity of these snapshots was examined using a measure termed the participation ratio. Contrary to our expectations, an eigenspectrum analysis of these snapshots revealed a broad distribution of eigenvalues and an increase in complexity compared to baseline networks. A deep generative adversarial network was trained to generate novel exemplars of snapshots that closely captured cortical spiral waves. These synthetic waves replicated key features of experimental data including a tight center of mass, a broad eigenvalue distribution, spatially-dependent correlations, and a high complexity. By adjusting the input to the model, new samples were generated that deviated in systematic ways from the experimental data, thus allowing the exploration of a broad range of states from healthy to pathologically disinhibited neural networks.
Conclusions
Together, results show that the complexity of population activity serves as a marker along a continuum from healthy to disinhibited brain states. The proposed generative adversarial network opens avenues for replicating the dynamics of cortical seizures and accelerating the design of optimal neurostimulation aimed at suppressing pathological brain activity.
Similar content being viewed by others
Background
In disinhibited cortical circuits, neural activity is characterized by patterns that propagate across widespread networks [1]. These patterns take on different forms, including planar waves traveling in a single direction, saddle waves emerging from the interaction between multiple sites of propagation, and spiral waves that evolve in a circular motion around a fixed spatial locus [2,3,4,5,6,7,8]. These spiral waves are found during interictal epileptic activity [9,10,11,12] and are reported in cortical networks both in vitro [1] and in vivo [13]. Their origin and characteristics, however, remain to be fully elucidated, as they constitute rare events relative to background activity and cannot be captured by simple computational models including classic balanced excitation/inhibition networks [14].
A promising avenue to describe patterns of activity is to examine their complexity, indicative of the number of distinct factors needed to capture neural fluctuations. In many instances, the activity of large networks can be closely approximated using only a small number of factors that capture much of the variance across neurons [2]. This low complexity suggests that a few broad features, such as oscillations or shared patterns of fluctuation, may explain most population-level activity, thus greatly simplifying descriptions of neural dynamics and providing a strong guidance to theories of brain function [15,16,17].
While alterations in neural complexity are expected in disinhibited brain networks [18, 13]. These events, however, were primarily limited to a single cycle, whereas manual inspection of spirals in our data revealed that approximately one third of events had more than a single cycle (one cycle: 63.79%; two cycles: 31.03%; three or more cycles: 3.45% of all spiral waves). The presence of two or more cycles prolonged the duration of spiral event compared with previous accounts and is consistent with in vivo cortical waves [3].
Center of mass
Next, the center of mass of each spiral wave was computed by averaging together the central row and column of individual snapshots (“Methods”, Eqs. 1–2). The center of mass was highly consistent across repeated waves of the same slice (Fig. 2A). Variability across waves was primarily delimited to the inter-electrode spacing (20 μm) (Fig. 2A, inset). An example of average voltage activity during a single wave is shown in Fig. 2B. Activity across the network arose in “domains” where groups of neurons were activated over delimited regions of space. Furthermore, voltage activation near the center of mass was lower than surrounding regions [29].
Spatiotemporal attributes of spiral waves. A Mean center of mass of individual spiral waves across recordings. Inset shows a zoom of center of mass for spiral waves of a single slice (darker color) and individual time frames (“snapshots”) of each wave (lighter color). B Solid black lines are voltage traces at individual electrodes on the array. The center of mass is colored according to slice #2 in panel A. C Rotational direction and duration of spiral waves across three in vitro cortical slices
Direction of rotation
Each spiral wave was assigned a clockwise or counter-clockwise direction of rotation by visual inspection. Overall, 161 waves rotated clockwise and 58 waves counter-clockwise. Because spiral waves may arise by planar waves colliding into each other [1], it is possible that the direction of rotation depends upon the exact arrival times of these simpler waves, which is subject to variability over time. Therefore, we speculated that the angle of rotation may change over the course of a given recording. Consistent with this idea, the direction of rotation alternated across individual waves in two of the slices (Fig. 2C, slices #2 and #3). In these recordings, waves repeated the same rotation several times before switching direction [13]. By comparison, another slice yielded rotational directions that remained mostly consistent over the entire recording (Fig. 2C, slice #1). Thus, cortical networks could exhibit spiral waves with both alternating directions of rotation and waves with more stable patterns characterized by a preferred direction.
Instantaneous phase
Another key feature of spiral waves is the broad distribution of instantaneous phases across individual electrodes [1]. Instantaneous phases were computed by applying a Hilbert transform to delta band-filtered snapshots of activity at a resolution of 1 ms. An example of instantaneous phase obtained at a given time point (Fig. 3A) revealed the presence of a phase gradient radiating from the center of mass of the spiral wave (Fig. 3B). Across all waves, the distribution of instantaneous phases exhibited a broad range of values (Fig. 3C). Thus, snapshots of activity displayed a wide distribution of phases in line with a well-documented signature of spiral waves.
Instantaneous phase of spiral waves. A Spatial distribution of instantaneous phases during a rotating wave. Black arrow: direction of vector field used in panel B. B Instantaneous phase along the vector field in A. C Global distribution of phases across all spiral waves. D Quiver plot showing vector fields of an individual spiral wave calculated between consecutive phase maps separated by 10 ms. Solid black circle: center of mass
Going further, phase maps were employed to generate vector fields using Matlab’s quiver function. These vector fields indicate the speed and direction of propagating activity across cortical tissue and were employed to validate the presence of spiral waves in segments of neural data [7]. Vector fields are shown by arrows that span a range of orientations representing the flow of spiral waves around a fixed center of mass (Fig. 3D).
Distance-dependent correlations
Next, network interactions during spiral waves were examined by computing the Pearson correlation between voltages at all pairs of electrodes. Individual correlation matrices were obtained for each spiral of a given network, then averaged to create a mean correlation matrix (Fig. 4A). A widely reported feature of correlations in cortex is their spatial dependence, whereby neighboring cells are on average more strongly correlated than distant pairs [30]. This spatial ordering is also observed in synaptic connectivity where the probability of a monosynaptic contact falls off exponentially with physical distance between neurons [31,32,33]. Therefore, we reasoned that correlations should decrease with physical distance between pairs of electrodes. Consistent with this prediction, we found a lower mean correlation with increased distance on the array (Pearson correlation test, R2 = 0.8789, p = 2.5193e−07) (Fig. 4B). This analysis was repeated by focusing on the correlation between the center of mass and surrounding points on the array (Fig. 4C). As expected, correlations decreased with increased physical distance from the center of mass (R2 = 0.3, p = 4.5221e−241) (Fig. 4D). Thus, spiral waves displayed distance-dependent interactions consistent with prior findings on functional and structural cortical connectivity.
Spatial distribution of correlations during spiral waves. A Pairwise correlations were computed for each spiral wave then averaged to create a matrix of mean correlations. B The pairwise correlation between electrodes decreased as a function of their spatial distance. Vertical bars: standard error of the mean. Dashed line: best-fitting line of regression. C Correlation between the center of mass of a spiral and surrounding electrodes. Filled black circle: center of mass. D Correlations relative to the distance from center of mass
Wave complexity
The complexity of spiral waves was estimated by first applying an eigenspectrum decomposition to population activity, then computing the PR based on the resulting eigenvalues (see “Methods”). Eigenvalues followed a skewed distribution with a broad right tail [25, 34, 35] (Fig. 5A). To evaluate whether complexity was altered in disinhibited cortex, the mean PR of slices was compared before and after application of the PE solution. An equivalent number of snapshots was selected across both conditions (Fig. 5B). The PR across all snapshots yielded a markedly higher value for disinhibited networks compared to baseline (Student’s t-test, T436 = 2.979, p = 0.0032) (Fig. 5C). The average PR value for the baseline was 22.2 (SD: 2.1) compared to 34.31 (SD: 4.24) for spirals. Therefore, spiral waves yielded a higher complexity than baseline, strengthening the view that these waves formed a state of high complexity in cortex [14, 20, 21].
Eigenvalues and complexity of spiral waves. A Distribution of ranked eigenvalues for spiral waves in disinhibited slices treated with a PE solution compared to baseline recordings. B Examples of snapshots from baseline data vs. spiral wave. C Participation ratio of baseline recordings and spiral waves. D LBMLE across 10 individual spiral waves and baseline activity of three cortical slices (filled circle, cross, and triangle markers). Dashed line shows unity. E, F Complexity (PR and normalized PR) versus number of randomly selected multi-electrode channels. Grey lines: individual spirals; solid black line: average over 10 spirals
Because the PR is prone to overestimating complexity in neural data [26], the above results were compared to an alternative measure termed the Levina–Bickel maximum likelihood estimation (LBMLE) [36]. This non-linear measure estimates complexity using a geometric approach to calculate the distance between data points. Ten spiral waves and comparable data segments from baseline recordings were selected at random from three cortical slices. For all except one spiral wave, LBMLE complexity was higher with spiral waves than baseline (Fig. 5D). The discrepancy between linear and non-linear measures of complexity is comparable with related work [26]. Hence, both linear (PR) and non-linear (LBMLE) approaches showed that spiral waves yield increased complexity compared to baseline cortical circuits.
Next, we examined how the number of channels \(\left( N \right)\) impacted the PR. Random subsets of channels were selected from 10 spiral waves and the PR of those channels was computed. Results show an increase in the PR as the number of selected channels increased (Fig. 5E). This increase could be compensated by scaling the PR by \(\sqrt N ,\) resulting in a stable estimate of the PR when at least a few hundred channels were included (Fig. 5F). This effect does not alter our conclusions regarding the increased complexity of spiral waves (Fig. 5C) given that the same number of channels was employed relative to baseline. However, it may be relevant in cases where \(N\) varies across conditions.
Finally, the complexity of baseline activity was compared to planar waves characterized by vector fields that were mainly aligned along a single direction (Fig. 6A). A set of 12 planar waves were manually identified from PE activity. These waves exhibited significantly lower PR than baseline (Student’s t-test, T87 = 14.4365, p = 8.1302e−25) (Fig. 6B). Thus, disinhibited activity was comprised of a mixture of high complexity spiral waves as well as lower complexity planar waves. Other forms of activity, including saddle waves, were likely present but not explicitly detected here.
Capturing spiral waves in a deep GAN
A deep GAN [27] was trained to produce snapshots that closely matched spiral waves obtained in disinhibited cortical networks (see “Methods”). This model is comprised of a generative network that produces synthetic samples and a discriminator network whose goal is to distinguish between real and synthetic data (Fig. 7A). The GAN was trained for 10,000 epochs, at which point the performance of both the generator and discriminator networks saturated (Fig. 7B).
Generative adversarial network trained to capture snapshots of spatial activity. A Architecture of the GAN model including both a generator and discriminator network. “conv.”: convolution operator. B Performance of the discriminator and generator networks. C Snapshots generated by the network after training. D Distribution of eigenvalues across 1000 snapshots generated by the network. E Center of mass across all snapshots. F Pairwise correlations decreased with spatial distance across the GAN snapshots
Once training was completed, noisy input (mean of zero and SD of 25) was injected to the generator network to produce synthetic exemplars of spiral waves (Fig. 7C). A total of 1000 novel snapshots of dimensions 64 × 64 pixels matching the size of the HD-MEA were generated in this fashion. Synthetic snapshots were analyzed similarly to experimental data using their eigenspectrum, center of mass, spatial correlations, and PR.
First, applying an eigenspectrum decomposition to the GAN snapshots yielded a broad distribution of eigenvalues (Fig. 7D) reminiscent of experimental data (Fig. 5A). Second, the center of mass of snapshots was concentrated in a delimited area of space (Fig. 7E) as in experiments (Fig. 2A). Third, spatial correlations were computed across snapshots of individual waves, then averaged together to yield a 4096 × 4096 pixels correlation matrix. As with experimental data, synthetic images had higher correlations for nearby spatial regions (Fig. 7F). This is expected given that the model generated spatially delimited “regions” where activity was highly correlated (Fig. 7C).
Next, a series of analyses examined the PR of snapshots generated by the GAN model. To study a broad range of synthetic images, we varied the SD of the noise injected as input to the generator network. By increasing the noise SD, waves of activity began to break apart into smaller spatial clusters (Fig. 8A) and yielded a more diffuse center of mass (Fig. 8B). Increasing noise SD resulted in higher values of PR, which began to saturate around an SD of 500 (Fig. 8C). PR values obtained from baseline and PE experimental data were included in Fig. 8C as points of comparison, showing that manipulating noise SD yielded a continuum of PRs covering the range of experimental data as well as more extreme cases. Manipulating the mean of the injected noise also yielded a broad range of PR values capturing the scope of experimental data (Fig. 8D).
The input provided to generative networks controlled the statistics of snapshots. A Examples of snapshots where the SD of the input noise was increased from 50 to 500. B Center of mass of 1000 snapshots. C The participation ratio increased along with the SD of the input noise. Dashed lines show the participation ratio of baseline and disinhibited cortical activity. 100 images were generated for each value of noise SD. D Effect of input strength on the participation ratio of snapshots. Input strength is in arbitrary units (a.u.). E, F Additive Gaussian noise to a cortical spiral wave altered the PR. G, H The Frechet Inception Distance (FID) and Inception Score are impacted by the input strength to the GAN. The log of the Inception Score is shown for ease of visualization
To compare the results of GAN with experimental data, the effect of noise on PR values was directly assessed by adding Gaussian noise with different means and SD to snapshots of a given cortical spiral wave and computing the resulting PR value. This analysis yielded PR distributions that were qualitatively comparable to those obtained by adding noise to GAN networks. Specifically, noise SD increased the PR until an asymptotic value was reached (Fig. 8E). Further, altering the mean of the Gaussian noise yielded a distribution of PR values that was maximal at zero (Fig. 8F). Hence, GANs provided the ability to not only generate novel samples that were faithful to the statistics of the training data, but also samples that deviated in systematic ways from those statistics. This key feature of GANs could be exploited to study the impact of noise on various measures of neural complexity [26] as well as design brain-computer protocols to study the effects of neurostimulation on epileptiform activity [37].
The performance of the GAN was further assessed using two common performance measures, namely the Inception Score [53,54]. Few studies, however, have applied GANs to brain data [55,56,13], and anaesthesia [6]. These characteristics include a broad phase distribution, a low amplitude near the center of mass, and the co-occurrence of spiral waves with other forms of activity including planar waves. The advantage of an in vitro approach using an HD-MEA is the ability to monitor spiral waves using a large number of channels simultaneously. The resulting data allowed us to elucidate several aspects of spiral waves that had not previously been explored, including spatial correlations and complexity. These results will benefit from in vivo support in future studies.
Limitations and future work
While our results suggest increased complexity in disinhibited cortical networks, it is unclear whether these results would generalize to surrounding brain regions. In hippocampus, for instance, chaotic dynamics were mainly confined to the dentate gyrus and subiculum, while lower levels of chaotic activity were found in areas CA1–CA4 [20]. It would be worthwhile to explore seizure-like activity across brain regions and capture their differences using generative networks.
Furthermore, disinhibited networks produce various forms of waves that have not been explored here, including saddle patterns formed by the interaction between multiple waves [2,3,4,5,6,7,8]. Future work should be aimed at capturing the diversity of waves produced during healthy and disinhibited cortical states.
Caution should be warranted when attempting to draw general conclusions about neural complexity based strictly on spiral waves without also considering other forms of neural events as well as inter-wave activity. Spiral waves are interleaved with other neuronal patterns, including periods of both synchronized and desynchronized activity [4]. It is possible that analyzing spiral waves in isolation may suggest increased neural complexity, while a broader range of activity may reveal otherwise. Here, we focused on spiral waves as they constitute an intricate form of neural activity that has thus far eluded a complete characterization. More broadly, neural complexity remains poorly understood as it covaries with many factors including cognitive attention [14], task demands [68, 69], arousal state [70], and neural pathologies [22].
Finally, the prospects of using artificial neural networks to monitor and dynamically control epileptic events in real time will require the implementation of GANs that can handle continuous input streams and produce time-evolving synthetic data. This field of research is currently under development and requires a combination of GANs with recurrent neural networks [71, 72].
Conclusions
During states of disinhibited activity, cortical circuits generate propagating waves whose spatial and temporal evolution follows reliable patterns [1]. A deep generative neural network trained on cortical spiral waves captured key aspects of these patterns. Once trained, the model was employed to show that neural complexity varies along a continuum—from lower values in healthy states to higher values in disinhibited states. The complexity of the simulated data was achieved solely by controlling the amplitude and variance of the input fed to the model, suggesting a framework that can be employed to examine the stimulus-driven suppression of aberrant network activity. This work opens the door to novel approaches that derive synthetic exemplars from neuroscience data to study rare forms of activity and probe their causal origins.
Methods
Electrophysiological data collection
Animals
All data were collected using three Sprague Dawley rats of both sexes (2 males and 1 female), aged 14 to 21 days, purchased from Charles River. Animals were housed in standard housing conditions with cage enrichment and ad libitum access to water and standard chow. All experiments were conducted in accordance with the Canadian Council on Animal Care guidelines and all procedures were approved by the University of Ottawa Animal Care and Veterinary Services.
Acute slice preparation
Animals were deeply anaesthetized using isofluorane (Baxter Corporation) and subsequently euthanized via decapitation. Brains of the animals were quickly extracted and submerged into a frozen choline dissection buffer. The buffer consisted of the following: 119.0 mM choline chloride, 2.5 mM KCl, 4.3 mM MgSO4, 1.0 mM CaCl2, 1.0 mM NaH2PO4, 1.3 mM sodium ascorbate, 11.0 mM glucose, 26.2 mM NaHCO3, and was perfused using carbogen (95% O2/5% CO2). Acute cortical slices containing the PFC were produced using a Leica VT1000S vibratome. The brain was sliced coronally at a thickness of 300 µm. Once the slices were collected, they were placed in a recovery chamber filled with a standard artificial cerebrospinal fluid (ACSF) consisting of 119.0 mM NaCl, 2.5 mM KCl, 1.3 mM MgSO4, 2.5 mM CaCl2, 1.0 mM NaH2PO4, 11.0 mM glucose, and 26.2 mM NaHCO3. The ACSF was continuously perfused using carbogen (95% O2/5% CO2) and maintained at a temperature of 37 °C. Following slicing, the chamber was left to recover for 1 h prior to experiments where it equilibrated to room temperature.
Multi-electrode arrays
Generation of epileptiform activity
Baseline data was recorded using standard ACSF prior to application of the PE solution. Slices were included in the study if they displayed neural activity during baseline recordings, defined as threshold-crossing events in voltage traces on the acquisition software. Following baseline recordings, epileptiform activity was generated by applying a pro-epileptiform ACSF (PE-ACSF) containing the following: 120 mM NaCl, 8.5 mM KCl, 1.25 mM NaH2PO4, 0.25 mM MgSO4, 2 mM CaCl2, 24 mM NaHCO3, 10 mM dextrose, and 0.05 mM 4-AP [73]. The PE-ACSF included a potassium channel blocker (4-AP) as well as reduced extracellular magnesium (Mg2+) and increased extracellular potassium (K+), all of which have been reported to induce epileptiform activity [73,74,75,76,77,78,79] and increase synchronization [80, 81]. The PE-ACSF solution was applied for 20 min prior to beginning the recordings and epileptiform activity was recorded for 10 min.
Multi-electrode recordings
Extracellular potentials were collected using an active pixel sensor HD-MEA. This array uses a complementary metal-oxide semiconductor monolithic chip in which the pixels were modified to detect changes in electric voltages from electrogenic tissue. The circuit is designed to provide simultaneous recordings from 4096 electrodes with a sampling rate of 7.7 kHz per channel. The chips are comprised of 64 × 64 electrodes arranged as a pixel element array whereby each pixel measures 21 μm × 21 μm with an electrode pitch of 42 μm. The active area of the array is 7.22 mm2 and has a pixel density of 567 pixels/mm2 [22, 82]. Data were acquired using BrainWave software (3Brain Gmbh, Switzerland) and imported to Matlab (MathWorks, Natick) for offline analysis.
Identification of spiral waves
Voltages at individual channels were processed by first applying a second order bandpass Butterworth filter in the delta range (1–4 Hz) to the raw voltages in the forward and reverse directions using the filtfilt function in Matlab [56, 83, 84]. Artefacts were removed by setting time-points with absolute values greater than 200 μV to the mean of the signal. Data segments containing spiral waves were extracted based on visual inspection and later verified by the following criteria [29]: (i) a broad distribution of instantaneous phases around the center of mass (Fig. 3A–C); (ii) rotating vector fields (Fig. 3D); (iii) a decrease in voltage near the center of mass (Fig. 2B); and (iv) spatially-dependent correlations between pairs of channels (Fig. 4).
Center of mass
The center of mass of a given spiral wave was obtained as follows [85, 86]. Assuming a 64 × 64 array of elements \(a_{ij}\) reflecting the band-filtered voltage at a particular time and spatial location (row \(i\) and column \(j\) up to \(N\) electrodes), the center row \(\left( r \right)\) and column \(\left( c \right)\) are given by
and
The above expressions were computed for each 1 ms time frame (“snapshot”) of a given spiral wave, then averaged to provide the mean center of mass of each wave.
Complexity
The complexity of a given spiral wave was estimated by applying an eigenspectrum decomposition [87, 88] to 6 evenly-spaced snapshots of each spiral wave, yielding ranked eigenvalues \(\lambda_{1} , \ldots ,\lambda_{N}\) where \(N\) is the total number of channels. Then, complexity was calculated using the PR [23,24,25],
corresponding to the square of the eigenspectrum’s first moment normalized by its second moment. If patterns of neural activity are limited to a few dimensions, only a few eigenvalues will be positive, and the PR will be low. However, more complex, high-dimensional neural activity will be reflected by a broad distribution of eigenvalues and a high PR value.
Generative adversarial network
In the GAN framework, two artificial neural networks compete against each other [27]. The “generative model” (G) attempts to produce synthetic samples that closely match the original data, while its counterpart, the “discriminative model” (D), learns to discriminate these synthetic samples from genuine ones. The competition between these two networks drives the GAN to produce synthetic samples that are indistinguishable from the original data. Once successfully trained, novel samples can be obtained from the generative model by feeding random noise to its input layer.
Here, a GAN was trained to produce synthetic samples of spiral waves. Once cortical spiral waves were identified and verified based on the above criteria, a sample of 6 snapshots were collected per spiral, corresponding to evenly spaced time points between the approximate time of initiation and termination of the wave. The complete dataset consisted of 1314 images obtained from 219 spiral waves. Each input to the GAN consisted of all 6 snapshots from an individual wave tiled to form a pattern of size 64 pixels × 64 pixels × 6 snapshots.
Formally, assume some real data \(\left\{ {x^{\left( i \right)} } \right\}_{i = 1}^{m} \sim {\mathbb{P}}_{r} ,\) where \({\mathbb{P}}_{r}\) is the data distribution. The goal was to generate some novel data \(\tilde{\user2{x}}\) whose distribution \({\mathbb{P}}_{g} \) is a close approximation of \({\mathbb{P}}_{r}\). This was achieved by feeding noise to the generator network, \(\tilde{\user2{x}} = G_{\theta } \left( z \right),\) given noisy priors \(\left\{ {z^{\left( i \right)} } \right\}_{i = 1}^{m} \sim p\left( z \right)\). The input \(z\) to the generator was sampled from a Gaussian distribution.
The generative and discriminative networks were trained according to a minimax objective function,
where \(V\left( {D,G} \right)\) is a min–max value function and \({\varvec{x}}\) is the original data. This objective function was optimized using the Adam optimizer [89] with a discriminator network learning rate of \(\alpha\) = 0.0002. The generator network learning rate was \(\alpha\) = 0.001. The total number of training iterations was set to 10,000. The generator network was composed of six hidden layers with rectified linear units (ReLU) and a hypertan (htan) output layer. The discriminator network had eight hidden layers with leaky ReLU units and a htan output layer. A convolution step preceded each hidden layer. The full model was trained using the Matlab Deep Learning library with default parameters unless otherwise stated. Output images were 64 × 64 pixels in size, matching the dimensions of the input snapshots obtained from the HD-MEA.
The performance of the generator network (Fig. 7B) was computed by the score
where \(\hat{Y}_{generated}\) contains the probabilities for the generated images. For the discriminator network, the score was
where \(\hat{Y}_{real}\) contains the discriminator output probabilities for real images. The ideal scenario is where both scores are close to 0.5. However, this is not a requirement to obtain a successful GAN; in fact, several measures were employed to compare the generated images with experimental data, including eigenspectrum distribution (Fig. 7D), center of mass (Fig. 7E), spatial correlations (Fig. 7F), complexity (Fig. 8C–F), Frechet Inception Distance (Fig. 8G), and Inception Score (Fig. 8H).
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.
Abbreviations
- PFC:
-
Prefrontal cortex
- PE:
-
Pro-epileptiform
- ACSF:
-
Artificial cerebrospinal fluid
- PE-ACSF:
-
Pro-epileptiform artificial cerebrospinal fluid
- HD-MEA:
-
High-density multi-electrode array
- GAN:
-
Generative adversarial network
- ReLU:
-
Rectified linear units
- htan:
-
Hypertan
- SD:
-
Standard deviation
- PR:
-
Participation ratio
- LBMLE:
-
Levina–Bickel maximum likelihood estimation
References
Huang X, Troy WC, Yang Q, Ma H, Laing CR, Schiff SJ, et al. Spiral waves in disinhibited mammalian neocortex. J Neurosci. 2004;24:9897–902.
Engel TA, Steinmetz NA. New perspectives on dimensionality and variability from large-scale cortical dynamics. Curr Opin Neurobiol. 2019;58:181–90.
Huang X, Xu W, Liang J, Takagaki K, Gao X, Wu J-Y. Spiral wave dynamics in neocortex. Neuron. 2010;68:978–90.
Muller L, Chavane F, Reynolds J, Sejnowski TJ. Cortical travelling waves: mechanisms and computational principles. Nat Rev Neurosci. 2018;19:255–68.
Sato TK, Nauhaus I, Carandini M. Traveling waves in visual cortex. Neuron. 2012;75:218–29.
Townsend RG, Solomon SS, Chen SC, Pietersen ANJ, Martin PR, Solomon SG, et al. Emergence of complex wave patterns in primate cerebral cortex. J Neurosci. 2015;35:4657–62.
Townsend RG, Gong P. Detection and analysis of spatiotemporal patterns in brain activity. PLoS Comput Biol. 2018;14: e1006643.
Wu JY, Huang X, Zhang C. Propagating waves of activity in the neocortex: what they are, what they do. Neuroscientist. 2008;14:487–502.
Dzhala VI, Staley KJ. Transition from interictal to ictal activity in limbic networks in vitro. J Neurosci. 2003;23:7873–80.
Le Van QM, Navarro V, Martinerie J, Baulac M, Varela FJ. Toward a neurodynamical understanding of ictogenesis. Epilepsia. 2003;44(Suppl 12):30–43.
Pinto DJ, Patrick SL, Huang WC, Connors BW. Initiation, propagation, and termination of epileptiform activity in rodent neocortex in vitro involve distinct mechanisms. J Neurosci. 2005;25:8131–40.
Trevelyan AJ, Sussillo D, Yuste R. Feedforward inhibition contributes to the control of epileptiform propagation speed. J Neurosci. 2007;27:3383–7.
Viventi J, Kim D-H, Vigeland L, Frechette ES, Blanco JA, Kim Y-S, et al. Flexible, foldable, actively multiplexed, high-density electrode array for map** brain activity in vivo. Nat Neurosci. 2011;14:1599–605.
Huang C, Ruff DA, Pyle R, Rosenbaum R, Cohen MR, Doiron B. Circuit models of low-dimensional shared variability in cortical networks. Neuron. 2019;101:337-348.e4.
Ecker AS, Berens P, Cotton RJ, Subramaniyan M, Denfield GH, Cadwell CR, et al. State dependence of noise correlations in macaque primary visual cortex. Neuron. 2014;82:235–48.
Lin I-C, Okun M, Carandini M, Harris KD. The nature of shared cortical variability. Neuron. 2015;87:644–56.
Rabinowitz NC, Goris RL, Cohen M, Simoncelli EP. Attention stabilizes the shared gain of V4 populations. Elife. 2015;4: e08998.
Barbero-Castillo A, Mateos-Aparicio P, Dalla Porta L, Camassa A, Perez-Mendez L, Sanchez-Vives MV. Impact of GABAA and GABAB inhibition on cortical dynamics and perturbational complexity during synchronous and desynchronized states. J Neurosci. 2021;41:5029–44.
**ao Y, Huang X-Y, Van Wert S, Barreto E, Wu J-Y, Gluckman BJ, et al. The role of inhibition in oscillatory wave dynamics in the cortex. Eur J Neurosci. 2012;36:2201–12.
Araújo NS, Reyes-Garcia SZ, Brogin JAF, Bueno DD, Cavalheiro EA, Scorza CA, et al. Chaotic and stochastic dynamics of epileptiform-like activities in sclerotic hippocampus resected from patients with pharmacoresistant epilepsy. PLoS Comput Biol. 2022;18: e1010027.
El Boustani S, Destexhe A. Brain dynamics at multiple scales: can one reconcile the apparent low-dimensional chaos of macroscopic variables with the seemingly stochastic behavior of single neurons? Int J Bifurc Chaos. 2010;20:1687–702.
Ferrea E, Maccione A, Medrihan L, Nieus T, Ghezzi D, Baldelli P, et al. Large-scale, high-resolution electrophysiological imaging of field potentials in brain slices with microelectronic multielectrode arrays. Front Neural Circuits. 2012;6:80.
Litwin-Kumar A, Harris KD, Axel R, Sompolinsky H, Abbott LF. Optimal degrees of synaptic connectivity. Neuron. 2017;93:1153-1164.e7.
Mazzucato L, Fontanini A, La Camera G. Stimuli reduce the dimensionality of cortical activity. Front Syst Neurosci. 2016;10:11.
Hu Y, Sompolinsky H. The spectrum of covariance matrices of randomly connected recurrent neuronal networks. bioRxiv. 2020. https://doi.org/10.1101/2020.08.31.274936.
Altan E, Solla SA, Miller LE, Perreault EJ. Estimating the dimensionality of the manifold underlying multi-electrode neural recordings. PLoS Comput Biol. 2021;17: e1008591.
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial nets. In: Advances in neural information processing systems. 2014. p. 27.
Cavanagh SE, Hunt LT, Kennerley SW. A diversity of intrinsic timescales underlie neural computations. Front Neural Circuits. 2020;14: 615626.
Rule ME, Vargas-Irwin C, Donoghue JP, Truccolo W. Phase reorganization leads to transient β-LFP spatial wave patterns in motor cortex during steady-state movement preparation. J Neurophysiol. 2018;119:2212–28.
Song S, Sjöström PJ, Reigl M, Nelson S, Chklovskii DB. Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol. 2005;3: e68.
Horvát S, Gămănuț R, Ercsey-Ravasz M, Magrou L, Gămănuț B, Van Essen DC, et al. Spatial embedding and wiring cost constrain the functional layout of the cortical network of rodents and primates. PLoS Biol. 2016;14: e1002512.
Levy RB, Reyes AD. Spatial profile of excitatory and inhibitory synaptic connectivity in mouse primary auditory cortex. J Neurosci. 2012;32:5609–19.
Mariño J, Schummers J, Lyon DC, Schwabe L, Beck O, Wiesing P, et al. Invariant computations in local cortical networks with balanced excitation and inhibition. Nat Neurosci. 2005;8:194–201.
Stringer C, Pachitariu M, Steinmetz N, Reddy CB, Carandini M, Harris KD. Spontaneous behaviors drive multidimensional, brainwide activity. Science. 2019;364:255.
Thivierge J-P. Frequency-separated principal component analysis of cortical population activity. J Neurophysiol. 2020;124:668–81.
Levina E, Bickel PJ. Maximum likelihood estimation of intrinsic dimension: neural information processing systems: NIPS. Vancouver, CA. 2004.
Scheid BH, Ashourvan A, Stiso J, Davis KA, Mikhail F, Pasqualetti F, et al. Time-evolving controllability of effective connectivity networks during seizure progression. Proc Natl Acad Sci USA. 2021;118: e2006436118.
Salimans T, Goodfellow I, Zaremba W, Cheung V, Radford A, Chen X. Improved techniques for training GANs. ar**v.org. 2016. https://arxiv.org/abs/1606.03498v1. Accessed 4 Feb 2023.
Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In: Advances in neural information processing systems. 2017. p. 30.
Zirkle J, Rubchinsky LL. Noise effect on the temporal patterns of neural synchrony. Neural Netw. 2021;141:30–9.
Golomb D. Models of neuronal transient synchrony during propagation of activity through neocortical circuitry. J Neurophysiol. 1998;79:1–12.
Wang S, Kfoury C, Marion A, Lévesque M, Avoli M. Modulation of in vitro epileptiform activity by optogenetic stimulation of parvalbumin-positive interneurons. J Neurophysiol. 2022;128:837–46.
Chirasani SKR, Manikandan S. A deep neural network for the classification of epileptic seizures using hierarchical attention mechanism. Soft Comput. 2022;26:5389–97.
Ilakiyaselvan N, Nayeemulla Khan A, Shahina A. Deep learning approach to detect seizure using reconstructed phase space images. J Biomed Res. 2020;34:240–50.
Ilias L, Askounis D, Psarras J. Multimodal detection of epilepsy with deep neural networks. Expert Syst Appl. 2023;213: 119010.
Brock A, Donahue J, Simonyan K. Large scale GAN training for high fidelity natural image synthesis. ar**. In: Proceedings of the IEEE international conference on computer vision. 2017. p. 2830–9.
Tulyakov S, Liu M-Y, Yang X, Kautz J. Mocogan: decomposing motion and content for video generation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018. p. 1526–35.
Lyamzin DR, Macke JH, Lesica NA. Modeling population spike trains with specified time-varying spike rates, trial-to-trial variability, and pairwise signal and noise correlations. Front Comput Neurosci. 2010;4:144.
Panzeri S, Brunel N, Logothetis NK, Kayser C. Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 2010;33:111–20.
Arakaki T, Barello G, Ahmadian Y. Capturing the diversity of biological tuning curves using generative adversarial networks. ar**v preprint. 2017. https://arxiv.org/abs/170704582.
Seeliger K, Güçlü U, Ambrogioni L, Güçlütürk Y, van Gerven MA. Generative adversarial networks for reconstructing natural images from brain activity. Neuroimage. 2018;181:775–85.
Amit DJ, Brunel N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb Cortex. 1997;7:237–52.
Compte A, Sanchez-Vives MV, McCormick DA, Wang X-J. Cellular and network mechanisms of slow oscillatory activity (<1 Hz) and wave propagations in a cortical network model. J Neurophysiol. 2003;89:2707–25.
Stringer C, Pachitariu M, Steinmetz NA, Okun M, Bartho P, Harris KD, et al. Inhibitory control of correlated intrinsic variability in cortical networks. Elife. 2016;5: e19695.
Ermentrout GB, Kleinfeld D. Traveling electrical waves in cortex: insights from phase dynamics and speculation on a computational role. Neuron. 2001;29:33–44.
Jirsa VK, Stacey WC, Quilichini PP, Ivanov AI, Bernard C. On the nature of seizure dynamics. Brain. 2014;137(Pt 8):2210–30.
Spiegler A, Hansen ECA, Bernard C, McIntosh AR, Jirsa VK. Selective activation of resting-state networks following focal stimulation in a connectome-based network model of the human brain. eNeuro. 2016. https://doi.org/10.1523/ENEURO.0068-16.2016.
Dhariwal P, Nichol A. Diffusion models beat GANs on image synthesis. 2021.
Kingma DP, Welling M. An introduction to variational autoencoders. Found Trends Mach Learn. 2019;12:307–92.
Chen X, Li Y, Yao L, Adeli E, Zhang Y. Generative adversarial U-Net for domain-free medical image augmentation. ar**v preprint. 2021. https://arxiv.org/abs/210104793.
Rigotti M, Barak O, Warden MR, Wang X-J, Daw ND, Miller EK, et al. The importance of mixed selectivity in complex cognitive tasks. Nature. 2013;497:585–90.
Stringer C, Pachitariu M, Steinmetz N, Carandini M, Harris KD. High-dimensional geometry of population responses in visual cortex. Nature. 2019;571:361–5.
Kohn A, Jasper AI, Semedo JD, Gokcen E, Machens CK, Yu BM. Principles of corticocortical communication: proposed schemes and design considerations. Trends Neurosci. 2020;43:725–37.
Esteban C, Hyland SL, Rätsch G. Real-valued (medical) time series generation with recurrent conditional gans. ar**v preprint. 2017. https://arxiv.org/abs/170602633.
Mogren O. C-RNN-GAN: continuous recurrent neural networks with adversarial training. 2016. https://doi.org/10.48550/ar**v.1611.09904.
Postnikova TY, Amakhin DV, Trofimova AM, Zaitsev AV. Calcium-permeable AMPA receptors are essential to the synaptic plasticity induced by epileptiform activity in rat hippocampal slices. Biochem Biophys Res Commun. 2020;529:1145–50.
Grainger AI, King MC, Nagel DA, Parri HR, Coleman MD, Hill EJ. In vitro models for seizure-liability testing using induced pluripotent stem cells. Front Neurosci. 2018;12:590.
Pacico N, Mingorance-Le MA. New in vitro phenotypic assay for epilepsy: fluorescent measurement of synchronized neuronal calcium oscillations. PLoS ONE. 2014;9: e84755.
Igelström KM, Shirley CH, Heyward PM. Low-magnesium medium induces epileptiform activity in mouse olfactory bulb slices. J Neurophysiol. 2011;106:2593–605.
Trevelyan AJ, Sussillo D, Watson BO, Yuste R. Modular propagation of epileptiform activity: evidence for an inhibitory veto in neocortex. J Neurosci. 2006;26:12447–55.
Bear J, Lothman EW. An in vitro study of focal epileptogenesis in combined hippocampal–parahippocampal slices. Epilepsy Res. 1993;14:183–93.
Traynelis SF, Dingledine R. Potassium-induced spontaneous electrographic seizures in the rat hippocampal slice. J Neurophysiol. 1988;59:259–76.
Avoli M, Barbarosie M, Lücke A, Nagao T, Lopantsev V, Köhling R. Synchronous GABA-mediated potentials and epileptiform discharges in the rat limbic system in vitro. J Neurosci. 1996;16:3912–24.
D’Antuono M, Benini R, Biagini G, D’Arcangelo G, Barbarosie M, Tancredi V, et al. Limbic network interactions leading to hyperexcitability in a model of temporal lobe epilepsy. J Neurophysiol. 2002;87:634–9.
Imfeld K, Neukom S, Maccione A, Bornat Y, Martinoia S, Farine P-A, et al. Large-scale, high-resolution data acquisition system for extracellular recording of electrophysiological activity. IEEE Trans Biomed Eng. 2008;55:2064–73.
Buzsáki G, Anastassiou CA, Koch C. The origin of extracellular fields and currents–EEG, ECoG, LFP and spikes. Nat Rev Neurosci. 2012;13:407–20.
Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature. 2001;412:150–7.
Han F, Caporale N, Dan Y. Reverberation of recent visual experience in spontaneous cortical waves. Neuron. 2008;60:321–7.
Xu W, Huang X, Takagaki K, Wu J. Compression and reflection of visually evoked cortical waves. Neuron. 2007;55:119–29.
Chapin JK, Nicolelis MA. Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations. J Neurosci Methods. 1999;94:121–40.
Nicolelis MA, Baccala LA, Lin RC, Chapin JK. Sensorimotor encoding by synchronous neural ensemble activity at multiple levels of the somatosensory system. Science. 1995;268:1353–8.
Kingma DP, Ba J. Adam: a method for stochastic optimization. ar**v preprint. 2014. https://arxiv.org/abs/14126980.
Acknowledgements
Authors are thankful to Artem Pilzak for useful discussions on the generative adversarial network, as well as the laboratory of Dr. Jean-Claude Beïque (University of Ottawa) for technical support.
Funding
This work was supported by a Discovery grant to J.P.T. from the Natural Sciences and Engineering Council of Canada (NSERC Grant No. 210977). The funders were not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
Author information
Authors and Affiliations
Contributions
MBR and JPT designed the experiment. MBR performed the experiment. MBR and JPT analyzed and interpreted the data. MBR and JPT wrote the manuscript. Both authors discussed the results, revised the manuscript, and approved the final manuscript. Both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All experiments were conducted in accordance with the Canadian Council on Animal Care guidelines and all procedures were approved by the University of Ottawa Animal Care and Veterinary Services. All methods are reported in accordance with ARRIVE guidelines (https://arriveguidelines.org) for the reporting of animal experiments.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1. Movie showing an example of a single spiral wave recorded with a HD-MEA. Color map shows voltages ranging between [− 200, 200] μV. Each frame of the movie was a snapshot of 100 ms.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Boucher-Routhier, M., Thivierge, JP. A deep generative adversarial network capturing complex spiral waves in disinhibited circuits of the cerebral cortex. BMC Neurosci 24, 22 (2023). https://doi.org/10.1186/s12868-023-00792-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12868-023-00792-6