WorksAgricultural and Biological Sciences
Cooperativity, information gain, and energy cost during early LTP in dendritic spines
Abstract
We investigate a mutual relationship between information and energy during early phase of LTP induction and maintenance in a large-scale system of mutually coupled dendritic spines, with discrete internal states and probabilistic dynamics, within the framework of nonequilibrium stochastic thermodynamics. In order to analyze this computationally intractable stochastic multidimensional system, we introduce a pair approximation, which allows us to reduce the spine dynamics into a lower dimensional manageable system of closed equations. It is found that the rates of information gain and energy attain their maximal values during an initial period of LTP (i.e. during stimulation), and after that they recover to their baseline low values, as opposed to a memory trace that lasts much longer. This suggests that learning phase is much more energy demanding than the memory phase. We show that positive correlations between neighboring spines increase both a duration of memory trace and energy cost during LTP, but the memory time per invested energy increases dramatically for very strong positive synaptic cooperativity, suggesting a beneficial role of synaptic clustering on memory duration. In contrast, information gain after LTP is the largest for negative correlations, and energy efficiency of that information generally declines with increasing synaptic cooperativity. We also find that dendritic spines can use sparse representations for encoding of long-term information, as both energetic and structural efficiencies of retained information and its lifetime exhibit maxima for low fractions of stimulated synapses during LTP. In general, our stochastic thermodynamics approach provides a unifying framework for studying, from first principles, information encoding and its energy cost during learning and memory in stochastic systems of interacting synapses.
* Corresponding author: [email protected]
Introduction
Parts of synapses known as dendritic spines play an important role in learning and memory in neural networks [9, 25, 10, 52, 19]. Learning can be thought as acquiring information in synapses through plasticity mechanism such as LTP and LTD (long term potentiation and depression, respectively), and memory can be regarded as storing that information (for experimental overview see e.g.: [59, 10, 52] (Poo et al 2016); for theoretical overview see e.g.: [14, 5, 11]). Thus learning and memory are strictly related to processing and maintaining of long term information, which in principle could be quantified in terms of information theory and statistical mechanics, similar as it was done for neural spiking activity [47]. Indeed, recent results by the authors show that information (entropy) contained in the distributions of dendritic spine volumes and areas is nearly maximal for any given of their average sizes across different brains and cerebral regions [24]. This suggests that the concept of information can be useful in quantifying synaptic learning and memory, and that actual synapses might “use” and optimize certain information-theoretic quantities.
Physics teaches us that there are close relationships between information and thermodynamics, and the smaller the system the stronger the mutual link, since smallness enhances fluctuations and thus unpredictability in the system [6, 28, 7, 43]. This means that information processing always requires some energy, and it is reasonable to assume that biological evolution favors systems that save energy while handling information, because of the limited resources and/or competition [42]. This line of thought was explored in neuroscience for estimating energy-efficient coding capacity in (short-term) neural activities and synaptic transmissions (Rieke et al 1999; Levy and Baxter 1996 and 2002; Levy and Calvert 2021; Laughlin et al 1998; Balasubramanian et al 2001). All these approaches and calculations for neural and synaptic activities, however valuable, missed one key ingredient of real biological systems, or did not make it explicit. Namely, biological systems, including neurons and synapses, always operate far from thermodynamic equilibrium, where balance between incoming and outgoing energy and matter (or probability) fluxes is broken; the so-called broken detailed balance (for a general physical approach, see: [35, 49, 15]; for a biophysical approach to synapses, see: [22]). As a consequence, equilibrium thermodynamics (with static or stationary variables and Gibbs distributions) does not seem to be the right approach, and to be more realistic, one has to use nonequilibrium statistical mechanics, where the concepts of stochasticity and entropy production play central roles (and where we do not know a priori the probability distributions). Nonequilibrium statistical mechanics (or nonequilibrium stochastic thermodynamics) provides a unifying description for stochastic dynamics, because it treats microscopic information and energy on the same footing, which allows us to get the right estimates of information and energy rates from first principles. Such an approach was initiated in [22, 23] for studying nonequilibrium thermodynamics of synaptic plasticity. Both of these studies suggested that synaptic plasticity can use energy rather economically, since (i) it consumes only about 4−11% of energy devoted for fast synaptic transmission [22], and (ii) it can provide higher coding accuracy and longer memory time for a lower energy cost at certain regimes [22, 23].
There exists a large experimental evidence that local synaptic cooperativity on a dendrite takes place during learning and memory formation (Marino and Malinow 2011; Yadav et al 2012; for a review see: Winnubst et al 2012), and it can also be useful for long-term memory stability [17] (Kastellakis and Poirazi 2019). Thus, it seems that any realistic model of synaptic plasticity relevant for memory formation should include correlations between neighboring synapses. Moreover, it would be good to know how such correlations influence the lifetime of memory trace, as well as, information gain and energy cost associated with it.
The current study explores nonequilibrium statistical mechanics for investigating the efficiency of learning and storing information in a system of interacting synapses with stochastic dynamics during early LTP induction and its maintenance (e-LTP phase, without consolidation). Not only fast synaptic transmission is noisy [56]; the noise is also present in long-term synaptic dynamics associated with slow plasticity due to large thermal fluctuations in internal molecules and presynaptic input [9, 18, 12, 51, 38, 25, 34]. Thus synaptic plasticity requires a probabilistic approach [60], and we assume that it can be described as dynamics involving transitions between discrete mesoscopic states [e.g. 40, 14, 29, 3, 5]. Our paper extends the previous two studies [22, 23] in three important methodological ways. First, it provides a general framework for approximating the dynamics of multidimensional stochastic system of interacting synapses each with 4 internal states (which in practice is computationally intractable for large ), by reducing it to a set of coupled lower-dimensional stochastic subsystems (which are computationally tractable). This is done by applying the so-called pair approximation, which allows us to reduce the system with equations to the system with equations. Second, our paper provides explicit formulas for investigating information gain (rate of Kullback-Leibler divergence) and energy consumption (entropy production rate) for arbitrary time during learning and memory retention phases. Third, we use data-driven estimates for transition rates between different synaptic states, and hence our values of information and energy are realistic.
On a conceptual level, our study investigates how the efficiency of encoded information (bothcuntegn amount and duration) depends on a degree of correlation between neighboring synapses, on a percentage of their activation by presynaptic neurons, and on magnitude and duration of synaptic stimulation during LTP. The first relates to cooperativity between synapses, the second to sparseness of synaptic coding, and the last to the strength of learning. All these parameters can in principle be compared to empirical data, once those are available, thus providing an important link between theory and experiment.
Throughout the paper we use interchangeably the terms “dendritic spine” and “synapse”.
Model of plastic interacting dendritic spines
We consider a single postsynaptic neuron having one basal (main) dendrite with dendritic spines located along its length (Fig. 1). Because of the small sizes of dendritic spines () their dynamics is necessarily probabilistic due to thermodynamic fluctuations of local environment (with high temperature K), as well as due to activity fluctuations in neurons (both of electric and chemical nature). Moreover and importantly, the spines are locally coupled by nearest neighbor interactions, as the experimental data suggest (Marino and Malinow 2011; Yadav et al 2012; Winnubst et al 2012)).
Morphological spine states and stochastic multidimensional dynamics
Empirical data indicate that a single dendritic spine can be regarded as a four state stochastic system with well defined morphological (mesoscopic) states (Montgomery and Madison 2004; Bokota et al 2016; Basu et al 2018; Urban et al 2020; Fig. 1A). These states are denoted here as at each location , with values , corresponding respectively to the following morphological states: nonexistent, stubby, filopodia/thin, and mushroom (the larger , the larger the spine size; see Appendix § 8). These mesoscopic states are quasi stable, which means that there are slow transitions between them that are much slower than microscopic transitions between molecular, mostly unknown, processes comprising internal microscopic dynamics of a dendritic spine [26, 50, 39, 19]. This approach can be treated as a coarse-grained description of intrinsic spine dynamics in terms of stochastic Markov process on a mesoscopic scale.
We assume stochastic dynamics for coupled dendritic spines, and denote by the probability that the spine system has the configuration of internal states . The dynamic of this global stochastic state is motivated by the Glauber model of time-dependent Ising model [16], and it is represented by the following Master equation (see Appendix § 8)
where is the transition rate for the jumps inside spine from state to state .
These jumps also depend on the states of neighboring spines and , because of the nearest neighbor coupling between the spines (Fig. 1B). Generally, we take the following form of the transition matrix :
where is the intrinsic basic transition rate between and at spine , and it is independent of the neighboring synapses. These intrinsic rates are the same for each , setting the temporal scale for basal synaptic plasticity, and they were estimated based on data in [53] and are presented in Table 1. The symbol is the spine size at state of spine and it is proportional to spine surface area (see Appendix § 8), whereas denotes the sign function of the argument , where if , and if . Note that larger spine sizes of neighboring spines generally influence more the transition rates of the given spine, which relates to their cooperativity. The parameter corresponds to magnitude of spine cooperativity between nearest neighbors, with , and there is rescaling by the maximal spine size (size in state called mushroom), which ensures positivity of all elements of the transition matrix. The positive values of indicate positive correlations (positive cooperativity), while its negative values mean negative correlations (negative cooperativity). Note that for positive cooperativity, the local spine interactions amplify the transitions that lead to increase of spine size, and reduce those transitions that decrease spine size. The opposite is true for negative cooperativity. It should be added that distant spines also can affect a given spine at location , but that interaction has an indirect character and thus is weaker and mediated with some delay.
| Matrix element | Value |
| 0.019 | |
| 0.065 | |
| 0.015 | |
| 0.007 | |
| 0.022 | |
| 0.001 | |
| 0.003 | |
| 0.061 | |
| 0.009 | |
| 0.015 | |
| 0.049 | |
| 0.008 |
Table 1. Values of intrinsic basic transition rates in each synapse.
The last factor on the right in Eq. (2) indicates the effect of external (presynaptic) stimulation, leading to LTP, with a time varying function known as alpha function given by
where is the stimulation amplitude, is the time after stimulation onset, and , are time constants related to falling and rising phases of the stimulation, respectively. The latter means that LTP related stimulation last only about ( min; Table 2), which we call the duration of the learning phase. After that time, all the transition rates essentially decay to their pre-stimulation basal values. Consequently, after the stimulation, the dynamics of synaptic plasticity is driven only by the interactions between neighboring spines and their internal states. These dynamics are slow, and we call this stage the memory phase. The prefactor of in Eq. (2) assumes two values: when the spine is stimulated with the probability , and when there is no stimulation with the probability . Note that LTP related stimulation amplifies only the transitions increasing the spine size (the sign function is then 1). For the transitions decreasing the spine size, there is no amplification, because then the prefactor of is zero.
| Description | Variable | Value | Units |
| Number of synapses | 1000 | unitless | |
| Cooperativity | (-1.0, 1.0) | unitless | |
| Probability of stimulation | 0.3 | unitless | |
| Stimulation amplitude | 200 | unitless | |
| Decay time of stimulation | 15 | min | |
| Rising time of stimulation | 2 | min | |
| Energy scale for plasticity | kT |
Table 2. Nominal values of global parameters used in computations.
The important point is that during learning (the phase when the function is activated), the information about the stimulation is encoded in the patterns of the probabilities . Thus, knowing how these patterns change in time provides necessary “data” for computing physical characteristics of learning and memory.
Reduction of multidimensional spine stochastic dynamics into low dimensional dynamics: pair approximation.
Equation (1) describes dynamics of the multidimensional probability that involves a gigantic number of equations. For a typical number of synapses on a dendrite , the dynamics represented by Eq. (1) require equations, which are impossible to simulate and solve on any existing computer. This numerical impossibility forces us to find an approximation to the dynamics in Eq. (1).
Consequently, we consider a lower dimensional dynamics involving only singlets and pairs of locally interacting spines. This strategy is sufficient to describe the global dynamics of the synaptic system, and to compute information and energy rates, if we make a certain reasonable assumption (see below).
The probabilities for singlets and doublets of spine states and can be obtained from Eq. (1) by summations over all other states in other synapses as
and similarly
As a result we obtain two equations
which is valid for , and
which is valid for . For the boundary probabilities, i.e., for the dynamics of , and , we have similar equations, except we drop the boundary terms , as they are nonexistent.
Equations (4) and (5) for the dynamics of and involve additionally the probabilities of spine triplets and , and thus they do not form a closed system of equations. To close these equations, we use the so-called “pair approximation” for probabilities. The main idea in this approximation is that the biggest influence on a given synapse is exerted only by the nearest neighbor synapses, and the effects from remote neighbors can be neglected, as is implied by the form of the transition rate . Specifically, for 3 neighboring synapses indexed spatially as , the dynamic of synapse depends directly only on the state of synapse , and the influence of synapse can be neglected as coming from the remote site. In terms of probabilities, this can be written as
where we used the approximation for the conditional probability , and the fact that . Thus the probabilities of the spine triplets can be effectively written as combinations of the probabilities for spine singlets and doublets, which forms the essence of the pair approximation. A similar expression can be obtained for synapses with other combination of indexes.
The above pair approximation allows us to write the dynamics of probabilities and as
for , and
for . Similar expressions can be written for the boundary probabilities with and .
It is clear that Eqs. (7),(8) for the dynamics of and form the closed system of equations, since now they only depend on each other. Importantly, the number of equations in the reduced dynamics (7,8) is only , which is linear in and thus much smaller than the original equations, and hence feasible for numerical analysis. These two types of probabilities are sufficient to compute quantities of interest, which are associated with LTP induction, such as memory trace and its duration, the average sizes of spines, and the rates of information gain (Kullback-Leibler divergence) and energy dissipated (entropy production rate). However, first we check the accuracy of the pair approximation.
Validity of the pair approximation.
In this section we check how accurate is the pair approximation by considering a small system of dendritic spines with , for which one can find an exact numerical solution for the dynamics in Eq. (1). Our goal is to compare this exact solution with its approximation given by Eqs. (7) and (8).
Numerical calculations indicate that the pair approximation is very accurate, as exact and approximate probabilities are practically indistinguishable (Fig. 2A), even for very strong couplings between spines ( and ). Moreover, the pair approximation is well defined, since it preserves positivity of all probabilities and their normalization (Fig. 2A,B). Additionally, as an example of the main observable used in this study, we also compared entropy production rates computed for the exact dynamics in Eq. (1), denoted as , with that computed from the approximate dynamics in Eqs. (7) and (8) and denoted as (the formulas for the exact and approximate EPR are given, respectively, in Eqs. (10)-(13) and Eqs. (16)-(19)). Both entropy production rates are also essentially indistinguishable, with a small difference at most 0.6% (Fig. 2C).
In order to give a measure of the pair approximation accuracy we introduce the ratio for spines, defined as
where the subscript refers to the pair approximation (Eqs. (7) and (8)), while corresponds to the exact solution (Eq. (1)). When approaches 1, then the pair approximation matches the exact solution perfectly. The larger the deviation of from unity, the less accurate is the approximation. This follows from the form of pair approximation for 4 spines, i.e., . To have a global numerical accuracy, we have to average over all states, which yields a mean ratio , and its standard deviation , serving as a global error. In Fig. 3, we show that is very close to 1, and is generally small, at most 0.1.
Taken together, the numerical results in Figs. 2 and 3 indicate that the pair approximation derived in this study is quite accurate, and its accuracy is preserved in time. For an analytical example related to the pair approximation, see Appendix § 9.
Derivation of entropy production rate as an energy cost for interacting spines
Energy expenditure of synaptic plasticity is associated with transitions between different states of a dendritic spine. The faster the transitions, the more energy is used, and vice versa. Generally, a spine is in a thermodynamic nonequilibrium with its environment, and thus the energy cost is strictly related to entropy production rate of the spine (for general ideas of nonequilibrium thermodynamics, see: Nicolis and Prigogine, (1977), and Peliti and Pigolotti [44]). Specifically, we assume that the energy rate associated with plasticity processes in dendritic spines is equal to the entropy production associated with stochastic transitions between spine mesoscopic states, similar as in [22].
In our case of dendritic spines, the entropy production rate of the whole system is given by a general formula for the entropy production [48, 35, 49, 55]:
where is the individual entropy productions of each interacting spine
for , and for the boundary terms
and
where is the energy scale for various biophysical processes taking place inside a typical dendritic spine and related to molecular plasticity. Its value was estimated at about kT (or ATP molecules), where is the Boltzmann constant and is the absolute brain temperature (see, [23]). In a nutshell, these numbers can be understood by considering that a typical dendritic spine contains roughly proteins, each with a few degree of freedom corresponding to the number of phosphorylation sites ([50]).
As before, we explore the pair approximation in Eqs. (11)-(13), which in the case of spines takes the form
This is a straightforward generalization of formula (6), which can be easily verified. Application of Eq. (14) leads to simplification of the ratio of probabilities under the logarithm in Eq. (11) as
which allows us to perform summation over almost all states except the few in Eqs. (11)-(13). This step produces the final expression for the approximate total entropy production rate of our interacting spines:
where
for , and for the boundary terms
and
Note that the total entropy production of all spines is determined exclusively in terms of the two types of probabilities considered in Eqs. (7) and (8), i.e., one- and two-point probabilities. It is also interesting to mention that the form of the approximated EPR in Eq. (17) can be also deduced instantly from the form of the approximated dynamics for probabilities in Eq. (7). This is possible if one realizes that the expression in the bracket on the right in Eq. (7) represents a probability flux.
The total energy used by all spines for LTP induction and its maintenance up to recovery (during synaptic stimulation and post stimulation) is the energy needed to keep the memory trace above the threshold. is the total energy cost of LTP, and it is defined as
where relates to the onset of stimulation, is the total entropy production rate given by Eqs. (16)-(19), and , where is the memory time, and is the duration of the stimulation (learning phase; see Eq. (3)). The energy used solely for LTP induction and maintenance is denoted as , and it is given by , where is the baseline entropy production rate of all spines.
Definition of memory trace and memory time.
We define the signal associated with dendritic spine activation as
The signal at a steady state (baseline) is denoted as . Memory trace is defined as the average normalized signal to noise ratio. The normalized signal is simply its deviation from the steady state or baseline. Consequently, the memory trace takes the form:
where for . The explicit forms for the signals and variance of the signal are
where , , and , where is the probability distribution at baseline state. The first sum on the right in Eq. (25) is the sum of variances of individual spines, while the second sum is the total cross correlation of spines. In the pair approximation for the probability, the last sum associated with the correlations simplifies, as only the cross correlations between neighboring spines provide nonzero contributions, since generally for .
Memory time is defined as the time after stimulation for which memory trace is in a declining phase and assumes value 1 [14, 29, 22]. This is the moment in time when normalized signal becomes comparable to its noise component.
Derivation of information gain for interacting spines
Information gain , for all spines, right after the end of LTP (i.e., when memory trace decays to the noise level ) is defined as Kullback-Leibler divergence at time , i.e. , between the baseline steady-state initial probability at time (before LTP stimulation) and final probability at time , i.e., . Its form is given by
For the pair approximation, i.e., applying the approximation (14) for the probabilities, information gain takes the form
which is used in the computations.
The rate of information gain is equivalent to the rate of Kullback-Leibler KL divergence at arbitrary time , i.e., (given by Eq. (26) but for arbitrary ). We are interested in the rate of information gain, since we want to compare it directly to the entropy production rate, which has a similar information-theoretic meaning. The rate of KL, which we denote as KLR, is given by . We find
where we used the fact that . The next step is to substitute Eq. (1) for , and perform summations over almost all states , except the few, similarly to the calculation for EPR. Finally, we use the pair approximation. As a result we obtain the total rate of information gain for all spines as
As can be seen, the rate of information gain depends, similar to EPR, on the transition rates between states in all spines. In all figures, we plot per spine, i.e., . Finally, note that the information gain is the temporal integral of from to , i.e., .
Numerical results on memory trace, information gain, and energy cost during LTP.
We divide the global dynamics of our system of interacting dendritic spines into two stages. The first stage relates to approaching and reaching a steady-state, starting from random initial conditions (with for each spine). This steady-state is a thermodynamic non-equilibrium steady-state that uses some small but nonzero energy (small but nonzero EPR), and can be thought as the state in which some background information is written in synapses. After reaching the steady-state, we start a second stage associated with spine stimulation, which we call LTP (long-term potentiation) phase. This stage consists of a brief stimulation of the synaptic system by amplifying the transition rates by the function present in Eqs. (2) and (3), and then observation of the system recovery to the steady state, with simultaneous recording of the most important observables. Stimulation of synapses is done by turning on the amplifier function , which amplifies the transition rates between synaptic states (Eqs. (2) and (3)). We call this stimulation phase as “learning” phase, and recovery phase as “memory” phase.
Dynamics of memory trace, information and energy rates, and synaptic size associated with LTP induction.
Following LTP induction (starting at time in function) memory trace contained in synapses behaves differently than the rates of information gain (Kullback-Leibler rate KLR) and energy (entropy production rate EPR) (Fig. 4). Initially all three quantities increase sharply, similarly as , but later their dynamics diverge. Specifically, memory trace exhibits a long temporal tail, i.e., it decays much slower than the stimulation function , with longer tail for positive cooperation () between neighboring spines than for negative cooperation (Fig. 4B). On the other hand, both KLR and EPR (per synapse) decay extremely fast to their baseline values, much faster then (Fig. 4C,D). This strongly suggests that keeping memory trace high does not require large rates of energy (EPR). Moreover, the dynamics of KLR and EPR are very similar in shape, and their ratio is positive only initially, when synaptic stimulation increases in time (Fig. 4E). This behavior indicates that information amount written at synapses increases sharply only in the beginning of LTP (learning); at later stages (memory) it weakly decreases (note negative values of KLR/EPR). The rates of information gain (KLR) and energy (EPR) depend weakly, and in the opposite way, on the sign of cooperativity ; the peak of KLR is greater for negative , while the peak of EPR is greater for positive (Fig. 4C,D). At its peak, i.e. during stimulation, energy is consumed at rate kT/min, and information is gained at rate 0.1 bits/min, which indicates that acquiring 1 bit at that moment in time is very expensive and costs about kT.
The dynamics of spine sizes following LTP induction are similar to the behavior of memory trace, except that sizes stabilize at some finite level (Fig. 5). Positive cooperativity among synapses () generally indicates positive correlations between them, and vice versa (Fig. 5C). Consequently, positive correlations lead to higher mean spine sizes than negative correlations (Fig. 5B). An opposite effect is seen for the ratio of KLR and spine size; higher peaks are observed for negative cooperativity between synapses (Fig. 5D). Interestingly, normalized correlations are more variable during learning and memory phases for negative cooperativity than for positive one (Fig. 5C).
Memory time, spine size, information gain after LTP, and their energy costs as functions of synaptic cooperativity.
Memory time grows monotonically but very weakly with cooperativity up to a point where is close to its maximal value 1 (Fig. 6A). In that regime of very high positive cooperativity, increases sharply with . The opposite dependence on is present for information gain and average spine size (Fig. 6B, E). generally decreases with (for negative the decay is stronger than for positive ; Fig. 6B), whereas mean spine size monotonically increases with (increase is stronger for close to 1; Fig. 6E). Total energy consumed during LTP and its part related solely to LTP depend nonmonotonically on cooperativity , exhibiting broad maxima for (Fig. 6C,D). For close to its maximal value 1, and behave in opposite ways: the former increases while the latter decreases with . This suggests that the cost of LTP alone drops for very high cooperativity.
How do these results translate to energy and structural efficiency of memory lifetime and information gain? Figure 7 provides the answers. The ratios of memory time and the energies, i.e., and , are essentially constant for up to (Figure 7A), suggesting that memory time and both of these energies grow proportionally with cooperativity for a wide range of . For larger these ratios grow significantly with , especially , indicating that energy efficiency of memory time is enhanced in the regime of very high positive synaptic cooperativity (Figure 7A).

(a)

(b)

(c)

(d)

(e)
Figure 7.
Energy efficiency of information gain is more complex (Figure 7B). Generally, the ratio of information to total energy during LTP decreases monotonically with , meaning that efficiency of is maximal for negative cooperativity between synapses. On the other hand, the ratio of information to energy solely to LTP, i.e., as a function of has a U-shape, with large values for both high negative and high positive cooperativity. The latter means that information efficiency in that energy currency has two regimes of higher values (Figure 7B). However, it should be emphasized that the overall energy efficiency of information gain is rather low, at bits/ or bits/, i.e., 1 bit of stored memory (after decline of LTP, i.e. after time ) costs about (see also below).
Structural efficiency (or energy efficiency of transmission) of memory time and information gain exhibit different behavior as functions of synaptic cooperativity (Figure 7 C,D). The ratio of information gain to mean spine size decreases monotonically with , which indicates that structural efficiency of information is the largest for negative cooperativity (Figure 7D), similar to the (total) energy efficiency of (Figure 7B). The ratio of memory time to mean spine size decreases slightly with increasing cooperativity from negative values of , but for this ratio increases sharply with (Figure 7C).
This result shows that structural efficiency of memory time is the highest for strong positive synaptic cooperativity (Figure 7C), where spine normalized correlations reach values (Figure 7E).
Sparse representations of synaptic memory and information are more energy efficient.
Next we investigate how memory time, information gain, average spine size, and energy cost depend on the fraction of stimulated synapses by presynaptic neurons (Figure 8). Memory time , energy cost solely due to LTP , and mean spine size grow monotonically with , though the first one saturates for larger (Figure 8 A,C,D). In contrast, information gain and total energy cost display non-monotonic behavior: the former has a maximum, while the latter a minimum for a small fraction of active synapses (Figure 8 B,C). In terms of energy efficiency, the ratios of , and , have maxima at around the same small fraction , regardless of the sign of synaptic cooperativity (Figure 9A,B). This means that there exist an optimal percentage of activated synapses on a dendrite that yields the highest information gain and memory lifetime per invested energy (whether total or only due to LTP). For that optimal , the energy cost of 1 bit of stored information is about , which is much lower (and thus more efficient) than for values away from the optimality. Interestingly, the normalized correlations between spines are essentially independent of (Figure 9E).

Figure 8.

Figure 9.
Structural efficiency of information gain and memory time is qualitatively similar to their energy efficiency (Figure 9). The information per spine size has a similar sharp peak as for low (Figure 9D). However, memory time per spine size has a much broader maximum at higher values of (Figure 9C).
Taken together, these results indicate that energetic and structural efficiency of information and its duration in synapses can be optimized for low fractions of activated synapses during LTP. In other words, acquiring and storing of synaptic information can be most efficient by using sparse synaptic representations, regardless of the nature of synaptic cooperativity.
Memory time, spine size, information gain, and their energy costs as functions of strength and duration of stimulation.
In Figure 10 and Figure 11, we show how memory time, information gain, energy cost, and mean spine size depend on the duration of stimulation (decay time of the stimulation). Memory time and its energy costs , both grow proportionally with (Figure 10A,C), such that their ratios and are almost constant, although with a weak increasing trend (Figure 11A). Information gain as well as its energy efficiencies , decrease with for small , but for larger all of these quantities saturate at some small level (Figure 10B and Figure 11B). Average spine size shows a similar saturation effect after a small initial increase (Figure 10D). In terms of structural efficiency, grows linearly with (Figure 11C), and first decreases with and then saturates (Figure 11D).

(a)

(b)

(c)

(d)
Figure 10. Figure 10

Figure 11.
The results in Figure 11 indicate that longer stimulation times are not particularly beneficial for energy efficiency of memory lifetime and information gain (Figure 11A,B). However, longer stimulation may be advantageous for structural efficiency of memory duration (Figure 11C), though not for information (Figure 11D).
In Figure 12 and Figure 13, we present the dependence of memory time, information gain, energy cost, and mean spine size on the amplitude of stimulation . Memory time and energy costs both grow weakly but saturate with (Figure 12 A,C). On the other hand, and spine size stay almost constant (Figure 12 B,D). These results translate into very weak variability of energy and structural efficiencies of memory time and information gain on , which are close to constancy, except the ratio that exhibits an increasing trend, but with a saturation (Figure 13). This suggests that too strong stimulations are also not advantageous over weaker stimulations for efficiency of information gain and its duration.

Figure 12.

(a)

(b)

(c)

(d)
Figure 13.
Influence of synaptic number on the efficiencies of memory lifetime and information gain.
In Figure 14, we show that energy efficiency of both memory lifetime and information gain exhibit a decreasing trend with increasing the number of dendritic spines . The biggest drop in efficiency is for changing from 10 to (Figure 14A,B). For higher values of , the rate of decline is much slower. This result suggests that having large number of spines on a dendrite is generally highly inefficient in terms of energy for storing information. For example, for we obtain min/, and bits/, i.e., storing 1 min of memory in the spines costs about kT of energy, and storing 1 bit after the degradation of LTP costs kT. In contrast, for , we have min/ and bits/, which means that in this case storing 1 min of memory costs kT, and storing 1 bit in all spines after LTP degradation costs kT.

Figure 14.
Since memory lifetime and information gain are collective variables, to determine structural efficiencies of these variable as functions of , we have to divide and by the whole structural cost of all spines, i.e., by . Thus, the structural efficiencies in this case are the ratios and (Figure 14 C,D), and they drop significantly with increasing , in a similar manner as the corresponding energy efficiencies (in Figure 14 A,B).
Taken together the two types of the efficiency, it is clear that too many synapses on a dendrite is not beneficial for information storage and its duration in terms energy and biochemical resources.
Summary and Discussion
We formulated the probabilistic approach to global dynamics of interacting synapses (on a single dendrite) and to their nonequilibrium thermodynamics to study information processing in synaptic internal degrees of freedom. In order to make the high dimensional system of interacting synapses computationally tractable, we introduced the so-called pair approximation, which effectively reduces the dimensionality and number of equations describing the system dynamics in a closed form by considering only the probabilities of singlets and doublets of dendritic spines. We verified on a simplified example that this approximation provides a very good accuracy of the exact dynamics, as well as entropy production rate. We also gave the analytical condition for the applicability of the pair approximation in the equilibrium Ising model in Appendix B Appendix § 9 (for a more general discussion about the accuracy of the pair approximation, see Matsuda et al [37], and van Baalen [54]).
The Master equation approach combined with stochastic thermodynamics allows us to treat information contained in synaptic states on equal footing with its energy cost by relating them to, respectively, the rates of Kullback-Leibler divergence and entropy production. Both of these quantities depend on state probabilities as well as on transitions between the states, and we provided explicit formulas for their calculations. The formalism makes it clear that every plastic transition in synaptic system is associated both with some information processing (flow) and with some energy expenditure (entropy production). Even stationary states out of thermodynamic equilibrium (baseline states), in order to maintain them, require some energy (usually small), which essentially means that keeping information always costs some energy for nonequilibrium systems even in stationary conditions. Physically, this energy dissipation (entropy production) in stationary state is a consequence of breaking the so-called detailed balance in probability flows, and it is a generic feature of systems out of thermodynamic equilibrium (in the context of physics, see: Maes et al [35]; Seifert [49]; for a dendritic spine, see: Karbowski 2019).
Our main results are: (i) Learning phase of a signal (spine stimulations) involves high levels of both information and energy rates, which are much larger than their values during a memory phase (Fig. 4). This indicates that keeping information (memory) is relatively cheap in comparison to acquiring it (learning). This result on a level of many interacting synapses is qualitatively similar to the result in [22], where it was shown that memory trace resulting from molecular transitions in a single synapse (protein phosphorylation) decouples from energy rate after stimulation phase, leading to a relatively cheap long memory trace of protein configurations. In our model, the maximal energy rate of spine plasticity taking place during stimulation is kT/min (for ). (ii) Memory lifetime and its energy efficiency can significantly increase their values for very strong positive synaptic cooperativity, while the opposite is observed for information gain right after LTP drops to its noise level (Figure 7). This result suggests that strong local positive correlations between neighboring spines can be beneficial for memory storage, especially in the range (Figure 7E), i.e., for values reported experimentally [36]. This conclusion supports the so-called “synaptic clustering hypothesis”, which was proposed as a mechanism for producing synaptic memory [17] and enhancing its capacity [45] (Kastellakis and Poirazi 2019). (iii) There exists an optimal fraction of stimulated synapses during LTP for which energy efficiency of both memory lifetime and information gain exhibit maxima (Figure 9). This means that sparse representations of learning and memory are much better in terms of energy efficiency, and thus might be preferable by actual synapses. This is also true for structural efficiency of information gain (Figure 9). (iv) Energy and structural efficiencies of memory lifetime and information gain after degradation of LTP both drop dramatically with increasing the number of spines (Figure 14). For example, storing 1 bit after LTP is over costs “only” kT for 10 spines, and at least two orders of magnitude more, i.e., kT for spines. Interestingly, the latter figure for energy cost is about times larger than the cost of transmitting 1 bit through a chemical synapse [27]. This high inefficiency of and is surprising and can induce a question: why do neurons have so many synapses? Perhaps, the answer is that neurons need many synapses for reliable transfer of an electric signal (short-term information) between themselves, not necessarily for efficient storing of long-term information.
Our model is based on the assumption that a dendritic spine can be treated as the system with discrete states, which is compatible with some morphological observations [10, 40, 8, 53]. In this respect, it is similar in architecture to some previous discrete models of synapses or dendritic spines [14, 29, 3, 5]. However, these models treat synaptic states quite arbitrary and abstract, and consider mostly unidirectional transitions between the states, which makes these models thermodynamically inconsistent (e.g. entropy production rate, equivalent to plasticity energy rate, is ill-defined and yields infinities for unidirectional transitions). In contrast, our model takes as a basis well defined morphological synaptic states, with bidirectional transitions between them that are estimated based on empirical data [8, 4, 53]. The latter feature, i.e., bidirectional transitions, makes our model thermodynamically consistent (with finite entropy production), as was explained in a previous model of metabolic molecular activity in a single spine within the framework of cascade models of learning and memory [22].
In this paper, we consider two types of costs. The first is energy cost (related to entropy production) associated with stochastic “plastic” transitions between different synaptic states. The second is structural cost, defined here as proportional to average spine size and related to biochemical cost of building a synapse. This structural cost is also proportional to the rate of electric energy of synaptic transmission ([1, 20, 21]), as spine size is proportional to synaptic electric conductance or, more commonly, synaptic weight ([25]). For standard cortical conditions, i.e. for low firing rates Hz, the energy cost of synaptic transmission is much larger than the energy cost related to plasticity processes inside spine ([22]). However, these two costs can become comparable for very large firing rates, Hz ([23]). There is some confusion in the literature about these two types of energy costs, and some researchers associate the structural cost related to synapse size/weight with “plasticity energy cost”, by assuming the larger synaptic weight leads the higher plastic energy cost (e.g. [33]). However, this does not have to be so, and we should make a distinction between the two energy costs. Bigger synapses do not necessarily require larger amounts of plasticity related energy than smaller synapses, because the transitions in bigger synapses could be generally much slower than in smaller synapses (as is in fact reported in some experiments; [25]). Thus, what mostly matter for the plasticity energy rate are the rates of transition between internal synaptic states. On the other hand, synaptic size/weight is always a good indicator of electric energy rate related to fast synaptic transmission ([1, 20, 21]).
The present model can be extended in several ways, e.g., by introducing heterogeneity in spine interactions. That is, by allowing random signs of the cooperativity parameter . However, we suspect that such modifications would not alter the general qualitative conclusions. Finally, our model considers only the early phase of LTP, the so-called e-LTP, which generally lasts up to a few hours and does not involve protein synthesis inside spines. Inclusion of protein synthesis, associated with the process of memory consolidation and thus late phase of LTP (so-called l-LTP), would require some modifications in our present model. The most important of which is inclusion of additional variables in the probabilities characterizing spine states, which are related to internal degrees of freedom (proteins, actin, etc).
This clearly would make the model much more complex, and thus it remains a major challenge at present. However, we hope that our approach of stochastic thermodynamics provides some insight about attempting to model the interplay of information and energy during the late phase of LTP and memory consolidation for interacting spines.
Stochastic model of morphological states in dendritic spines.
Our data on dendritic spines come from cultures of rat hippocampus [8, 4]. We assume that each dendritic spine can be in four different morphological states: nonexistent (lack of spine), stubby, filopodia, and mushroom. These four states constitute the minimal number of states that can be classified and quantified on a mesoscopic level [8, 4, 53]. Each state has a typical size, which can be characterized by several geometric parameters. We focus on one particular parameter, spine head surface area, as an indicator of both spine structure and function. Spine head surface area is proportional to synaptic weight (as measured by the number of AMPA receptors; Kasai et al [25]), which relates to spine neurophysiological function (synaptic transmission and information storage in molecular structure). On the other hand, spine area is also a measure of its structural and metabolic costs (larger area larger both costs). To estimate spine areas in each of the three states (for nonexistent state the size is 0), we used the data on minimal and maximal spine head diameters from [8, 53], which gave us the following numbers: for nonexistent, for stubby, for filopodia/thin, and for mushroom. Values of these intrinsic transition matrix are given in Table 1. The values of global parameters are presented in Table 2.
We assume that global spine dynamics can be described as Markov chain model, in which there are stochastic transitions between spine internal states. The general model of this kind is given by the following master equation (e.g. Glauber [16]):
where is the multidimensional transition matrix of the whole system of dendritic spines. We assume that transitions between the states take place only in one of the spines at any given time unit (the rest of states in other spines do not change in that brief time step). This means that the multidimensional matrix can be decomposed as
where are the transitions rates at individual spines, which are dependent on the neighboring spines. After insertion of the form of multidimensional transition matrix in Eq. (31) above, and performing summations, we obtain Eq. (1) in the main text.
By using the above pattern of transition probabilities we assume that at sufficiently short time step only one transition can take place, i.e., simultaneous transitions in different spines are much less likely, and thus can be neglected. Indeed, since the local basic transitions between mesoscopic states in individual spines are of the order of several minutes ([53]; Table 1), the likelihood that two or more such transitions in two or more spine take place simultaneously in a short period of time (much smaller than a minute) is small. This type of locality of explicit synaptic interactions allows us to analyze the dynamics of global system of interacting spines.
Validity of the “pair approximation” for analytically solvable model
In this section we provide conditions that much be satisfied for applying the pair approximation in a case that can be treated analytically, which is a simplified Ising model in thermal equilibrium. We consider 3 interacting units () forming a linear ordered chain, similar as in Fig. 1, but each unit having only two states or . Additionally, in this model, nearest neighbors interact strongly with the coupling , whereas remote units (i.e. 1 and 3) interact weakly with the coupling , which is much smaller than . Our goal is to check how accurate is the pair approximation as we increase the strength of remote coupling in relation to .
The equilibrium probability of finding a given configuration of units , , has the form [13]
where is the normalization factor. The two-point marginal probabilities are given by
The one-point marginal probability for the middle unit is
These four probabilities is all we need to quantify the accuracy of the pair approximation, which in our case is represented by . The numerical accuracy of this approximation can be assessed by defining the ratio as
and looking how much deviates from unity. Since depends on configurations , , , it is good to determine the mean value of , averaged over all these states, i.e., .
After some straightforward algebra, we can find as
From this formula it is clear that for we get , regardless of the value of . For large coupling (), we obtain , which means that is essentially close to 1 for small . For example, for we get , for we get , and higher values of increase even further, which breaks the pair approximation. For intermediate values of , e.g. , the ratio achieves value 1.55 for , which is a slightly larger value than for the strong coupling case.
Supplementary Information
The code for performed computations is provided in the Supplementary Material.
Acknowledgments
The work was supported by the Polish National Science Centre (NCN) grant number 2021/41/B/ST3/04300 (JK).
Figure Captions
Figure 1. Mesoscopic model of dendritic spines and their interactions on a dendrite. A) Four state stochastic model of a dendritic spine with transitions between the mesoscopic states. B) Interactions between spines on a dendrite are determined only by nearest neighbors, in such a way that spine’s intrinsic transition rates depend on the states of neighboring spines. These interactions can be thought as representing inflow and outflow of different molecules between spines.
Figure 2. Comparison of an exact solution and pair approximation for interacting spines. A) Time dependence of exact and approximated probability for three different couplings . Both probabilities are essentially indistinguishable. Exact solutions correspond to solid (), dashed (), and dotted () lines. Pair approximations correspond to diamonds (), x (), and circles (). B) Normalization condition for probabilities of spine no 1, i.e. . Solid line for , dashed line for , and dotted line for . Note that the sum deviates from unity by a very small number less than . C) Time dependence of exact () and approximated () entropy production rate. Exact correspond to solid () and dashed () lines. Pair approximations correspond to diamonds () and x (). Note an excellent matching of to .
Figure 3. Accuracy measure for pair approximation with interacting spines. A) Average ratio as a function of time for different magnitudes of coupling between the spines. B) Similar as in A but for standard deviation of the ratio . Note that SD(R) is for moderate values of much less than
0.05, and maximally achieves the value in the extreme case .
Figure 4. Dynamics of memory trace, and the rates of information gain and energy. Temporal dependence of A) stimulation function (amplifier of transitions between the states), B) memory trace MT, C) information gain rate per spine (Kullback-Leibler divergence rate, KLR/), D) entropy production rate (energy rate) per spine (EPR/ in units of ), and of E) the ratio of information gain rate to entropy production rate per spine (KLR/EPR). Learning phase, equivalent to stimulation phase, lasts up to 20 min (A). Memory phase, quantified by memory trace, starts after the end of stimulation and lasts up to min (B). Note that upon stimulation the rates of information gain and entropy production (KLR and EPR) achieve peaks very fast, but they also decay very fast. In contrast, memory trace lasts much longer. EPR value at its peak is kT/min per spine, which is about 2-3 orders of magnitude larger than at baseline (before or long after the stimulation).
Figure 5. Dynamics of spine size, correlations, and of information gain per spine size. Temporal dependence of A) stimulation function , B) average spine size C) normalized correlations between spines, and of D) the ratio of KLR per spine to average spine size .
Figure 6. Dependence of memory time, information gain, energy cost, and spine size on the synaptic cooperativity. A) and B) Monotonic but opposite dependence of memory time and total information gain on cooperativity . C) and D) Total energy consumption of all spines during LTP and its part , related solely to LTP induction and maintenance, exhibit nonmonotonic dependence
on (energy units are in ; see Methods). During whole LTP, a typical spine used about kT of energy. E) Average spine size increases monotonically with .
Energetic and structural efficiencies of memory time and information gain in comparison to spine correlations as functions of synaptic cooperativity. Ratios of A) memory time and B) information gain to two energies and exhibit two opposite dependence. Similar behavior for the ratios C) memory time and D) information gain to average spine size as functions of . E) Normalized correlations always increase with , reaching for .
Dependence of memory time, information gain, energy cost, and spine size on probability of synaptic stimulation. A) Memory lifetime saturates for large . B) Information gain exhibits a sharp peak for very small . C, D) Energy solely due to LTP and average spine size increase linearly with .
Energetic and structural efficiencies of memory time and information gain as functions of probability of synaptic stimulation. All the ratios of memory time and information gain to energies and to spine size exhibit maxima. At the peak, the ratio is bit/ and is bit/, which means that 1 bit of stored information after LTP degradation requires about kT of energy.
Dependence of memory time, information gain, energy cost, and spine size on duration of stimulation .
All diagonal elements, i.e. , are zero. The units are in .
Value of stimulation amplitude is motivated by experimental facts that during LTP the rates of protein phosphorylation at PSD increase by 2 − 3 orders of magnitude in respect to baseline rates (e.g. [39]). Energy scale for synaptic plasticity was taken from the estimate in [23].

Figure 1 (PDF p. 51).

Figure 2 (PDF p. 52).

Figure 3 (PDF p. 53).

Figure 4 (PDF p. 54).

Figure 5 (PDF p. 55).

Figure 6 (PDF p. 56).
References
- [1]Attwell D, Laughlin SB (2001) An energy budget for signaling in the gray matter of the brain. J. Cereb. Blood Flow Metabol. 21: 1133-1145.pubmed.ncbi.nlm.nih.gov/11598490
- [3]Barrett AB, Billings GO, Morris RGM, van Rossum MCW (2009) State based model of long-term potentiation and synaptic tagging and capture. PLoS Comput. Biol. 5: e1000259.DOI
- [4]Basu S, Saha PK, Roszkowska M, Magnowska M, Baczynska E, et al (2018) Quantitative 3-D morphometric analysis of individual dendritic spines. Sci. Rep. 8: 3545.DOI
- [5]Benna MK, Fusi S (2016) Computational principles of synaptic memory consolidation. Nature Neurosci. 19: 1697-1706.DOI
- [6]Bennett CH (1982) The thermodynamics of computation - a review. Int. J. Theor. Physics 21: 905-940.DOI
- [7]Berut A, Arakelyan A, Petrosyan A, Ciliberto S, Dillenschneider R, Lutz E (2012) Experimental verification of Landauer’s principle linking information and thermodynamics. Nature 483: 187-190.DOI
- [8]Bokota G, Magnowska M, Kusmierczyk T, Lukasik M, et al (2016) Computational approach to dendritic spine taxonomy and shape transition analysis. Front. Comput. Neurosci. 10: 140.
- [9]Bonhoeffer T, Yuste R (2002) Spine motility: phenomenology, mechanisms, and function. Neuron 35: 1019-1027.pubmed.ncbi.nlm.nih.gov/12354393
- [10]Bourne JN, Harris KM (2008) Balancing structure and function at hippocampal dendritic spines. Annual Rev. Neurosci. 31: 47-67.DOI
- [11]Chaudhuri R, Fiete I (2016) Computational principles of memory. Nature Neurosci. 19: 394-403.DOI
- [12]Choquet D, Triller A (2013) The dynamic synapse. Neuron 80: 691-703.DOI
- [13]Feynman RP (1972). Statistical Mechanics: A set of lectures. Westview Press.
- [14]Fusi S, Drew PJ, Abbott LF (2005) Cascade models of synaptically stored memories. Neuron 45: 599-611.pubmed.ncbi.nlm.nih.gov/15721245
- [15]Gardiner CW (2004) Handbook of Stochastic Methods. Berlin: Springer.
- [16]Glauber RJ (1963) Time-dependent statistics of the Ising model. J. Math. Phys. 4: 294-307.DOI
- [17]Govindarajan A, Kelleher RJ, Tonegawa S (2006) A clustered plasticity model of long-term memory engrams. Nat. Rev. Neurosci. 7: 575-583.pubmed.ncbi.nlm.nih.gov/16791146
- [18]Holtmaat AJ, Trachtenberg JT, Wilbrecht L, Shepherd GM, Zhang X, et al (2005) Transient and persistent dendritic spines in the neocortex in vivo. Neuron 45: 279-291.pubmed.ncbi.nlm.nih.gov/15664179
- [19]Kandel ER, Dudai Y, Mayford MR (2014) The molecular and systems biology of memory. Cell 157: 163-186.DOI
- [20]Karbowski J (2009) Thermodynamic constraints on neural dimensions, firing rates, brain temperature and size. J. Comput. Neurosci. 27: 415-436.DOI
- [21]Karbowski J (2012) Approximate invariance of metabolic energy per synapse during development in mammalian brains. PLoS ONE 7: e33425.DOI
- [22]Karbowski J (2019) Metabolic constraints on synaptic learning and memory. J. Neurophysiol. 122: 1473-1490.DOI
- [23]Karbowski J (2021) Energetics of stochastic BCM type synaptic plasticity and storing of accurate information. J. Comput. Neurosci. 49: 71-106.DOI
- [24]Karbowski J, Urban P (2022) Information encoded in volumes and areas of dendritic spines is nearly maximal across mammalian brains. (www.biorxiv/2021.12.30.474505) Preprint.DOI
- [25]Kasai H, Matsuzaki M, Noguchi J, Yasumatsu N, Nakahara H (2003) Structure-stability-function relationships of dendritic spines. Trends Neurosci. 26: 360-368. Kastellakis G, Poirazi P (2019) Synaptic clustering and memory formation. Front. Mol. Neurosci. 12: 300.
- [26]Kennedy MB (2000) Signal-processing machines at the postsynaptic density. Science 290: 750-754.pubmed.ncbi.nlm.nih.gov/11052931
- [27]Laughlin SB, de Ruyter van Steveninck RR, Anderson JC (1998) The metabolic cost of neural information. Nature Neurosci. 1: 36-40.pubmed.ncbi.nlm.nih.gov/10195106
- [28]Leff HS, Rex AF (1990) Maxwell’s Demon: Entropy, Information, Computing. Princeton Univ. Press: Princeton, NJ.
- [29]Leibold C, Kempter R (2008) Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. Cereb. Cortex 18: 67-77.pubmed.ncbi.nlm.nih.gov/17490993
- [33]Li HL, van Rossum MCW (2020) Energy efficient synaptic plasticity. eLife 9: e50804.
- [34]Loewenstein Y, Kuras A, Rumpel S (2011) Multiplicative dynamics underlie the emergence of the log-normal distribution of spine sizes in the neocortex in vivo. J. Neurosci. 31: 9481-9488.DOI
- [35]Maes C, Redig F, van Moffaert A (2000) On the definition of entropy production, via examples. J. Math. Phys. 41: 1528.DOI
- [36]Makino H, Malinow R (2011) Compartmentalized versus global synaptic plasticity on dendrites controlled by experience. Neuron 72: 1001-1011.DOI
- [37]Matsuda H, Ogita N, Sasaki A, Sato K (1992) Statistical mechanics of population: The lattice Lotka- Volterra Model. Prog. Theor. Physics 88: 1035-1049.DOI
- [38]Meyer D, Bonhoeffer T, Scheuss V (2014) Balance and stability of synaptic structures during synaptic plasticity. Neuron 82: 430-443.
- [39]Miller P, Zhabotinsky AM, Lisman JE, Wang X-J (2005) The stability of a stochastic CaMKII switch: Dependence on the number of enzyme molecules and protein turnover. PLoS Biol. 3: e107.pubmed.ncbi.nlm.nih.gov/15819604
- [40]Montgomery JM, Madison DV (2004) Discrete synaptic states define a major mechanism of synaptic plasticity. Trends Neurosci. 27: 744-750.pubmed.ncbi.nlm.nih.gov/15541515
- [42]Niven B, Laughlin SB (2008) Energy limitation as a selective pressure on the evolution of sensory systems. J. Exp. Biol. 211: 1792-1804.DOI
- [43]Parrondo JMR, Horowitz JM, Sagawa T (2015) Thermodynamics of information. Nature Physics 11: 131-139.
- [44]Peliti L, Pigolotti S (2021) Stochastic Thermodynamics: An Introduction. Princeton: Princeton Univ. Press.
- [45]Poirazi P, Mel BW (2001) Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 29: 779-796.pubmed.ncbi.nlm.nih.gov/11301036
- [47]Rieke F, Warland D, de Ruyter R, Bialek W (1999) Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
- [48]Schnakenberg J (1976) Network theory of microscopic and macroscopic behavior of master equation systems. Reviews of Modern Physics 48: 571-585.DOI
- [49]Seifert U (2012) Stochastic thermodynamics, fluctuation theorems and molecular machines. Rep. Prog. Phys. 75: 126001.DOI
- [50]Sheng M, Hoogenraad CC (2007) The postsynaptic architecture of excitatory synapses: a more quantitative view. Annu. Rev. Biochem. 76: 823-847.pubmed.ncbi.nlm.nih.gov/17243894
- [51]Statman A, Kaufman M, Minerbi A, Ziv NE, Brenner N (2014) Synaptic size dynamics as an effective stochastic process. PLoS Comput. Biol. 10: e1003846.DOI
- [52]Takeuchi T, Duszkiewicz AJ, Morris RGM (2014) The synaptic plasticity and memory hypothesis: encoding, storage and persistence. Phil. Trans. R. Soc. B 369: 20130288.DOI
- [53]Urban P, Tabar VR, Denkiewicz M, Bokota G, Das N, et al (2020) The mixture of autoregressive hidden Markov models of morphology for dendritic spines during activation process. J. Comput. Biol. 27: 1471-1485.DOI
- [54]Van Baalen M (2000) Pair approximation for different spatial geometries. In: The Geometry of Ecological Interactions: Simplifying Spatial Complexity. Eds: Dieckmann U et al, pp. 359-387. Cambridge Univ. Press.
- [55]Van den Broeck C, Esposito M (2015) Ensemble and trajectory thermodynamics: A brief introduction. Physica A 418: 6-16.
- [56]Volgushev M, et al (2004) Probability of transmitter release at neocortical synapses at different temperatures. J. Neurophysiol. 92: 212-220.pubmed.ncbi.nlm.nih.gov/14999046
- [59]Yang G, Pan F, Gan W-B (2009) Stably maintained dendritic spines are associated with lifelong memories. Nature 462: 920-924.DOI
- [60]Yasumatsu N, Matsuzaki M, Miyazaki T, Noguchi J, Kasai H (2008) Principles of long-term dynamics of dendritic spines. J. Neurosci. 28: 13592-13608.DOI