betaFeedback

WorksPhysics and Astronomy

Statistical mechanics of spontaneous behavior

Abstract

Why do a few behaviors fill most of an animal's time? The usual answer is that these behaviors are started more often, because learning and reinforcement favor them. Here we show that how long a behavior lasts can, by itself, explain much of what is observed. We consider a system that runs until it meets a constraint, such as a wall, and then resets. The fraction of time it spends in each behavior then follows the Boltzmann law, and the partition function is the mean time between resets. The four laws of thermodynamics follow as theorems from four postulates, and critical points that act as bottlenecks become the most occupied states. In 47 multi-day recordings of fruit flies, the dominant behavior accounts for only 13%13\% of bout starts yet fills 49%49\% of the time, and its typical duration identifies the individual fly. These results lay the groundwork for a statistical mechanics of behavior.

Place a fly in a closed box and record what it does. The record has a recognizable shape. Long stretches of circling alternate with short crossings and rare collisions with a wall, and of everything the fly could do, a few behaviors take up most of its time. The same is true of any agent whose activity is interrupted by encounters with a constraint, whether that constraint is a wall, the limit of its own body, or an exhausted energy reserve.

Two quantities summarize such a record. The frequency of a behavior is how often it is started, and its duration is how long it lasts once started. The time a behavior fills is the product of the two, so a behavior can dominate because it is started often or because it lasts long. The main theories of behavior, such as reinforcement learning and choice theory, explain dominance through frequency. They ask which action is selected and treat its duration as a detail.

Here we ask what a record looks like when nothing favors one behavior over another, so that only duration varies. The answer is a null theory, which plays the role that the ideal gas plays in thermodynamics. We show that this null theory is a complete statistical mechanics. The time share of each behavior follows the Boltzmann law, the partition function is the mean time between two encounters with the constraint, and the four laws of thermodynamics follow as theorems from four postulates. Dominance, the matching law, individuality, and criticality all emerge without assigning value to any behavior. Formally the construction belongs to stochastic resetting [1, 2], with one difference that matters. The reset is triggered when the system reaches the constraint, and this is what makes the partition function a time. We state the postulates, derive the free energy and the four laws, and test the theory in three simulated systems and in 47 multi-day fly recordings.

The postulates. P0 (behavior). An observer chooses a finite set of observables, such as position and heading, and a time resolution. The behavior of a system over a record is then its path t↦Xtt \mapsto X_t through the space X\mathcal{X} that these observables span [3, 4]. Because the observables are a choice, one animal supports many behaviors, and the laws below hold for each. The dynamics of XtX_t depends on a hidden parameter a∈Aa \in\mathcal{A}, which we call an affordance, after Gibson’s term for what a situation offers an agent to do [5]. Each value of aa fixes one regime of the dynamics, for example circling or crossing. We also call it a mode. Finally, a region D⊂XD \subset\mathcal{X} is bounded by the constraint C=∂DC = \partial D. The constraint need not be a wall. A joint at the end of its range or a depleted energy store ends a bout in the same way.

P1 (reset). With the affordance aa held fixed, the observable follows a memoryless (Markov) dynamics until its path reaches the constraint CC. At that contact two things happen. The observable restarts from a fixed starting distribution, the injection law, and a new affordance is drawn from the resampling law λ\lambda. We call this an affordance-reset process. Since λ\lambda sets how often each affordance is started, it is the frequency of the theory. The stretch between two contacts is an excursion. Its length τa=inf⁡{t:Xt∈C}\tau^a = \inf\{t : X_t \in C\} is the duration, and its mean m(a)=E[τa]m(a) = \mathbb{E}[\tau^a] is the dwell of aa. Our reference system throughout is a diffusion in a box,

dXt=[aω(−Yt,Xt)+(1−a)v] dt+σ dWt,(1)\mathrm{d}X_t = [a\omega(-Y_t,X_t) + (1-a)\mathbf{v}]\,\mathrm{d}t + \sigma\,\mathrm{d}W_t, \tag*{(1)}

where a=1a = 1 is pure rotation, which the geometry traps, and a=0a = 0 is pure drift, which crosses the box ballistically Figure 1(a). Between the two the dwell rises by more than an order of magnitude Figure 1(b).

Three panels showing two behaviors, dwell time, and occupation

Figure 1. The box, Eq. (1). (a) Two behaviors from one dynamics. Circling (a=0.96a = 0.96, blue) is trapped and drift (a=0.10a = 0.10, red) crosses. (b) The dwell m(a)m(a) rises from the ballistic crossing time 0.65≈L/∣v∣0.65 \approx L/|v| to the diffusive escape time 9.2≈L2/2σ29.2 \approx L^2/2\sigma^2. (c) Occupation pβ(a)p_\beta(a), where β\beta is the strength of the agent’s response to reward (see Reward). With no reward (β=0\beta= 0) and a uniform frequency the record is dominated by circling through duration alone. As reward for reaching the wall grows (β=3,8\beta= 3, 8) drift takes over. Parameters L=1L = 1, ω=6\omega= 6, ∣v∣=1.6|v| = 1.6, σ=0.24\sigma= 0.24, over ∼8×105\sim8 \times10^5 excursions.

P2 (the ensemble is time). Ordinary statistical mechanics averages over many copies of a system. Here there is one record and no copies, so the only primitive quantity is the occupation, the fraction of a window of length twt_w that each mode fills, p^tw(da)=tw−1∫0tw1(at∈da) dt′\hat{p}_{t_w}(da) = t_w^{-1}\int_0^{t_w}\mathbf{1}(a_t \in da)\,\mathrm{d}t'. Equilibrium means that this fraction has a limit as tw→∞t_w \to\infty. That limit plays the role of the thermodynamic limit, so in this theory *system size is recording duration. Under P1 successive excursions are independent and form a renewal process, and the renewal reward theorem [6] gives the long-run occupation,

p0(da)=m(a)λ(da)Z0,Z0=∫m dλ=⟨τ⟩λ.(2)p_0(\mathrm{d}a) = \frac{m(a)\lambda(\mathrm{d}a)}{Z_0}, \qquad Z_0 = \int m\,\mathrm{d}\lambda= \langle\tau\rangle_\lambda. \tag*{(2)}

In words, the time share of a mode is its frequency times its dwell, divided by the mean duration of an excursion. This is a Gibbs measure written in the two variables of the record. The frequency λ\lambda plays the role of the density of states, the dwell mm that of the Boltzmann weight, and the partition function Z0Z_0 is the mean cycle time. Equation (2) treats all modes alike. A mode that holds the system longer is simply observed for longer, an effect statisticians call length-biased sampling. This is why circling dominates the box even when every mode is started equally often [Figure 1(c), blue]. The agreement of time and ensemble averages, which ordinary statistical mechanics must assume, is here a theorem.

P2 also limits what a finite record can reveal. A window of length twt_w contains about N=tw/Z0N = t_w/Z_0 excursions, and the occupation measured in it fluctuates around p0p_0 with variance χ/N\chi/N, where χ\chi is given in the SM. The number of excursions thus plays the part of the number of particles in a finite gas.

P3 (the dictionary). It remains to name temperature and energy. For a diffusion in a potential landscape with noise strength σ\sigma, the exit theory of Freidlin and Wentzel [7] shows that the dwell grows exponentially in 1/σ21/\sigma^2, σ2log⁡E[τa]→Jˉa\sigma^2 \log\mathbb{E}[\tau^a] \to\bar{J}^a, where Jˉa\bar{J}^a is twice the barrier to the easiest exit. Because Jˉa\bar{J}^a is a property of the landscape and does not depend on the noise, the natural way to write the dwell as a Boltzmann factor is

T:=σ2,E(a):=−Jˉa,m(a)=e−E(a)/T.(3)T := \sigma^2, \qquad E(a) := -\bar{J}^a, \qquad m(a) = e^{-E(a)/T}. \tag*{(3)}

The energy of a behavior is therefore minus its exit barrier, so a deep trap is a low-energy state. The environment sets the energies, while the temperature (the agent’s noise) and the frequency belong to the agent.

The potential. As in thermodynamics, the theory is organized around a free energy and its derivatives. The free energy of one excursion is F=−Tlog⁡(Z0/τ0)F = -T \log(Z_0/\tau_0), with τ0\tau_0 a reference time, and a record of NN excursions has total free energy Φ=NF\Phi= NF, so NN plays the role of system size, with conjugate F=∂Φ/∂NF = \partial\Phi/\partial N. The free energy FF depends on four controls. These are the temperature TT, the volume ∣D∣|\mathcal{D}| of the domain D\mathcal{D}, the strength β\beta of a reward field introduced below, and the propensities μi\mu_i. The propensities are the shares of the frequency given to groups of behaviors, with ∑iμi=1\sum_i \mu_i = 1. Each control has a conjugate, the partial derivative of FF with respect to that control with the others held fixed,

dF=−S dT−Π d∣D∣−Υ dβ+∑iνi dμi.(4)\mathrm{d}F = -S\,\mathrm{d}T - \Pi\,\mathrm{d}|\mathcal{D}| - \Upsilon\,\mathrm{d}\beta+ \sum_i \nu_i\,\mathrm{d}\mu_i. \tag*{(4)}

All conjugates are per excursion, and those of the whole record follow by multiplying by NN. Each has a behavioral reading. The entropy S=−∂F/∂TS = -\partial F/\partial T measures how far the occupation departs from the frequency. It equals minus the relative entropy −∫p0log⁡(p0/λ)-\int p_0 \log(p_0/\lambda), so it vanishes when duration plays no role. The pressure Π=−∂F/∂∣D∣\Pi= -\partial F/\partial|\mathcal{D}| is the response of the free energy to enlarging the domain. The mean reward Υ=−∂F/∂β\Upsilon= -\partial F/\partial\beta is TT times the average reward of the record. The behavioral chemical potential νi=∂F/∂μi\nu_i = \partial F/\partial\mu_i is the free-energy cost of shifting frequency into group ii. Proofs are in the SM.

The four laws. Each law is a theorem of P0 to P3 (Table S1 in the SM). For each one we state what frequency can do and what duration does.

LawStatementCorollaries / test
0than intensive viv_i exists, equalizes, is transitivematching law s=T/Tμs = T/T_\mu [Eqs. (5),(6)], no learning
1stevery change of UU is heat or work, one function FF behind every conjugateMaxwell relations, global = local (non-circular), equation of state [Eq. (10)]
2ndD(qn∥ρ)↓D(q_n\Vert\rho) \downarrow and S˙obs≥0\dot{S}_{\mathrm{obs}} \ge0 [Eq. (8)]monotone relaxation, arrow of time measurable in data
3rddegeneracy of p0p_0 = divergence of the clock Z0Z_0 [Eq. (9)], unattainable in finite timeground-state collapse, critical point = ground state, aging N∼twαN \sim t_w^\alpha beyond the edge

Table S1. The four laws of the affordance-reset thermodynamics. Each law is a theorem of postulates P0 to P3. The table gives its statement, its corollaries, and the test that checks it.

Zeroth law (a common scale exists). We first need the time allocated among options. Split the repertoire into disjoint groups AiA_i, for example the options of a choice task. Let μi\mu_i be the propensity of AiA_i, the share of fresh affordances drawn from it, and let Zi=∫Aim dλiZ_i = \int_{A_i} m\,d\lambda_i be the mean dwell of a visit to it, with λi\lambda_i the frequency within AiA_i. Since the agent enters AiA_i at a rate proportional to μi\mu_i and each visit lasts ZiZ_i on average, the renewal argument behind Eq. (2) gives

pi=μiZi∑jμjZj.(5)p_i = \frac{\mu_i Z_i}{\sum_j \mu_j Z_j}. \tag*{(5)}

With uniform propensities, that is with no preference, reward, or learning, this reduces to pi∝Zip_i \propto Z_i. The time allocated to an option is then proportional to its dwell, with slope one [Fig. 2(a), heavy line]. This is the matching law of operant psychology [8, 9], the central law of choice, here produced by duration alone.

The zeroth law itself concerns what happens when propensity can flow between groups. The chemical potential viv_i is the cost of moving a little frequency into AiA_i, and at equilibrium it is equal across groups. Because it is a single number, this equality is transitive. If A1A_1 is in equilibrium with A2A_2 and A2A_2 with A3A_3, then A1A_1 is in equilibrium with A3A_3, and vv serves as a common scale, as temperature does in the classical law. If allocating propensity carries a mixing entropy at a temperature TμT_\mu, equalizing vv redistributes propensity as μi∝Zis\mu_i \propto Z_i^s, the generalized matching law, with sensitivity

s=TTμ,(6)s = \frac{T}{T_\mu}, \tag*{(6)}

where TμT_\mu measures how strongly the agent resists concentrating its propensity on a few groups [SM]. The theory therefore predicts undermatching, the empirically common case (median s=0.83s = 0.83 for responses and 0.920.92 for time in Baum’s survey [10, 11]), whenever the agent’s noise TT is smaller than TμT_\mu [Fig. 2(a,b), shaded].

First law (heat, work, and a state function). Let U=⟨E⟩p0U = \langle E\rangle_{p_0} be the mean energy of the record, that is, the time average of minus the exit barrier of the current mode. A record that spends its time in deep traps has low UU. When a control such as the noise TT or the box size ∣D∣|D| is changed slowly, UU changes for two reasons. Either the record redistributes its time among the modes while their energies stay fixed, or the environment shifts the energies while the time shares stay fixed. The first change is heat, and for a Gibbs occupation it equals exactly T dST\,dS [SM]. The second is work, and its volume part is −Π d∣D∣-\Pi\,d|D|,

dU=∫E dp0⏟δQ=T dS+∫p0 dE⏟δW=−Π d∣D∣.(7)dU = \underbrace{\int E\,dp_0}_{\delta Q = T\,dS} + \underbrace{\int p_0\,dE}_{\delta W = -\Pi\,d|D|}. \tag*{(7)}

Because the environment sets the energies directly, the law here carries no conservation statement. Its content is the decomposition itself. Every change of UU is heat or work, and every conjugate in Eq. (4) derives from the single function FF. This has testable consequences. The pressure measured from the response to volume must agree with the one computed from the mean cycle time, and the mixed derivatives must obey Maxwell relations such as ∂Π/∂β=∂γ/∂∣D∣\partial\Pi/\partial\beta= \partial\gamma/\partial|D| [SM]. The entropy is concave in the energy with slope exactly 1/T1/T [Fig. 2(c)]. The law requires a reward that does not depend on the box geometry, because otherwise the force measured from the geometry is not a derivative of FF.

Second law (two irreversibilities). The second law appears in two forms. The first concerns the approach to equilibrium, and the second concerns the equilibrium record itself. Relaxation toward the Gibbs occupation is monotonic. For any resampling rule with stationary law ρ\rho, the distribution qnq_n of the mode after nn excursions obeys D(qn+1∥ρ)≤D(qn∥ρ)D(q_{n+1}\|\rho) \le D(q_n\|\rho), so the distance to equilibrium can only decrease, an HH-theorem [12] [SM]. The equilibrium record also has a direction in time, and it enters at the reset. At each contact many different states are sent back to the same injection point, and this map cannot be run backward. The observed sequence is therefore irreversible even when the affordance is resampled symmetrically. Its entropy production is the occupation average of S˙exc(a)\dot S_{\mathrm{exc}}(a), the rate at which excursions in mode aa produce entropy through their reset,

S˙obs=⟨S˙exc⟩p0≥0,(8)\dot S_{\mathrm{obs}} = \langle\dot S_{\mathrm{exc}}\rangle_{p_0} \ge0, \tag*{(8)}

with equality only when there is no reset [13, 14]. In data, the irreversibility I\mathcal{I}, the relative entropy between the statistics of the observed transitions and those of the same record played backward, gives a measurable lower bound on it [SM].

Third law (unattainability). The classical third law says that absolute zero cannot be reached in finite time. Its counterpart here is that no record can be completely dominated by one behavior in finite time. Let G\mathcal{G} be a set of modes that are candidates to dominate, and suppose the other modes are still started, with frequency λ(Gc)>0\lambda(\mathcal{G}^{c}) > 0. Every excursion lasts at least the fastest crossing of the domain, τmin⁡\tau_{\min}, so each cycle spends on average at least τmin⁡λ(Gc)\tau_{\min}\lambda(\mathcal{G}^{c}) outside G\mathcal{G}. Dividing by the mean cycle time gives

Z0≥τmin⁡λ(Gc)p0(Gc).(9)Z_0 \ge\frac{\tau_{\min}\lambda(\mathcal{G}^{c})}{p_0(\mathcal{G}^{c})}. \tag*{(9)}

Pushing the time share outside G\mathcal{G} toward zero therefore requires the mean cycle time to grow without limit. The bound shows how differently the two variables act. Frequency is bounded, λ≤1\lambda\le1, so it can make one behavior fill the record only by never starting the others. Duration is unbounded, so it can make one behavior fill the record with the repertoire intact, but only by making excursions ever longer. A record of length twt_w contains N=tw/Z0N = t_w/Z_0 excursions and knows its own occupation only through a scatter χ/N\chi/N [P2]. As the occupation concentrates, Z0Z_0 grows, NN falls below one, and the window becomes a single unfinished excursion. No finite record ever shows a fully dominated occupation. In classical thermodynamics this unattainability is an independent principle, or requires additional resource assumptions [15]. Here it is a theorem, because the partition function is itself a time.

Zeroth and first laws

Figure 2. Zeroth and first laws. (a) Log ratios against the dwell ratio of two options. Time shares p1/p2p_1/p_2 with uniform propensity give strict matching [Eq. (5), heavy line]. Propensities μ1/μ2\mu_1/\mu_2 after exchange follow the generalized matching law μi∝Zis\mu_i \propto Z_i^s when the groups are kept separate (quenched, dashed) and bend when they are pooled (annealed, dotted) [SM]. (b) The sensitivity ss measured from the slope in (a) against T/TμT/T_\mu [Eq. (6)]. Undermatching (s<1s < 1, shaded) is the regime T<TμT < T_\mu. (c) The entropy against the mean energy, for the trap ensemble with Tλ=1T_\lambda= 1, is concave with slope 1/T1/T, as the first law requires.

The limit itself is still informative. As the noise TT goes to zero the occupation collapses onto the mode with the deepest exit barrier, G=arg max⁡aJˉaG = \operatorname{arg\,max}_a \bar{J}^a, which is the longest-dwelling mode, and the entropy tends to log⁡λ(G)\log\lambda(G) [SM]. A record concentrated on its most persistent behavior looks optimized, yet nothing has been optimized. A Gibbs measure has simply concentrated on its energy minimum, as a cooled gas does, and the recording time needed to observe this grows with Z0Z_0 without bound.

Criticality. The energy minimum has a further identity. When an excursion must pass through a bottleneck near a continuous transition, the passage time diverges, the phenomenon called critical slowing down. The critical point is then the longest-dwelling affordance, so it minimizes E=−Tlog⁡mE = -T \log m and is the ground state. Duration alone parks the record at the critical point. Figure 3 shows the simplest case, a saddle-node bottleneck

The critical point is the ground state and excursion durations are scale-free

Figure 3. The critical point is the ground state. Saddle-node bottleneck, critical at ϵc=0\epsilon_c = 0. (a) From a uniform frequency λ(ϵ)\lambda(\epsilon) (blue) the occupation p(ϵ)∝m(ϵ)p(\epsilon) \propto m(\epsilon) (red) piles up at the critical point. (b) Excursion durations are scale-free, P(τ)∼τ−3P(\tau) \sim\tau^{-3} (dashed), cut off by noise. Inset, the collapse τ2/3P(τ)\tau^{2/3}P(\tau) against τσ2/3\tau\sigma^{2/3}. X0=3X_0 = 3, uniform ϵ\epsilon on (0,1)(0, 1), σ=0.15\sigma= 0.15 in (a).

dx=(ϵ+x2) dt+σ dWt,dx = (\epsilon+ x^2)\,dt + \sigma\,dW_t,

reinjected at −X0-X_0 on reaching X0X_0, in which the control parameter ϵ\epsilon is the affordance and ϵc=0\epsilon_c = 0 is critical. The passage time grows as π/ϵ\pi/\sqrt{\epsilon}, so from a flat frequency the occupation piles up at ϵc\epsilon_c as ϵ−1/2\epsilon^{-1/2} [Figure 3(a)]. Because each ϵ\epsilon maps to one duration, the durations follow a power law, P(τ)∼τ−3P(\tau) \sim\tau^{-3}, up to a cutoff set by the noise, τ∗∼σ−2/3\tau^* \sim\sigma^{-2/3} [Figure 3(b)]. Observed criticality is usually read as evidence of tuning or of a self-organizing feedback [16, 17]. Here it is the null expectation for any repertoire that straddles such a transition, and it must be excluded before criticality is attributed to adaptation.

A power law of durations is the signature of a heavy-tailed repertoire, where the third law takes a sharper form. Suppose the frequency itself has a Boltzmann form in the exit barriers, λ(Jˉ)∝e−Jˉ/Tλ\lambda(\bar{J}) \propto e^{-\bar{J}/T_\lambda}, with TλT_\lambda setting how

fast the frequency decays with barrier depth. This is the trap ensemble of Bouchaud [18, 19]. The partition function is then Z0=T/(T−Tλ)Z_0 = T/(T - T_\lambda) [SM]. It is finite when the noise TT exceeds TλT_\lambda and diverges at T=TλT = T_\lambda, a point we call the ergodic edge, because there time averages stop converging. Beyond the edge, T<TλT < T_\lambda, the number of excursions in a window grows more slowly than the window, N(tw)∼twαN(t_w) \sim t_w^\alpha with α=T/Tλ<1\alpha= T/T_\lambda< 1. As in the trap model, the occupation of a window is then expected to remain random at all times, which is called weak ergodicity breaking, and the statistics of a record change with its length, which is called aging [18, 19]. The exponent α\alpha can be read off the tail of the measured durations, so the duration exponent of a record tells how far it is from the edge.

Reward. So far every mode has been treated alike. Now let each mode get a return a reward Ψ(a)\Psi(a) when it is run, and let the agent respond by a simple local rule, win-stay/lose-sample. After a rewarding excursion the agent keeps the current affordance, and otherwise it draws a fresh one from λ\lambda. This rule changes only how often each

mode is started. Its steady state is the tilted frequency λeβΨ\lambda e^{\beta\Psi}, where β\beta measures how strongly the agent responds to reward [SM], so the occupation becomes pβ∝mλeβΨp_\beta\propto m\lambda e^{\beta\Psi}. Reward therefore acts on frequency as an external field, in the role a magnetic field plays for a spin system, and leaves duration untouched. Because dominance is measured in time, a reward that favors a short behavior must first overcome the advantage that long behaviors gain from length-biased sampling. We call this advantage the entropic force, because it arises purely from how time is counted. The crossover between the two regimes is abrupt. Two modes exchange dominance at the field β∗=[log⁡(m1/m2)+log⁡(λ1/λ2)]/(Ψ2−Ψ1)\beta^* = [\log(m_1/m_2) + \log(\lambda_1/\lambda_2)]/(\Psi_2 - \Psi_1), as in a first-order phase transition, and the price of crossing is the dwell ratio log⁡(m1/m2)\log(m_1/m_2), the analogue of a latent heat. In the box, reward for reaching the wall favors drift, yet the field must reach β≈4\beta\approx4 before drift displaces circling [Fig. 1(c)].

Equation of state. The geometry of the domain also has a conjugate. Differentiating the free energy with respect to the volume of the domain gives the pressure, which takes an ideal-gas form,

Π∣D∣=T⟨ζ⟩p0,ζ(a):=∂log⁡m(a)∂log⁡∣D∣,(10)\Pi|D| = T \langle\zeta\rangle_{p_0}, \qquad\zeta(a) := \frac{\partial\log m(a)}{\partial\log|D|}, \tag*{(10)}

where ζ(a)\zeta(a) measures how fast the dwell of mode aa grows as the domain is enlarged. For a mode that escapes by diffusion the dwell grows as the square of the linear size, so ζ=2/d\zeta= 2/d in dd dimensions. For a mode that crosses ballistically it grows linearly, so ζ=1/d\zeta= 1/d. The pressure therefore measures how much of the record is trapped and how much is ballistic.

Verification in three systems. We test each relation in three systems chosen to share as little mechanism as possible. In each, the prediction uses only dwells measured without reward, and it is compared with an independent simulation of the dynamics [SM]. In the box (d=2d = 2) the measured exponents are ζ=0.964\zeta= 0.964 for circling and 0.4960.496 for drift, against the predicted 1 and 1/2. When win-stay/lose-sample is simulated with a real reward field, circling and drift share the record equally at β=3.89±0.04\beta= 3.89 \pm0.04, against 3.85 predicted from the unrewarded dwells. The global free energy computed from the mean cycle time agrees with the integral of the local pressure to within 1 to 3%. In a one-dimensional decision process ζ\zeta runs from 2/d=22/d = 2 to 1/d=11/d = 1, following the prediction to within 0.016. Finally, a Braitenberg vehicle [20], a robot whose affordance is a sensorimotor wiring that is rewired at each wall contact, has an occupation that matches mλ/Z0m\lambda/Z_0 to within 1.1×10−31.1 \times10^{-3} in total variation [SM].

The fly records. We test the two variables on 47 multiday recordings of Drosophila [21], each 1.3 to 7.8 days long and labeled into nine behavioral states [SM, Fig. 4]. In the data an excursion is a bout. The counterpart of the frequency λ\lambda is the election share of a state, the fraction

of bouts that begin in it, and the counterpart of the dwell mm is its mean bout duration. The idle state is elected on a median 13% of bouts yet fills 49% of the record, and the most-elected state differs from the most-occupied one in 46 of 47 flies [Fig. 4(a)]. Dominance is manufactured by duration.

Duration also carries individuality. When each record is split into two halves, the mean idle dwell of a fly replicates between the halves at r=0.85r = 0.85, so that 91% of its variation across flies is a stable trait of the individual (split-half reliability corrected to full record length). The election share replicates at only r=0.24r = 0.24, with 39% stable. The identity of a fly is carried by its duration scale, and its frequency is the fluctuating part. Finally, the records show anomalous scatter. In every fly the scatter of the idle occupation across windows decays with an exponent between −0.07-0.07 and −0.50-0.50, where the finite-variance law gives −1-1 [Fig. 4(b)], and the idle durations have tail exponents from 0.56 to 1.70, median 0.77. Both are consistent with a repertoire near the ergodic edge, where this anomalous scatter is expected.

Discussion. Several features of behavior that are usually read as signs of design turn out to be consequences of one free energy. Dominance is the Gibbs weight, the matching law is length-biased sampling, apparent optimality is the ground-state collapse of the third law, and criticality is the ground state itself. All of them are properties of duration, the variable that theories of choice set aside. Once this null part is subtracted, what remains is what a genuine account of reward must explain, and each law comes with its own test (Table S1 in the SM). The laws are verified in a diffusing particle, a decision process, and a self-rewiring robot, and the fly records show the duration structure they rest on. Like the laws of thermodynamics across substances, they are theorems of the renewal structure, and so they carry over to any mechanism that realizes it.

D.Y.T. was supported by CNPq grants 421955/2023-6 and 445096/2024-1, FAPESP grant 2013/07699-0, and Serrapilheira grant R-2401-47364. A.E.H. acknowledges support by the DFG German Research Foundation (EXC 2117-422037984) and the Human Frontier Science Program (RGP006/2025). We thank the Princeton Drosophila data initiative for the public dataset.1

Supplemental Material for Statistical mechanics of spontaneous behavior

Daniel Yasumasa Takahashi; Ahmed El Hady

This Supplemental Material gives the proofs of the results stated in the Letter, together with the numerical methods behind every quoted number. Section and equation numbers prefixed by S refer to this document, and unprefixed numbers refer to the Letter. Throughout we assume that relaxation within a basin is fast compared with the dwell, so that each excursion is quasi-stationary, that the embedded affordance chain is positive Harris recurrent, so that it has a unique stationary law, and that the mean cycle time is finite, Z0<∞Z_0 < \infty. The small-noise results of § 3.1 further assume that the noise σ\sigma is small. § 6 is the one exception, since there the failure of Z0<∞Z_0 < \infty is itself the subject. Table S1 collects the four laws with their corollaries and tests.

The Occupation Law

We prove Eq. (2). Between two consecutive contacts with the constraint, the affordance stays fixed at a value drawn from λ\lambda for a random duration τ\tau with E[τ∣a]=m(a)\mathbb{E}[\tau\mid a] = m(a). The sequence of pairs (ξi,τi)(\xi_i,\tau_i), in which the ξi∼λ\xi_i \sim\lambda are independent and identically distributed (i.i.d.) and τi\tau_i is the iith dwell, is therefore a marked renewal process, a renewal process whose cycles each carry a label. For a bounded test function gg, the renewal reward theorem gives the long-run time average

lim⁡t→∞1t∫0tg(at′) dt′=E[g(ξ)τ]E[τ]=∫g(a)m(a) λ(da)∫m dλa.s.,(11)\lim_{t \to\infty} \frac{1}{t}\int_0^t g(a_{t'})\,\mathrm{d}t' = \frac{\mathbb{E}[g(\xi)\tau]}{\mathbb{E}[\tau]} = \frac{\int g(a)m(a)\,\lambda(\mathrm{d}a)}{\int m\,\mathrm{d}\lambda}\quad\text{a.s.}, \tag*{(11)}

because the numerator is the expected reward ∫0τg dt′=g(ξ)τ\int_0^\tau g\,\mathrm{d}t' = g(\xi)\tau accumulated per cycle and the denominator is the mean cycle length. Identifying the right-hand side with ∫g dp0\int g\,\mathrm{d}p_0 yields

p0(da)=m(a)λ(da)Z0,Z0=∫m dλ=⟨τ⟩λ,(12)p_0(\mathrm{d}a) = \frac{m(a)\lambda(\mathrm{d}a)}{Z_0}, \qquad Z_0 = \int m\,\mathrm{d}\lambda= \langle\tau\rangle_\lambda, \tag*{(12)}

valid whenever Z0<∞Z_0 < \infty. If the affordance is instead redrawn from a Markov kernel KK, the excursions form a Markov-renewal process, and the same length-biased argument applied to the stationary law ρ\rho of the embedded chain (ξi)(\xi_i) gives p(da)=m(a)ρ(da)/∫m dρp(\mathrm{d}a) = m(a)\rho(\mathrm{d}a) / \int m\,\mathrm{d}\rho [6], of which Eq. (12) is the special case ρ=λ\rho= \lambda. The condition Z0<∞Z_0 < \infty is precisely what makes the free energy F=−Tlog⁡(Z0/τ0)F = -T\log(Z_0/\tau_0) well defined, and its failure, which is the loss of ergodicity, is taken up in § 6. Finally, the almost-sure convergence in Eq. (11) turns postulate P2, the equivalence of time and ensemble averages, into a theorem.

Finite records and the fluctuation law

By P2 a finite record is a finite system, and its size is the number of completed excursions. For a window tw=∑k≤Nτkt_w = \sum_{k \le N} \tau_k and a measurable A⊂AA \subset\mathcal{A}, the error of the empirical occupation decomposes over excursions,

p^A−pA=1tw∑k≤Nηk,ηk=(1A(ξk)−pA)τk,(13)\hat{p}_A - p_A = \frac{1}{t_w}\sum_{k \le N}\eta_k,\qquad\eta_k = (\mathbf{1}_A(\xi_k)-p_A)\tau_k, \tag*{(13)}

where p^A\hat{p}_A is the empirical occupation measure and the ηk\eta_k are i.i.d. with mean zero, the mean vanishing by Eq. (12) itself. The central limit theorem for renewal reward processes [22] then gives

Var⁡(p^A)=χAN+o(N−1),χA=E[(1A(ξ)−pA)2τ2]Z02,N=twZ0.(14)\operatorname{Var}(\hat{p}_A) = \frac{\chi_A}{N} + o(N^{-1}),\qquad\chi_A = \frac{\mathbb{E}[(\mathbf{1}_A(\xi)-p_A)^2\tau^2]}{Z_0^2},\qquad N = \frac{t_w}{Z_0}. \tag*{(14)}

In a numerical test on a five-mode ensemble with exponential dwells and N=400N = 400, the measured and predicted variances over 4000 independent records agree to 0.1% (ratio 1.001), with bias O(1/N)O(1/N). Equation (S4) plays three roles. It is the finite-size scaling of the theory, it predicts how the scatter of matching data shrinks with session length, and it serves as the ruler for the third law (§ 6). Because a record resolves its own occupation only to accuracy χAZ0/tw\sqrt{\chi_A Z_0/t_w}, any limit in which Z0Z_0 diverges is one in which the record can no longer display its equilibrium.

The small-noise dictionary

We justify Eq. (3) by specializing the observable dynamics to a gradient diffusion in a single basin,

dXt=−∂xV(Xt,a) dt+σ dWt,(15)\mathrm{d}X_t = -\partial_x V(X_t,a)\,\mathrm{d}t + \sigma\,\mathrm{d}W_t, \tag*{(15)}

started at the bottom x∗(a)x^*(a) of the well, with the constraint CC placed on the basin boundary. The Freidlin and Wentzell theory of exit times [7] then gives

lim⁡σ→0σ2log⁡E[τa]=inf⁡t>0,y∈C{12∫0t(ϕ˙s+∂xV(ϕs,a))2 ds:ϕ0=x∗, ϕt=y}=:Jˉa.(16)\lim_{\sigma\to0}\sigma^2\log\mathbb{E}[\tau^a] = \inf_{\substack{t>0,\,y\in C}} \left\{\frac{1}{2}\int_0^t(\dot{\phi}_s+\partial_xV(\phi_s,a))^2\,\mathrm{d}s:\phi_0=x^*,\,\phi_t=y\right\} =: \bar{J}^a. \tag*{(16)}

For a gradient field the action-minimizing path is the time reversal of the noiseless relaxation into the well, along which ϕ˙=+∂xV\dot{\phi}=+\partial_xV, so the integrand is 2∂xV ϕ˙2\partial_xV\,\dot{\phi} and

Jˉa=2[V(y∗(a),a)−V(x∗(a),a)],(17)\bar{J}^a = 2[V(y^*(a),a)-V(x^*(a),a)], \tag*{(17)}

which is twice the height of the barrier to the easiest exit point y∗y^*. The mean dwell therefore grows as E[τa]≍eJˉa/σ2\mathbb{E}[\tau^a]\asymp e^{\bar{J}^a/\sigma^2}, which is Kramers’ law, and writing m(a)=e−E(a)/Tm(a)=e^{-E(a)/T} suggests the identification

T:=σ2,E(a):=−Jˉa,(18)T:=\sigma^2,\qquad E(a):=-\bar{J}^a, \tag*{(18)}

to the leading exponential order.

Zeroth law, chemical potential and matching

Partition the repertoire into disjoint sub-repertoires AiA_i with propensities μi\mu_i (∑iμi=1\sum_i\mu_i=1) and conditional laws λi\lambda_i, so λ=∑iμiλi\lambda=\sum_i\mu_i\lambda_i and

Z0=∑iμiZi,Zi:=∫Aim dλi,(19)Z_0=\sum_i\mu_i Z_i,\qquad Z_i:=\int_{A_i}m\,\mathrm{d}\lambda_i, \tag*{(19)}

with ZiZ_i the mean dwell conditioned on entering AiA_i. Allocating propensity among the groups carries a mixing entropy at a temperature TμT_\mu, and the resulting free energy depends on whether the sub-repertoires are pooled (annealed) or kept separate (quenched),

annealed:Fa(μ)=−Tlog⁡(∑iμiZi)+Tμ∑iμilog⁡μi,(20)\text{annealed:}\qquad F_{\mathrm{a}}(\mu)=-T\log\left(\sum_i\mu_iZ_i\right)+T_\mu\sum_i\mu_i\log\mu_i, \tag*{(20)}
quenched:Fq(μ)=−T∑iμilog⁡Zi+Tμ∑iμilog⁡μi.(21)\text{quenched:}\qquad F_{\mathrm{q}}(\mu)=-T\sum_i\mu_i\log Z_i+T_\mu\sum_i\mu_i\log\mu_i. \tag*{(21)}

The behavioral chemical potential is vi=∂F/∂μiv_i = \partial F/\partial\mu_i. Making FF stationary under the constraint ∑iμi=1\sum_i \mu_i = 1 equalizes it across groups, vi=vjv_i = v_j, and because viv_i is a single number this equality is transitive, which is the content of the zeroth law. The equalized allocation is

annealed:μi∝exp⁡[TTμZiZ0](self-consistent),quenched:μi∝Zis,s=TTμ=σ2Tμ(22)\begin{aligned} \text{annealed:}\quad&\mu_i \propto\exp\left[\frac{T}{T_\mu}\frac{Z_i}{Z_0}\right]\quad\text{(self-consistent)},\qquad \text{quenched:}\quad\mu_i \propto Z_i^s,\quad s=\frac{T}{T_\mu}=\frac{\sigma^2}{T_\mu} \tag*{(22)} \end{aligned}

The quenched result is the generalized matching law with sensitivity ss, so strict matching corresponds to T=TμT=T_\mu and undermatching (s<1s<1) to σ2<Tμ\sigma^2<T_\mu. Time allocation is the length-biased image of choice,

pi=μiZi∑jμjZj,(23)p_i=\frac{\mu_i Z_i}{\sum_j \mu_j Z_j}, \tag*{(23)}

so uniform propensity μi=1/n\mu_i=1/n already gives pi∝Zip_i\propto Z_i, which is strict matching in time, with unit sensitivity and without any learning.

First law, heat and work, and the state function

In this thermodynamics the first law states that a single state function stands behind every operationally measured force, and that every change of the mean energy is exactly heat or work. We first assemble the potential, then prove the decomposition, and finally verify exactness.

The potential and its conjugates

The per-excursion free energy is F=−Tlog⁡(Z0/τ0)F=-T\log(Z_0/\tau_0) and the total potential over a record of NN excursions is Φ=NF\Phi=NF. From p0=e−E/Tλ/Z0p_0=e^{-E/T}\lambda/Z_0,

S=−D(p0∥λ)=⟨E⟩p0T+log⁡Z0τ0=−∂F∂T,(24)S=-D(p_0\Vert\lambda)=\frac{\langle E\rangle_{p_0}}{T}+\log\frac{Z_0}{\tau_0}=-\frac{\partial F}{\partial T}, \tag*{(24)}

so the Gibbs entropy is the conjugate of temperature. Differentiating FF at fixed occupation gives the remaining conjugates, namely the pressure Π=−∂∣D∣F\Pi=-\partial_{|D|}F, the mean reward Υ=−∂βF=T⟨Ψ⟩\Upsilon=-\partial_\beta F=T\langle\Psi\rangle, and the behavioral chemical potentials vi=∂F/∂μiv_i=\partial F/\partial\mu_i of Sec. S3. Collecting them,

dF=−S dT−Π d∣D∣−Υ dβ+∑ivi dμi,(25)dF=-S\,dT-\Pi\,d|D|-\Upsilon\,d\beta+\sum_i v_i\,d\mu_i, \tag*{(25)}

and for the whole record dΦ=N dF+F dNd\Phi=N\,dF+F\,dN, so that F=∂Φ/∂NF=\partial\Phi/\partial N is the conjugate of the record size. Unlike its classical counterpart, this differential carries no conserved quantity, because the energy E=−JˉaE=-\bar{J}a is set by the environment, is not additive over the repertoire, and is exchanged with no bath. What survives of the classical first law is the decomposition of every change of UU into heat and work, and that decomposition survives exactly.

The heat and work decomposition

We adopt the exact assignment E(a):=−Tlog⁡(m(a)/τ0)E(a):=-T\log\bigl(m(a)/\tau_0\bigr), whose small-noise limit is Eq. (3). With it, p0=λe−E/T/(Z0/τ0)p_0=\lambda e^{-E/T}/(Z_0/\tau_0) holds at any noise level and the identities below are exact. Let U=⟨E⟩p0U=\langle E\rangle_{p_0}. Any smooth change of the controls at fixed frequency gives dU=∫E dp0+∫p0 dEdU=\int E\,dp_0+\int p_0\,dE, and the first term is exactly T dST\,dS, because ∫dp0=0\int dp_0=0 implies

dS=−∫dp0log⁡p0λ=−∫dp0[−ET−log⁡Z0τ0]=1T∫E dp0.(26)dS=-\int dp_0\log\frac{p_0}{\lambda}=-\int dp_0\left[-\frac{E}{T}-\log\frac{Z_0}{\tau_0}\right]=\frac{1}{T}\int E\,dp_0. \tag*{(26)}

The second term is the work done by the geometry. Section S7 shows that ∫p0 ∂∣D∣E d∣D∣=−Π d∣D∣\int p_0\,\partial_{|D|}E\,d|D|=-\Pi\,d|D|, so the two pressure meters −∂∣D∣F-\partial_{|D|}F and −⟨∂∣D∣E⟩-\langle\partial_{|D|}E\rangle necessarily agree, and along quasistatic paths at fixed frequency and field

dU=T dS−Π d∣D∣.(27)dU=T\,dS-\Pi\,d|D|. \tag*{(27)}

Here heat is the reshuffling of the record over its modes, and work is the displacement of the energies by the environment. A temperature path at fixed geometry is therefore pure heat whenever the barriers do not depend on TT, as in the Arrhenius regime of Sec. S2. On the discrete ensemble of the next subsection the stepwise identity ∫E dp0=T dS\int E\,\mathrm{d}p_0=T\,\mathrm{d}S holds to 2×10−152 \times10^{-15}. Integrated along a temperature path, ΔU=∫T dS\Delta U=\int T\,\mathrm{d}S holds to 10−610^{-6}, and along a volume path ΔU=TΔS−∫Π d∣D∣\Delta U=T\Delta S-\int\Pi\,\mathrm{d}|D| holds to the same accuracy, with the two pressure meters coinciding to 10−610^{-6}.

Exactness and the Maxwell relations

Because every term in Eq. (25) is a first partial derivative of the single function FF, the form is closed and its mixed second derivatives commute, giving

∂Π∂β=∂Υ∂∣D∣,∂Υ∂∣D∣=∂S∂T,∂Π∂β=∂S∂T.(28)\frac{\partial\Pi}{\partial\beta}=\frac{\partial\Upsilon}{\partial|D|},\qquad\frac{\partial\Upsilon}{\partial|D|}=\frac{\partial S}{\partial T},\qquad\frac{\partial\Pi}{\partial\beta}=\frac{\partial S}{\partial T}. \tag*{(28)}

We verify these on a solvable discrete model with nn affordances, each assigned a barrier EaE_a, a frequency λa\lambda_a, a dwell-scaling exponent ζa\zeta_a (so that log⁡ma\log m_a is affine in log⁡∣D∣\log|D|) and a reward Ψa\Psi_a, for which F(T,∣D∣,β,μ)F(T,|D|,\beta,\mu) is a closed-form log-sum-exp. Each conjugate computed analytically agrees to machine precision with a centered finite difference of FF, the three Maxwell relations (S18) hold to ∼10−11\sim10^{-11}, and ∮dF=0\oint\mathrm{d}F=0 holds around closed loops in the (T,β)(T,\beta) plane to ∼10−12\sim10^{-12}. Exactness fails by construction when the reward Ψ\Psi itself depends on ∣D∣|D|, because then −∂∣D∣F=Π+Tβ⟨∂∣D∣Ψ⟩pβ≠Π-\partial_{|D|}F=\Pi+T\beta\langle\partial_{|D|}\Psi\rangle_{p_\beta}\ne\Pi. A pressure that is a state function therefore requires a reward schedule that does not depend on the confining geometry.

Second law, relaxation and the arrow of the record

The H-theorem

Read the record as a sequence of excursions and keep only which mode each excursion used. This sequence of modes is a Markov chain, the embedded chain, whose transition rule K(a,⋅)K(a,\cdot) gives the probability of each next mode when the current mode is aa, and whose stationary law ρ\rho is the distribution of modes that the rule leaves unchanged, ρK=ρ\rho K=\rho. Without reward every mode is drawn afresh from the frequency λ\lambda, so K(a,⋅)=λK(a,\cdot)=\lambda and ρ=λ\rho=\lambda. Under the win-stay/lose-sample rule of Sec. S8 the system instead keeps its current mode with probability wˉ(a)\bar{w}(a) and otherwise draws a new one from λ\lambda, so that K(a,⋅)=wˉ(a) δa+(1−wˉ(a)) λK(a,\cdot)=\bar{w}(a)\,\delta_a+(1-\bar{w}(a))\,\lambda, where δa\delta_a puts all the weight on aa, and ρ∝λ/(1−wˉ)\rho\propto\lambda/(1-\bar{w}).

Let qnq_n be the distribution of the mode at the nnth excursion, so that qn+1=qnKq_{n+1}=q_nK. Its distance from equilibrium is measured by the relative entropy D(q∥ρ)=∑aq(a)log⁡[q(a)/ρ(a)]D(q\Vert\rho)=\sum_a q(a)\log[q(a)/\rho(a)], which vanishes only when q=ρq=\rho. Passing two distributions through the same random rule can only make them harder to tell apart, a fact known as the data-processing inequality [12], D(qK∥ρK)≤D(q∥ρ)D(qK\Vert\rho K)\le D(q\Vert\rho), and since ρK=ρ\rho K=\rho it gives

D(qn+1∥ρ)≤D(qn∥ρ).(29)D(q_{n+1}\Vert\rho)\le D(q_n\Vert\rho). \tag*{(29)}

The distance to equilibrium therefore never grows, and it strictly shrinks whenever the rule mixes, that is, whenever the chain can move between modes. Because the time occupation is the distribution of modes weighted by their dwells (Sec. S1), it inherits the same descent. For a six-mode win-stay/lose-sample rule started from each of 20 random distributions, D(qn∥ρ)D(q_n\Vert\rho) never increases by more than 10−1310^{-13} per step, and the stated ρ\rho is stationary to machine precision.

The arrow of the record

Let PP be the probability of an observed sequence of behavioral states over a window, and P~\widetilde{P} the probability of the same sequence played backward. The irreversibility

I=D(P∥P~)≥0(30)\mathcal{I}=D(P\Vert\widetilde{P})\ge0 \tag*{(30)}

is a relative entropy, so it is never negative, and it is zero only when the record looks the same forward and backward [13, 14]. The reset breaks this symmetry, because at each contact many different states are sent to the same injection point and this map cannot be run backward. The full path therefore produces entropy at the rate S˙obs=⟨S˙exc⟩p0>0\dot{S}_{\mathrm{obs}}=\langle\dot{S}_{\mathrm{exc}}\rangle_{p_0}>0 whenever resets occur, even when the affordance is resampled symmetrically. Grouping states into behaviors can hide part of this asymmetry but cannot create any, so the irreversibility I\mathcal{I} of the observed record is a lower bound on S˙obs\dot{S}_{\mathrm{obs}}.

Third law and unattainability

The dwell floor and the clock bound

Every excursion must cross the domain, so at fixed geometry the mean dwell is bounded below by the time of the fastest, ballistic crossing, m(a)≥τmin⁡>0m(a) \ge\tau_{\min} > 0. For any measurable G⊂A\mathcal{G} \subset\mathcal{A} this gives

p0(Gc)=∫Gcm dλZ0≥τmin⁡λ(Gc)Z0⟺Z0≥τmin⁡λ(Gc)p0(Gc).(31)p_0(\mathcal{G}^{c}) = \frac{\int_{\mathcal{G}^{c}} m\,\mathrm{d}\lambda}{Z_0} \ge\frac{\tau_{\min}\lambda(\mathcal{G}^{c})}{Z_0} \qquad\Longleftrightarrow\qquad Z_0 \ge\frac{\tau_{\min}\lambda(\mathcal{G}^{c})}{p_0(\mathcal{G}^{c})}. \tag*{(31)}

Suppose now that the controls change so that the occupation concentrates on G\mathcal{G}, p0(Gc)→0p_0(\mathcal{G}^{c}) \to0, while the modes outside G\mathcal{G} keep a frequency λ(Gc)≥λ∗>0\lambda(\mathcal{G}^{c}) \ge\lambda_* > 0. The bound then forces the partition function to diverge. Since Z0Z_0 is the mean cycle time, the elementary renewal theorem [22] gives an expected number of completed excursions in a window twt_w of EN(tw)∼tw/Z0→0\mathbb{E}N(t_w) \sim t_w/Z_0 \to0, and by the fluctuation law (S4) the occupation of the window keeps a variance χ/N\chi/N. No finite record therefore equilibrates at a degeneracy of the occupation measure. Classical thermodynamics treats unattainability as an independent principle or derives it from added resource assumptions [15], whereas here it is a theorem, because the normalizer of the equilibrium measure and the clock that samples it are the same number.

Ground-state collapse

As T=σ2→0T = \sigma^2 \to0, the integral Z0=∫e−E/T dλZ_0 = \int e^{-E/T}\,\mathrm{d}\lambda is dominated by the minimizers of EE (Laplace’s method), so

lim⁡T→0F=min⁡aE(a)=−sup⁡aJˉa,p0⟹δG,G=arg min⁡aE(a),(32)\lim_{T\to0} F = \min_a E(a) = -\sup_a \bar{J}^a,\qquad p_0 \Longrightarrow\delta_{\mathcal{G}},\quad\mathcal{G} = \operatorname*{arg\,min}_a E(a), \tag*{(32)}

which is the mode with the deepest barrier and hence the longest dwell. The entropy tends to S→log⁡λ(G)S \to\log\lambda(\mathcal{G}), the log frequency of the ground-state set, so strict Nernst behavior S→0S \to0 would hold only if λ(G)=1\lambda(\mathcal{G}) = 1. This is the familiar T→0T \to0 concentration of any Gibbs measure, and it is what apparent optimality and selection reduce to. The preceding subsection shows, however, that no finite record attains this limit. Displaying it would take a recording time tw≫Z0≥λ(G)m(G)=λ(G)eJˉG/Tt_w \gg Z_0 \ge\lambda(\mathcal{G})m(\mathcal{G}) = \lambda(\mathcal{G})e^{\bar{J}_{\mathcal{G}}/T}, which diverges in Arrhenius fashion, and at T=0T = 0 the renewal process has no renewals at all, so the whole record is a single unfinished excursion.

The ergodic edge and critical slowing down

Consider the trap ensemble [18, 19], in which barriers on [0,∞)[0,\infty) have the exponential frequency λ(Jˉ)=Tλ−1e−Jˉ/Tλ\lambda(\bar{J}) = T_{\lambda}^{-1}e^{-\bar{J}/T_{\lambda}}, decaying with depth at rate 1/Tλ1/T_{\lambda}, and dwells m=eJˉ/Tm = e^{\bar{J}/T}. Its partition function is elementary,

Z0=∫0∞eJˉ(1T−1Tλ)dJˉTλ=TT−Tλ,T>Tλ,(33)Z_0 = \int_0^\infty e^{\bar{J}\left(\frac{1}{T}-\frac{1}{T_{\lambda}}\right)}\frac{\mathrm{d}\bar{J}}{T_{\lambda}} = \frac{T}{T-T_{\lambda}},\qquad T > T_{\lambda}, \tag*{(33)}

and it diverges as (T−Tλ)−1(T-T_{\lambda})^{-1} at the edge T=TλT = T_{\lambda}. In ordinary critical phenomena the partition function stays finite while correlations diverge. Here the divergence of Z0Z_0 is itself the critical slowing down, so thermodynamics and kinetics meet in a single quantity, and by the bound of § 6 no finite record can display the edge. The dwells have the power-law tail P(τ>x)=x−α\mathbb{P}(\tau> x) = x^{-\alpha} with α=T/Tλ\alpha= T/T_{\lambda}. For α>1\alpha> 1 renewals accumulate at the steady rate 1/Z01/Z_0, whereas for α<1\alpha< 1 the mean dwell is infinite, sums of dwells are governed by a one-sided stable law, and the number of renewals grows only as N(tw)∼twαN(t_w) \sim t_w^\alpha, up to slowly varying corrections [22].

The critical point is the ground state

Because the Boltzmann weight is the dwell, the occupation concentrates wherever the dwell is longest. Near a continuous transition the passage time diverges, which is critical slowing down, so the longest-dwelling affordance is the critical point and E=−Tlog⁡mE = -T\log m has its minimum there. We make this concrete with the saddle-node bottleneck of Figure 3, the canonical form of critical slowing down and the channel of type-I intermittency, in which the affordance is the control parameter ϵ\epsilon of

dx=(ϵ+x2) dt+σ dWt(34)\mathrm{d}x = (\epsilon+ x^2)\,\mathrm{d}t + \sigma\,\mathrm{d}W_t \tag*{(34)}

on [−X0,X0][-X_0, X_0]. The trajectory is reinjected at −X0-X_0 on reaching +X0+X_0, which is the constraint, and ϵ\epsilon is redrawn at every contact from the uniform frequency on (0,1](0,1], so that ϵc=0\epsilon_c=0 is the critical point. The deterministic passage time is exact,

m(ϵ)=∫−X0X0dxϵ+x2=2ϵarctan⁡X0ϵ→ϵ→0+πϵ,(35)m(\epsilon)=\int_{-X_0}^{X_0}\frac{\mathrm{d}x}{\epsilon+x^2}=\frac{2}{\sqrt{\epsilon}}\arctan\frac{X_0}{\sqrt{\epsilon}}\xrightarrow{\epsilon\to0^+}\frac{\pi}{\sqrt{\epsilon}}, \tag*{(35)}

and is maximal at ϵc\epsilon_c. In simulation the dwell matches Eq. (35) to better than 0.1% for ϵ>0.3\epsilon>0.3 at σ=0.08\sigma=0.08. The entropic force ∂ϵlog⁡m→−1/2ϵ\partial_\epsilon\log m\to-1/2\epsilon points inward and diverges at criticality. This holds near any continuous transition, since a passage time m(a)∼∣a−ac∣−γm(a)\sim|a-a_c|^{-\gamma} produces a force ∼−γ/(a−ac)\sim-\gamma/(a-a_c) that always points toward aca_c. The peak does require a marginal-passage geometry, however. In a simple confining well mm varies monotonically with stiffness and has no interior maximum, which is why the relevant critical structure is the bottleneck.

By Eq. (12) the occupation is p(ϵ)∝m(ϵ)λ(ϵ)∼ϵ−1/2p(\epsilon)\propto m(\epsilon)\lambda(\epsilon)\sim\epsilon^{-1/2} as ϵ→0+\epsilon\to0^+. This square-root singularity is integrable, so the occupation concentrates at criticality while remaining normalizable, even though the mean dwell ∫mp dϵ∼∫ϵ−1 dϵ\int m p\,\mathrm{d}\epsilon\sim\int\epsilon^{-1}\,\mathrm{d}\epsilon diverges logarithmically. In simulation at σ=0.15\sigma=0.15, the time occupation generated from the uniform frequency is tilted 5.8-fold toward ϵc\epsilon_c across (0,1](0,1] [Fig. 3(a)], and it follows the noiseless curve mλ/Z0m\lambda/Z_0 everywhere except in the first bin, where noise shortens the longest passages.

The durations are scale-free. Changing variables to τ=m(ϵ)\tau=m(\epsilon) with uniform λ\lambda gives P(τ)=λ(ϵ)∣dϵ/dτ∣P(\tau)=\lambda(\epsilon)|\mathrm{d}\epsilon/\mathrm{d}\tau|, which for m≈πϵ−1/2m\approx\pi\epsilon^{-1/2} equals 2π2τ−32\pi^2\tau^{-3}. Noise cuts this power law off, and balancing drift against noise near the bottleneck, where x∼ϵx\sim\epsilon, gives a crossover ϵ∗∼σ4/3\epsilon^*\sim\sigma^{4/3} and a duration cutoff τ∗∼σ−2/3\tau^*\sim\sigma^{-2/3}. The power law therefore holds for 2m(ϵ=1)<τ<τ∗2m(\epsilon=1)<\tau<\tau^* and extends further as the noise falls. For every σ\sigma from 0.4 to 0.08 the simulated P(τ)P(\tau) follows the noiseless law up to the cutoff, with a tail exponent of 3.2±0.13.2\pm0.1 fitted between 2m(ϵ=1)2m(\epsilon=1) and the cutoff (3.04 at the lowest noise), and the curves collapse under P(τ)=τ−3F(τσ2/3)P(\tau)=\tau^{-3}F(\tau\sigma^{2/3}) [Fig. 3(b), inset]. The exponent is not universal, however. Near a general transition with passage divergence m∼∣a−ac∣−γm\sim|a-a_c|^{-\gamma} and frequency λ∼∣a−ac∣κ\lambda\sim|a-a_c|^\kappa, the same change of variables gives P(τ)∼τ−1−(1+κ)/γP(\tau)\sim\tau^{-1-(1+\kappa)/\gamma}, which recovers 3 for the saddle-node with uniform frequency (γ=12\gamma=\frac{1}{2}, κ=0\kappa=0). Shallower divergences, or frequencies that thin out toward the transition, lower the exponent, so a measured duration exponent reflects the geometry of the bottleneck and the frequency jointly.

Observed criticality is usually taken as evidence of tuning, selection, or a self-organizing feedback [16, 17]. Here, by contrast, the system sits at a critical point simply because the critical point is the longest-dwelling state and length-biased sampling converts long dwell into high occupation. No parameter is tuned to ϵc\epsilon_c and nothing drives the control parameter there, since it is drawn afresh from a fixed frequency at every contact and only the time occupation is reweighted. This dwell-weighted proximity to criticality differs from avalanche self-organized criticality, in which the critical state is an attractor of the dynamics. Criticality is therefore a null expectation that must be excluded before an observed critical point is attributed to adaptation, just as the neutral occupation is the null for dominance.

A frozen record, numerically

We simulate three modes with barriers Jˉ=(0,0.8,1.0)\bar{J}=(0,0.8,1.0), frequency λ=(0.8,0.1,0.1)\lambda=(0.8,0.1,0.1) and exponential dwells, using a fixed window tw=104t_w=10^4 and 300 records per temperature. In equilibrium the shallower of the two trapped modes holds a share f0=[1+e0.2/T]−1→0f_0=[1+e^{0.2/T}]^{-1}\to0 of the time spent in the traps, but a finite record freezes into whichever trap it enters first.

TTZ0Z_0EN(tw)\mathbb{E}N(t_w)f0f_0 (equilibrium)f^\hat{f} (measured)
0.601.758520.4170.417±0.0190.417\pm0.019
0.402.836270.3780.376±0.0240.376\pm0.024
0.258.711480.3100.308±0.0420.308\pm0.042
0.151001000.2090.225±0.1060.225\pm0.106
0.102.5×1032.5\times10^34.00.1190.288±0.3580.288\pm0.358
0.082.9×1042.9\times10^40.340.0760.452±0.4780.452\pm0.478

Table 1.

Down to N≈102N\approx10^2 renewals the record tracks equilibrium with the x/N\sqrt{x/N} scatter of Eq. (14), but at N=4N=4 it no longer does, and at N<1N<1 the window is a single unfinished excursion whose occupation is close to a coin flip between the traps. The collapse of § 6B is thus real yet unattainable, since it is approached only on records whose length grows with the clock.

Equation of State

From F=−Tlog⁡Z0F=-T\log Z_0 and ∂∣D∣log⁡Z0=⟨∂∣D∣log⁡m⟩p0\partial_{\lvert D\rvert}\log Z_0=\langle\partial_{\lvert D\rvert}\log m\rangle_{p_0},

Π=−∂F∂∣D∣=T⟨∂∣D∣log⁡m⟩p0⟺Π∣D∣=T⟨ζ⟩p0,ζ(a)=∂log⁡m(a)∂log⁡∣D∣.(36)\Pi=-\frac{\partial F}{\partial\lvert D\rvert}=T\langle\partial_{\lvert D\rvert}\log m\rangle_{p_0}\Longleftrightarrow\Pi\lvert D\rvert=T\langle\zeta\rangle_{p_0},\qquad\zeta(a)=\frac{\partial\log m(a)}{\partial\log\lvert D\rvert}. \tag*{(36)}

Under isotropic dilation of a fixed shape, a mode that escapes by diffusion has m∼ℓ2/2σ2m\sim\ell^2/2\sigma^2 and hence ζ=2/d\zeta=2/d, while a ballistic mode has m∼ℓ/∣v∣m\sim\ell/\lvert v\rvert and hence ζ=1/d\zeta=1/d. For the decision process with absorbing thresholds at ±c\pm c and drift ν\nu the mean dwell is known in closed form [23], m(c)=(c/ν)tanh⁡(νc/σ2)m(c)=(c/\nu)\tanh(\nu c/\sigma^2), and with u=νc/σ2u=\nu c/\sigma^2 it gives

ζ(c)=1+2usinh⁡2u,(37)\zeta(c)=1+\frac{2u}{\sinh2u}, \tag*{(37)}

which runs from ζ→2\zeta\to2 as u→0u\to0, where escape is limited by diffusion, to ζ→1\zeta\to1 as u→∞u\to\infty, where it is limited by drift. Taking ∣D∣=c\lvert D\rvert=c, the one-dimensional equation of state reads Πc=T⟨ζ⟩\Pi c=T\langle\zeta\rangle, which approaches the ideal-gas form Πc=T=σ2\Pi c=T=\sigma^2 at large threshold.

Reward Field and Coexistence

Under the win-stay/lose-sample rule, the affordance of each excursion is retained with a probability w(a,ϱ)w(a,\varrho) that depends on the reward signal ϱ\varrho the excursion produced, and is otherwise redrawn from λ\lambda. The embedded chain then has kernel K(a,⋅)=wˉ(a)δa+(1−wˉ(a))λK(a,\cdot)=\bar w(a)\delta_a+(1-\bar w(a))\lambda with wˉ(a)=E[w∣a]\bar w(a)=\mathbb{E}[w\mid a], and its unique stationary law is

ρ(da)∝λ(da)1−wˉ(a).(38)\rho(\mathrm{d}a)\propto\frac{\lambda(\mathrm{d}a)}{1-\bar w(a)}. \tag*{(38)}

When the mean retention is exponential, 1−wˉ(a)=e−βΨ(a)1-\bar w(a)=e^{-\beta\Psi(a)}, this gives ρ∝λeβΨ\rho\propto\lambda e^{\beta\Psi} and hence, by § 2, pβ∝mλeβΨp_\beta\propto m\lambda e^{\beta\Psi}, so the reward tilt is the exact stationary law of a local rule driven by experience. Two modes then carry equal weight when m1λ1eβΨ1=m2λ2eβΨ2m_1\lambda_1e^{\beta\Psi_1}=m_2\lambda_2e^{\beta\Psi_2}, which defines the first-order coexistence line

β∗=log⁡(m1/m2)+log⁡(λ1/λ2)Ψ2−Ψ1,(39)\beta^*=\frac{\log(m_1/m_2)+\log(\lambda_1/\lambda_2)}{\Psi_2-\Psi_1}, \tag*{(39)}

along which the quantity exchanged between the modes, the analogue of a latent heat, is the log dwell ratio log⁡(m1/m2)\log(m_1/m_2).

The Fly Records

The analysis includes all 47 flies of the Princeton long-timescale dataset [21], recorded in four cohorts during 2022. Each fly contributes 1.3 to 7.8 days of continuous ethogram over nine behavioral states, amounting to 0.7×1050.7\times10^5 to 6.8×1056.8\times10^5 completed bouts per record. Bout lists of states and durations are read off the published per-frame labels without smoothing. Because the idle state holds the largest time share in 45 of the 47 flies, it serves as the reference mode below. Table S2 lists the per-fly numbers and Figure S1 shows the corresponding panels, of which (a) and (d) appear as Figure 4 of the Letter.

Scatter plots comparing election share and occupation share, and variance of idle occupation

Figure 4. The 47 fly records [21]. (a) Election share (frequency) against occupation share (time) for every fly and state, idle in black. (b) Variance of the idle occupation across windows of length twt_w against the finite-variance law χ/N\chi/N of P2 (faint dashed, slope −1-1). Every fly decays more slowly.

Four-panel scatter and fluctuation plots

Figure S1. The 47 multi-day fly records [21]. (a) Election share against occupation share for every fly and state, idle in black. Idle sits far above the diagonal and the most-entered state, the grey cluster near λ=0.4\lambda= 0.4, sits below it. Dominance is manufactured by dwell. (b) The mean idle dwell of each fly, first half of the record against second half. The dwell scale replicates at r=0.85r = 0.85 and identifies the individual. (c) The same split for the idle election share, which replicates at r=0.24r = 0.24. (d) Variance of the idle occupation across non-overlapping windows of length twt_w (solid, one curve per fly) against the parameter-free finite-variance law χ/N\chi/N (faint dashed). Every fly decays far more slowly than the predicted slope −1-1, the anomalous scatter of a repertoire near the ergodic edge.

flydatecamdaysboutsZ0Z_0 (s)pidlep_{\mathrm{idle}}λ\lambdamm (s)Var
102-1714.9391 2861.080.510.144.05−0.13
202-1713.3295 1470.980.370.103.50−0.26
302-1716.2450 0541.180.480.153.89−0.23
402-1715.0388 7801.110.430.114.44−0.32
502-1724.0238 2561.470.580.136.58−0.44
602-1726.8305 6361.920.660.158.53−0.40
702-1727.8568 5551.180.480.134.44−0.26
802-1726.1466 3301.130.410.133.67−0.26
902-1736.3566 2830.960.400.132.96−0.31
1002-1734.3370 5370.990.390.123.21−0.19
1102-1733.8412 3640.790.290.102.30−0.23
1202-1736.5680 3820.830.330.102.76−0.29
1302-1744.2353 7811.030.450.143.34−0.23
1402-1743.1292 5610.920.370.113.09−0.29
1502-1745.8222 1222.270.680.169.90−0.50
1603-1333.5399 5710.770.130.071.40−0.21
1703-1333.9486 9350.690.240.072.45−0.19
1803-1334.8364 2581.150.500.163.60−0.18
1903-1334.7658 9250.620.210.091.37−0.21
2003-1344.3409 3220.910.410.152.44−0.19
2103-1343.2352 3330.800.340.132.11−0.23
2203-1344.4421 3950.910.390.113.31−0.09
2303-1342.3183 9901.100.450.143.56−0.15
2403-2633.8299 1071.100.480.095.86−0.15
2503-2633.0230 0231.140.450.105.09−0.12
2603-2634.8354 9181.160.490.105.54−0.16
2703-2635.2351 3471.270.530.106.94−0.23
2803-2645.0286 8431.520.570.127.22−0.16
2903-2645.0363 4821.190.430.095.41−0.20
3003-2644.1212 5611.680.600.137.64−0.26
3103-2644.2246 5221.470.570.108.06−0.15
3204-1811.373 6931.560.620.185.44−0.11
3304-1816.5333 8811.670.620.156.88−0.26
3404-1814.9284 5851.480.560.108.12−0.25
3504-1814.2210 1591.710.620.147.43−0.23
3604-1823.4199 7291.460.590.117.93−0.14
3704-1824.2258 5781.410.590.165.16−0.27
3804-1823.0215 0351.210.470.105.76−0.09
3904-1825.2262 6751.700.590.156.87−0.32
4004-1836.0218 5512.370.730.1610.46−0.36
4104-1834.8236 3931.770.610.138.29−0.26
4204-1834.8256 1971.620.600.137.52−0.27
4304-1833.7228 2311.400.490.116.15−0.19
4404-1845.3271 6081.670.610.137.56−0.37
4504-1846.8310 3351.890.650.148.51−0.34
4604-1842.0129 5161.330.590.145.52−0.07
4704-1844.1268 1351.320.510.088.10−0.14

Table S2. The 47 flies of Ref. [21]. Columns give the fly identifier, the 2022 recording date and camera, the record length in days, the number of completed bouts, the mean bout time Z0Z_0, the idle occupation share pidlep_{\mathrm{idle}}, the idle election share λ\lambda, the mean idle dwell mm, and the measured decay exponent of the idle occupation scatter across windows, whose finite-variance value would be −1-1.

Dominance is manufactured by dwell. The occupation factorizes exactly as pa=λama/Z0p_a=\lambda_a m_a/Z_0, where λa\lambda_a is the election share, the fraction of completed bouts that enter aa, and mam_a is the mean dwell. If dominance reflected preference, the structure would sit in λ\lambda, but the data place it in mm. The flies elect idle on a median 0.13 of bouts (range 0.07 to 0.18) yet spend a median 0.49 of the record in it (range 0.13 to 0.73), a four to six fold length bias. The most-entered state is the unstereotyped state in all 47 flies, whereas the most-occupied state is idle in 45, and the two coincide in only a single fly Figure S1. Across the full nine-state repertoire the variance of log occupation is carried mainly by the election shares, with the dwell accounting for a median variance fraction of 0.18 per fly. Election thus decides which states appear in the repertoire at all, while dwell decides which of them dominates the record.

Individuality lives on the dwell axis. Across flies the variance of log⁡pidle=log⁡λ+log⁡m−log⁡Z0\log p_{\mathrm{idle}}=\log\lambda+\log m-\log Z_0 splits into a dwell fraction of 1.39 and an election fraction of 0.44. Fractions can exceed one because the covariance terms with log⁡Z0\log Z_0 are negative and absorb the balance. Consistently, log⁡pidle\log p_{\mathrm{idle}} correlates with log⁡m\log m at 0.90 but with log⁡λ\log\lambda only at 0.65. To separate a stable trait from finite-record noise we split every record into two halves by time. The mean idle dwell replicates between the halves at r=0.85r = 0.85 (Spearman 0.82), so that 91% of its across-fly variance is stable after the Spearman-Brown correction to full record length, and the occupation follows at r=0.72r = 0.72. The election share, in contrast, replicates at only r=0.24r = 0.24, with 39% stable [Fig. S1(b,c)]. The identifying trait of an individual fly is therefore its dwell scale, while its election rate is the fluctuating component. Two confounds can be set aside. The correlation of log⁡m\log m with record length is only 0.17, so the length bias of heavy-tailed sample means contributes little. The two halves do share arena, camera, and week, which could inflate all replication numbers together, but a shared setting cannot produce the contrast between mm and λ\lambda.

The finite-variance scatter law fails in every fly. Postulate P2 fixes the scatter that a finite record can have, Var⁡(p^)=χ/N\operatorname{Var}(\hat{p}) = \chi/N with the plug-in χ\chi of Eq. (14). In every one of the 47 flies, however, the measured variance of idle occupation across non-overlapping windows decays far more slowly, with log-log slopes from −0.07-0.07 to −0.50-0.50 against the predicted −1-1 [Fig. S1(d)], as expected in the anomalous regime of a repertoire near the ergodic edge (Sec. S6 C). The idle dwell tail has survival exponents near unity, 0.56 to 1.70 by the maximum-likelihood fit of Ref. [24] and 0.75 to 1.84 by the Hill estimator [25]. Single records in this regime have random growth exponents, and the bout count averaged over flies grows sublinearly, as tw0.93t_w^{0.93} over three decades. As a check, the analysis pipeline recovers ground truth on seeded Pareto ensembles, returning growth exponents of 1.00, 1.00, 0.67 and 0.50 against min⁡(1,α)\min(1,\alpha) for an exponential control and for α=1.5\alpha= 1.5, 0.7 and 0.5.

Numerical Methods

Every prediction uses only mean dwells and reward rates measured in fixed-affordance runs without reward, and it is compared against a separate simulation of the dynamics under win-stay/lose-sample resampling, in which the Gibbs weight never enters. Table S3 lists the parameters.

SystemParametersSampling
BoxL=1L = 1, ω=6\omega= 6, ∣v∣=1.6\lvert v\rvert= 1.6, σ=0.24\sigma= 0.24, reward offset D0=0.5D_0 = 0.5, uniform frequency a∈[0,1]a \in[0, 1]∼8×105\sim8 \times10^5 excursions
Decisionthresholds u=νc/σ2∈[0.10,15.6]u = \nu c/\sigma^2 \in[0.10, 15.6], 15 values≥106\ge10^6 crossings/threshold
Vehiclesensors at ±ϕ\pm\phi, gain gg, base speed v0v_0, wheel noise σw\sigma_w, L∈[0.5,2.8]L \in[0.5, 2.8]2.1×1052.1 \times10^5 rewirings

Table S3. Simulation parameters. The box and vehicle are simulated with many parallel realizations undergoing repeated excursions. The decision process uses the closed-form first-passage law as a check on the simulated dwells.

Box

We integrate Eq. (1) on D=[−L,L]2\mathcal{D} = [-L,L]^2 with an absorbing wall and reinjection near the centre. The rotational part of the vector field is integrated exactly, by Strang splitting of rotation against drift and noise, because explicit Euler multiplies the orbit radius by 1+(aω dt)2\sqrt{1+(a\omega\,dt)^2} at each step. That spurious outward spiral of ∼12%\sim12\% per orbit shortens the circular dwell by ∼30%\sim30\% and corrupts ζ\zeta, which it returns as 0.61 in place of 1. With exact rotation the circular dwell is m=9.22m = 9.22, against the analytic two-dimensional Bessel first-passage value L2/2σ2=8.68L^2/2\sigma^2 = 8.68. The exponents ζ=0.964\zeta= 0.964 (circling) and 0.496 (drift) come from regressing log⁡m\log m on log⁡∣D∣\log|D| across the box sizes. Reward for reaching the wall enters through the rate of wall contact Ψ(a)=Ea[(τ+D0)−1]\Psi(a) = \mathbb{E}_a[(\tau+ D_0)^{-1}], where the offset D0D_0 keeps it bounded on short excursions, and the equation of state then gives Π∣D∣/T\Pi|\mathcal{D}|/T falling from 1.07 at β=0\beta= 0 to 0.73 at β=8\beta= 8. For coexistence, the two end modes alone give β∗=3.62\beta^* = 3.62 by Eq. (39), while summing the tilt meβΨm e^{\beta\Psi} over all modes places equal

occupation on circling (a>1/2a > 1/2) and drift (a<1/2a < 1/2) at 3.85. Simulating the reward rule with retention 1−e−βΨ(a)1 - e^{-\beta\Psi(a)} gives this crossing at 3.89±0.043.89 \pm0.04. If retention instead depends on the reward ϱ=(τ+D0)−1\varrho= (\tau+ D_0)^{-1} of each excursion, as 1−e−βϱ1 - e^{-\beta\varrho}, Eq. (38) predicts 4.05 and the simulation gives 4.05.

Decision process

A one-dimensional accumulator dX=ν dt+σ dW\mathrm{d}X = \nu\,\mathrm{d}t + \sigma\,\mathrm{d}W runs between absorbing thresholds ±c\pm c with reinjection at 0. Across fifteen thresholds spanning u=νc/σ2=0.10u = \nu c/\sigma^2 = 0.10 to 15.6 the simulation reproduces the closed-form mean first-passage time to better than 0.5%. The measured ζ\zeta follows Eq. (37) to within 0.016, from ζ=2.00\zeta= 2.00 at the diffusive end to 1.004 at the drift end, and the resulting pressure Πc=0.0579\Pi_c = 0.0579 matches T=σ2=0.0576T = \sigma^2 = 0.0576 to 0.4%.

Braitenberg vehicle

A differential-drive vehicle with pose (x,y,θ)(x, y, \theta) and two light sensors at ±ϕ\pm\phi moves in a square arena with a light at its centre. With crossing fraction aa the wheel speeds are vL=v0+g[(1−a)sL+a sR]v_L = v_0 + g[(1-a)s_L + a\,s_R] and vR=v0+g[(1−a)sR+a sL]v_R = v_0 + g[(1-a)s_R + a\,s_L], so that a<1/2a < 1/2 steers away from the light and a>1/2a > 1/2 toward it, while the mean speed does not depend on aa. Noise enters on the wheels, so translational diffusion is emergent, and the wiring aa is redrawn independently at each wall contact. Over 2.1×1052.1 \times10^5 rewirings the measured time occupation matches mλ/Z0m\lambda/Z_0, with mm taken from separate fixed-wiring runs, to a total-variation distance of 1.1×10−31.1 \times10^{-3}, and the trapped wiring holds 46.3% of the record against 46.4% predicted from a 10.5-fold dwell contrast. Fitting ζ\zeta on pairs of arena sizes across L=0.5L = 0.5 to 2.8 gives ζ≈0.48\zeta\approx0.48 for the ballistic wirings and ζ=1.13\zeta= 1.13 for the trapped wiring, whose excess over 1 reflects that the trapped label describes the mode only asymptotically.

References

  1. [1]M. R. Evans and S. N. Majumdar, Phys. Rev. Lett. 106, 160601 (2011).
  2. [2]M. R. Evans, S. N. Majumdar, and G. Schehr, J. Phys. A: Math. Theor. 53, 193001 (2020).
  3. [3]G. J. Berman, D. M. Choi, W. Bialek, and J. W. Shaevitz, J. R. Soc. Interface 11, 20140672 (2014).
  4. [4]A. E. X. Brown and B. de Bivort, Nat. Phys. 14, 653 (2018).
  5. [5]J. J. Gibson, The Ecological Approach to Visual Perception (Houghton Mifflin, Boston, 1979).
  6. [6]E. Çinlar, Introduction to Stochastic Processes (Prentice-Hall, Englewood Cliffs, NJ, 1975).DOI
  7. [7]M. I. Freidlin and A. D. Wentzell, Random Perturbations of Dynamical Systems, 3rd ed. (Springer, Heidelberg, 2012).
  8. [8]R. J. Herrnstein, J. Exp. Anal. Behav. 4, 267 (1961).
  9. [9]W. M. Baum, J. Exp. Anal. Behav. 22, 231 (1974).
  10. [10]W. M. Baum, J. Exp. Anal. Behav. 32, 269 (1979).
  11. [11]J. H. Wearden and I. S. Burgess, J. Exp. Anal. Behav. 38, 339 (1982).
  12. [12]T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. (Wiley, Hoboken, NJ, 2006).
  13. [13]U. Seifert, Rep. Prog. Phys. 75, 126001 (2012).
  14. [14]G. E. Crooks, Phys. Rev. E 60, 2721 (1999).
  15. [15]L. Masanes and J. Oppenheim, Nat. Commun. 8, 14538 (2017).
  16. [16]P. Bak, C. Tang, and K. Wiesenfeld, Phys. Rev. Lett. 59, 381 (1987).
  17. [17]M. A. Muñoz, Rev. Mod. Phys. 90, 031001 (2018).
  18. [18]J.-P. Bouchaud, J. Phys. I (France) 2, 1705 (1992).
  19. [19]C. Monthus and J.-P. Bouchaud, J. Phys. A: Math. Gen. 29, 3847 (1996).
  20. [20]V. Braitenberg, Vehicles: Experiments in Synthetic Psychology (MIT Press, Cambridge, MA, 1984).
  21. [21]G. C. McKenzie-Smith, J. F. Ayroles, J. W. Shaevitz, and S. W. Wolf, Drosophila melanogaster Long Timescale Data 2022, Princeton Data Commons, doi:10.34770/1sab-8845 (2023).
  22. [22]W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, 2nd ed. (Wiley, New York, 1971).
  23. [23]R. Bogacz, E. Brown, J. Moehlis, P. Holmes, and J. D. Cohen, Psychol. Rev. 113, 700 (2006).
  24. [24]A. Clauset, C. R. Shalizi, and M. E. J. Newman, SIAM Rev. 51, 661 (2009).
  25. [25]B. M. Hill, Ann. Stat. 3, 1163 (1975).

Paper details

vlnc:W_kmag35r7
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents