betaFeedback

WorksPhysics and Astronomy

Memory in biological Lévy walks from the dynamic-entropy formalism

Abstract

Lévy walks are recognized by the histogram of their flight lengths, while the renewal hypothesis on which the textbook model rests, that every flight is drawn afresh, is seldom tested. We test it with the dynamic-entropy formalism. Maximizing the causal entropy of a sequence of logarithmic flight lengths at fixed lagged correlations yields a chain of continuous spins on a compact interval, whose depth, selected by the data, tells a renewal walker from a Markovian one and from one with a longer memory. With one lag the chain is exactly solvable. A duality that exchanges long and short flights locates a first-order condensation of the flights at the upper cutoff, with the logarithmic range of the flights in the role of system size, and a positive memory makes the histogram heavier-tailed than the rule that generates each flight. For groups, the same construction separates the memory of each individual from delayed interactions and from drives common to all units, which an analysis of the group average confounds, and it gives the collective speed a critical point. On open data, renewal is rejected in seven of ten conditions of Drosophila larvae and in every termite, whose memory reaches a few flights back and lowers the exponent of the histogram by more than half a unit below that of the one-step rule. Wild baboons align with where their nearest neighbors, those ahead above all, were heading 10 to 30 s earlier, and homing pigeons are coupled across their small flocks. Zebrafish T cells, a negative control, remember their own speed, but no delayed coupling between the speeds of different cells survives the controls.

Introduction

Put a Drosophila larva on a dish of plain agar, with nothing to smell, see or eat, and it will not stay put. It crawls in straight runs separated by turns: many short runs and, every now and then, a very long one, with lengths spread over two decades in a way that resembles a power law [1]. Termite workers in a Petri dish [2], T cells in living tissue [3] and marine predators in the open ocean [4] leave records of the same kind. A walk made of straight flights whose lengths ℓ\ell follow p(ℓ)∝ℓ−μp(\ell) \propto\ell^{-\mu}, with 1<μ≤31 < \mu\le3, is called a Lévy walk [5, 6], and whether real organisms perform Lévy walks, and why, has been argued about for two decades [7, 8, 9].

Most of that argument concerns the histogram of flight lengths. This paper is about their order. Does a long flight make the next one longer? Does a walker remember its previous flights, and if so, how many? And if it does, is the exponent read from the histogram still the exponent of the rule that the walker follows at each turn? The textbook Lévy walk has no memory: it is a renewal process, in which every flight is drawn afresh from the same law. A power law, however, only counts long flights. It does not say whether they come in runs, or runs of long flights change how far and how fast a walker spreads [10]. When walkers move in groups a second question joins the first: when a walker speeds up or turns, is it following its own past or the past of the others?

Questions of this kind are inverse problems, and maximum entropy (MaxEnt) is a natural way to pose them [11]. Among all the probability laws that reproduce a chosen set of measured averages, MaxEnt selects the one that assumes nothing else.

When the averages are those of some functions fkf_k, the selected law is an exponential family, p∝exp⁡(∑kλkfk)p \propto\exp(\sum_k \lambda_k f_k), formally a Boltzmann weight whose Lagrange multipliers λk\lambda_k act as fields and couplings; read in this way, the correlations measured in flocks of birds and in populations of neurons have been turned into networks of effective interactions [12, 13, 14, 15]. Maximizing the entropy of whole trajectories rather than of single configurations, the principle of maximum caliber [16, 17], carries the idea over to dynamics. Constraints on correlations at different times have been used to predict the spiking of neurons [18] and the motion of birds in a flock [19]. In cell migration, inference of this kind has told collective from individual motion [20], measured how a drug reshapes the interactions between cancer and stromal cells [21] and, in the dynamic-entropy formalism of Agliari et al. [22], inferred delayed interactions between migrating cells from the directions in which they move.

We apply this program to the lengths of flights. Its static half is old: fixing only the mean of ln⁡ℓ\ln\ell, MaxEnt returns a power law [23]. The dynamic half is not. Fixing also the correlations between ln⁡ℓt\ln\ell_t and ln⁡ℓt−τ\ln\ell_{t-\tau}, for lags up to a depth KK, turns the sequence of flights into a chain of spins coupled in time, and the depth that the data select tells a renewal walker (K=0K = 0) from a Markovian one (K=1K = 1) and from one with a longer memory (K>1K > 1). The chain is a small statistical-mechanics problem of its own. With one lag it can be solved exactly. Exchanging long and short flights, ℓ→ℓmin⁡ℓmax⁡/ℓ\ell\to\ell_{\min}\ell_{\max}/\ell, maps the chain onto itself with different parameters, and on the line of parameters that this duality leaves unchanged the flights condense at the largest available scale through a first-order transition, with the logarithmic range of the flights in the role of system size. Short of the transition, memory makes the histogram heavier-tailed than the rule that generates it. In a group, the same construction separates the correlation of a walker with the past into a part due to its own past and a part due to the past of the others, and the collective speed acquires a critical point. On open data, memory turns out to be common. Drosophila larvae crawling without sensory cues [1] remember one to four flights back, and they remember most when their brain lobes and sensory neurons have been ablated. Termites [2] remember about four flights back, and the wall of their dish, which they follow closely, does not explain it. In groups, wild baboons [24] align with where their nearest neighbors, those ahead above all, were heading 10 to 30 s earlier, and homing pigeons [25] are coupled to the whole of their small flocks. In zebrafish T cells [3], which we use as a negative control, the delayed coupling that an analysis of their group average would report is the memory of each cell, and no coupling between the speeds of different cells survives the controls; this does not mean that T cells do not interact, only that their interactions do not take this form (§ 2 D).

Rather than evaluating search optimality, competing functional distributions (such as log-normal alternatives over empirical ranges; Appendix F), or underlying neural circuitry, our objective is to characterize trajectory dependence directly: determining whether sequential flight memory exists, quantifying its range, and isolating individual persistence from social coupling.

Section II builds the model, for one walker and for many, and Sec. III works out its emergent properties. Section IV turns the model into an estimator and § 2 applies it to larvae, termites, baboons, pigeons and T cells. § 2.1 discusses what the results mean for Lévy walks. Proofs, validations on synthetic data and the controls on the real ones are collected in the Appendices.

Flights with memory

One flight

A flight length has no natural unit, so we measure it on a logarithmic scale. Every data set also comes with two bounds: a shortest flight ℓmin⁡\ell_{\min}, set by the resolution of the measurement, and a longest one ℓmax⁡\ell_{\max}, set by the walker, by the arena or by the duration of the recording. We keep both from the start and work with

x=ln⁡ℓℓmin⁡∈[0,L],L=ln⁡ℓmax⁡ℓmin⁡,(1)x = \ln\frac{\ell}{\ell_{\min}} \in[0,L], \qquad L = \ln\frac{\ell_{\max}}{\ell_{\min}}, \tag*{(1)}

so that LL counts the ee-folds spanned by the flights. The measure dx=dℓ/ℓ\mathrm{d}x = \mathrm{d}\ell/\ell is the only one that a change of units leaves invariant, up to a shift of xx. Maximizing the entropy S[p]=−∫0Ldx p(x)ln⁡p(x)S[p] = -\int_0^L \mathrm{d}x\,p(x)\ln p(x) at fixed ⟨x⟩\langle x\rangle gives

p(x)=eθxZ(θ),Z(θ)=eθL−1θ,(2)p(x) = \frac{e^{\theta x}}{Z(\theta)}, \qquad Z(\theta) = \frac{e^{\theta L}-1}{\theta}, \tag*{(2)}

which is a power law p(ℓ)∝ℓ−μp(\ell) \propto\ell^{-\mu} truncated to [ℓmin⁡,ℓmax⁡][\ell_{\min},\ell_{\max}], with μ=1−θ\mu= 1-\theta [23], and not a Lévy-stable law, which describes the sum of many flights rather than a single one. For a single flight, ℓmax⁡\ell_{\max} is a convenience. On the half-line x≥0x \ge0, Eq. (2) is a normalized law whenever θ<0\theta< 0, that is, μ>1\mu> 1, and one may let ℓmax⁡→∞\ell_{\max} \to\infty. The cutoff does make room for the opposite case: on [0,L][0,L] any θ\theta is allowed, and θ>0\theta> 0 describes a walker whose flights pile up near ℓmax⁡\ell_{\max}. Section II B shows that, once flights remember each other, this case cannot be avoided, and the cutoff becomes a necessity.

The mean and the variance of xx are

⟨x⟩=Λ(θ)=L2[1+L(θL2)],Var⁡x=Λ′(θ)=L24L′(θL2),(3)\langle x\rangle= \Lambda(\theta) = \frac{L}{2}\left[1+\mathcal{L}\left(\frac{\theta L}{2}\right)\right], \qquad \operatorname{Var}x = \Lambda'(\theta) = \frac{L^2}{4}\mathcal{L}'\left(\frac{\theta L}{2}\right), \tag*{(3)}

where L(y)=coth⁡y−1/y\mathcal{L}(y)=\coth y-1/y is the Langevin function of paramagnetism Figure 5(a). Its appearance has a simple explanation. In the variable u=2x/L−1∈[−1,1]u=2x/L-1\in[-1,1] the law (2) reads p(u)∝ebup(u)\propto e^{bu} with b=θL/2b=\theta L/2. This is exactly the law of the vertical component u=cos⁡ϑu=\cos\vartheta of a classical Heisenberg spin, a unit vector in three dimensions, in a field bb: the area of a sphere between two heights is proportional to the distance between them (Archimedes’ hat-box theorem), so cos⁡ϑ\cos\vartheta is uniform on [−1,1][-1,1] for a spin without field, and the Boltzmann factor ebcos⁡ϑe^{b\cos\vartheta} tilts it as eθxe^{\theta x} tilts the flight. A flight is therefore a classical spin that interacts with nothing but an external field, the elementary unit of Langevin’s theory of paramagnetism: the spin points to the south pole when the flight is close to ℓmin⁡\ell_{\min} and to the north pole when it is close to ℓmax⁡\ell_{\max} Figure 1(b)], the field $b$ sets how strongly it is tilted toward one pole or the other, and $\langle u\rangle=\mathcal{L}(b)$ is its magnetization. For the planar spins that describe directions of motion in Ref. [22], the Bessel ratio $I_1/I_0$ plays the same role. The susceptibility $\Lambda'$ is largest at $\theta=0$, where the histogram of $\ln\ell$ is flat and $\Lambda'(0)=L^2/12$; this number will set the critical point of the collective speed in {xref}Sec. III D`.

Figure 1. From a track to a chain of spins. (a) One hour of a Drosophila larva (shi/+, 33 °C) crawling on plain agar: the flights (black segments, dots at the turns) cut out of the recorded track (grey). (b) In the variable x=ln⁡(ℓ/ℓmin⁡)∈[0,L]x = \ln(\ell/\ell_{\min}) \in[0,L] a flight is the vertical projection of a classical spin on a sphere whose poles are the cutoffs ℓmin⁡\ell_{\min} and ℓmax⁡\ell_{\max}; shown are four consecutive flights of the larva in (a). The next flight xtx_t feels a field hih_i, specific to the walker, and the previous flights through the couplings JτJ_\tau, Eq. (6). (c) Phase diagram of the chain with one lag (K=1K = 1). Horizontal axis: the bare exponent μbare=1−h\mu_{\mathrm{bare}} = 1 - h, with which a flight is drawn after a run of the shortest ones (Sec. II C). Vertical axis: the coupling J1J_1 between consecutive flights times the logarithmic range LL, the largest change of exponent that one flight can induce in the next (Sec. II B). Shading: fraction Π\Pi of flights longer than the geometric mean ℓmin⁡ℓmax⁡\sqrt{\ell_{\min}\ell_{\max}}, the midpoint of the logarithmic range, which stays fixed when long and short flights are exchanged; it is computed from the exact stationary law of the chain, Eq. (17), for ℓmax⁡/ℓmin⁡=102\ell_{\max}/\ell_{\min} = 10^2. Dotted, the coupling JupJ_{\mathrm{up}} beyond which a run of long flights can sustain itself (spinodal); dashed, the coupling Jcond=2JupJ_{\mathrm{cond}} = 2J_{\mathrm{up}} beyond which the flights condense at ℓmax⁡\ell_{\max}, Eq. (16) (Sec. III B). Indigo: larval conditions (median and interquartile range of μbare\mu_{\mathrm{bare}} over larvae, ±2\pm2 standard errors of J1LJ_1L; circles, controls; squares, neurons silenced; diamond, brain lobes and sensory neurons ablated); ochre: 75 termite workers (§ 2); both from fits with K=1K = 1. (d) Stationary distribution of flight lengths at the three states marked A, B and C in (c), which share μbare=2\mu_{\mathrm{bare}} = 2 and have J1L=0.5J_1L = 0.5, 1.5 and 2.5, for ℓmax⁡/ℓmin⁡=103\ell_{\max}/\ell_{\min} = 10^3; dashed, the renewal walk with the same μbare\mu_{\mathrm{bare}}. (e) Free energy F(u)=−lim⁡L→∞L−1ln⁡πF(u) = -\lim_{L\to\infty}L^{-1}\ln\pi along u=ln⁡(ℓ/ℓmin⁡)/Lu = \ln(\ell/\ell_{\min})/L, Eq. (20). It is piecewise linear because the stationary weight is a product of exponentials in xx. In A the only minimum is at ℓmin⁡\ell_{\min}; in B a second, higher minimum at ℓmax⁡\ell_{\max} makes runs of long flights metastable; on the dashed coexistence line the two minima are degenerate; in C the flights condense at ℓmax⁡\ell_{\max}.

Figure 5. The memory chain at depth one. (a) Response of one flight to its field, Eq. (3): mean (solid) and variance (dashed, in units of its maximum L2/12L^2/12) of xx. (b) Order parameter Π\Pi, the fraction of stationary flights longer than ℓmin⁡ℓmax⁡\sqrt{\ell_{\min}\ell_{\max}}, versus Φ=J1L/(μbare−1)\Phi= J_1L/(\mu_{\mathrm{bare}}-1) at μbare=2\mu_{\mathrm{bare}}=2, for ranges ℓmax⁡/ℓmin⁡\ell_{\max}/\ell_{\min} from 10210^2 to 101210^{12}. The curves cross at the self-dual point Φ=2\Phi=2, Π=1/2\Pi=1/2, and sharpen into a step as the range grows; dotted, the spinodal Φ=1\Phi=1. (c) Exponent returned by an i.i.d. truncated-Pareto fit to the same stationary laws: memory lowers it below μbare\mu_{\mathrm{bare}}, and every curve crosses μ^=1\hat{\mu}=1 at Φ=2\Phi=2.

A sequence of flights

A walker produces flights x=(x1,…,xT)\mathbf{x}=(x_1,\ldots,x_T) one after the other Figure 1(a). Following Ref. [22], in the spirit of maximum caliber [16], we maximize the entropy of the whole sequence, S[P]=−∫Dx P[x]ln⁡P[x]S[P]=-\int\mathcal{D}x\,P[x]\ln P[x] with Dx=∏tdxt\mathcal{D}x=\prod_t\mathrm{d}x_t, at fixed mean of xx and fixed lagged correlations

C(τ)=1T−K∑t=K+1T⟨xtxt−τ⟩,τ=1,…,K.(4)C(\tau)=\frac{1}{T-K}\sum_{t=K+1}^{T}\langle x_t x_{t-\tau}\rangle,\qquad\tau=1,\ldots,K. \tag*{(4)}

The lagged correlations are the constraints that carry the memory. Fixing only the mean returns the law (2) for every flight, independently of the others, so that a walker described by it has no memory by construction. Each lagged correlation that is also fixed lets a flight depend on the one τ\tau steps earlier, and on nothing else that the data have not demanded; whether the data do demand it, and up to which lag, KK, is then a question that the data answer (Sec. IV A). In this way MaxEnt turns the question “does the walker remember?” into the estimate of a few multipliers. Introducing the Lagrange multipliers hh for the mean and JτJ_\tau for the correlation at lag τ\tau, the law of maximum entropy is

P[x]=1ZTexp⁡[∑txt(h+∑τ=1KJτxt−τ)],(5)P[\mathbf{x}] = \frac{1}{Z_T}\exp\left[\sum_t x_t\left(h+\sum_{\tau=1}^{K}J_\tau x_{t-\tau}\right)\right], \tag*{(5)}

the Boltzmann weight of a one-dimensional chain of continuous spins in time, in a field hh and with couplings JτJ_\tau of range KK (Figure 1(b)). As in C(τ)C(\tau), the sum runs over t=K+1,…,Tt = K + 1,\ldots,T, the first KK flights being held fixed. For K=0K = 0 the flights are independent and identically distributed: this is the renewal Lévy walk. A positive coupling means that long flights tend to follow long flights, a negative one that they alternate with short ones. With Gaussian instead of scale-free constraints the same construction gives Burg’s maximum-entropy autoregression [26, 27].

This is where the upper cutoff earns its place. Seen from flight tt, the past acts as an effective field h+∑τJτxt−τh + \sum_\tau J_\tau x_{t-\tau}. With Jτ>0J_\tau> 0 this field grows with the lengths of the previous flights, and a run of flights that are long enough makes it positive, so that the next flight favors long lengths. On the half-line there is no normalizable law eθxe^{\theta x} with θ>0\theta> 0, and the weight (5) itself cannot be normalized. On [0,L][0,L] every history yields a proper law, and every value of the parameters is allowed. What the cutoff costs is a scale: the largest change of field that one flight can produce on another is JτLJ_\tau L, and it is this product, not JτJ_\tau alone, that measures the strength of the memory (Sec. III B).

When several walkers are observed together, we give each walker ii its own field hih_i. The fields absorb the differences between individuals, a quenched random field in the language of disordered systems, while the couplings, which describe the memory, are shared.

The causal chain

The normalization ZTZ_T couples all the flights of Eq. (5), which makes its likelihood costly to evaluate. Agliari et al. removed the difficulty with a mean-field step [22]: in the weight of each spin they replaced the field generated by the past with the value it takes on the observed data, and normalized spin by spin, which makes the measure factorize in time. For one walker this step has an exact meaning. Each factor becomes the law of the next flight given the observed previous ones,

p(xt∣xt−1,…,xt−K)=eθtxtZ(θt),θt=h+∑τ=1KJτxt−τ(6)p(x_t \mid x_{t-1},\ldots,x_{t-K})=\frac{e^{\theta_t x_t}}{Z(\theta_t)},\qquad\theta_t=h+\sum_{\tau=1}^{K}J_{\tau}x_{t-\tau} \tag*{(6)}

and their product is the probability of the observed sequence under a Markov chain of order KK. This chain is a MaxEnt object in its own right. It maximizes, under the same constraints, the causal entropy

Sc[P]=−∑t∫Dx P[x]ln⁡p(xt∣xt−1,…,xt−K),(7)S_{\mathrm{c}}[P]=-\sum_t\int\mathcal{D}x\,P[x]\ln p(x_t\mid x_{t-1},\ldots,x_{t-K}), \tag*{(7)}

the sum of the entropies of each flight given the KK previous ones [28], and it is the model we use. At each turn the walker draws a truncated power law whose exponent, μt=1−θt\mu_t=1-\theta_t, is set by its recent flights.

The log-likelihood

l(h,J)=∑t[θtxt−ln⁡Z(θt)](8)l(h,\mathbf{J})=\sum_t\left[\theta_t x_t-\ln Z(\theta_t)\right] \tag*{(8)}

summed over the same flights as Eq. (5), or over those with at least Kmax⁡K_{\max} predecessors when depths up to Kmax⁡K_{\max} are compared (Appendix C), is an elementary function of the parameters (h,J)(h,\mathbf{J}), and it is concave in them, because ln⁡Z\ln Z is a convex function of θ\theta and θt\theta_t is linear in (h,J)(h,\mathbf{J}). Its maximum, when it exists, is unique. The stationarity conditions,

∑t[xt−Λ(θt)]=0,∑t[xt−Λ(θt)]xt−τ=0,(9)\sum_t\left[x_t-\Lambda(\theta_t)\right]=0,\qquad\sum_t\left[x_t-\Lambda(\theta_t)\right]x_{t-\tau}=0, \tag*{(9)}

are the dynamic version of moment matching: the difference between each flight and its predicted mean must vanish on average and be uncorrelated with the past. The Fisher information,

I=∑tΛ′(θt)ztztT,zt=(1,xt−1,…,xt−K),(10)\mathbf{I}=\sum_t\Lambda'(\theta_t)\mathbf{z}_t\mathbf{z}_t^{\mathsf{T}},\qquad\mathbf{z}_t=(1,x_{t-1},\ldots,x_{t-K}), \tag*{(10)}

gives the error bars. No Gaussian surrogate of the likelihood is needed: Eq. (8) is maximized as it is.

The path measure Eq. (5) and the causal chain Eq. (6) are different families with the same sufficient statistics. They agree to first order in JJ, after a shift of the field, and fitted to the same flights they return nearly the same couplings (Appendix A). In both, the selected depth is a Markov order [17]: K∗=0K^*=0 is renewal, K∗=1K^*=1 a Markov chain of flights, K∗>1K^*>1 a longer memory. We call

μbare=1−h(11)\mu_{\mathrm{bare}}=1-h \tag*{(11)}

the bare exponent. It is the exponent with which the walker draws its next flight after a run of the shortest possible ones (xt−τ=0x_{t-\tau}=0 for every τ\tau), when the memory adds nothing to the field. With memory it differs from the exponent of the histogram of all flights (Sec. III C).

Many walkers on a common clock

In a group, the flights of different individuals start and end at different times, so “the previous flight of the others” is not defined. A group needs a common clock. We use frames tt of fixed duration and, for unit ii, the log-displacement per frame, or log-speed, xit=ln⁡(ℓit/ℓmin⁡)∈[0,L]x_i^t=\ln(\ell_i^t/\ell_{\min})\in[0,L], with the same single-site law (2).

Frames and flights are two different observables, and they answer different questions. On a frame clock a single flight spans many frames, so a walker’s memory from one frame to the next mostly measures how long it keeps moving fast or slow; a renewal Lévy walk observed in frames is strongly correlated, simply because its flights last. Whether a walker is a renewal process can only be asked of its flights, the events at which it chooses anew, and that is what we do for single walkers. To ask whether a walker responds to the others, instead, we must know what each of the others was doing τ\tau seconds before the walker’s step. Flight indices do not provide this, since the tt-th flight of one walker and the tt-th flight of another happen at different times; a clock shared by all walkers does, because it gives every walker a state at every instant. For groups we therefore use frames. The model is the same; only the index of time changes.

Transcribing Eq. (A16) of Ref. [22] from directions to log-speeds gives the path measure

P(x)=1Zexp⁡[∑t,ixit(H+1N∑τ=1τMJτ∑jxjt−τ)],(12)P(\mathbf{x})=\frac{1}{Z}\exp\left[\sum_{t,i}x_i^t\left(H+\frac{1}{N}\sum_{\tau=1}^{\tau_M}J_\tau\sum_jx_j^{t-\tau}\right)\right], \tag*{(12)}

which fixes the mean of xx and the lagged autocorrelation R(τ)=⟨mtmt−τ⟩R(\tau)=\langle m_t m_{t-\tau}\rangle of the group average mt=N−1∑ixitm_t=N^{-1}\sum_i x_i^t. This autocorrelation contains two different things,

R(τ)=1NA(τ)+(1−1N)S(τ),(13)R(\tau)=\frac{1}{N}A(\tau)+\left(1-\frac{1}{N}\right)S(\tau), \tag*{(13)}

where A(τ)A(\tau) is the mean lagged correlation of each unit with its own past and S(τ)S(\tau) that with the past of the others (Figure 2(a)). In Eq. (12) one multiplier JτJ_\tau accounts for both. Giving each its own multiplier, and each unit and each frame its own field, yields the self + social model,

Figure 2. Many walkers. (a) The lagged correlation between units has a diagonal part, each unit with its own past (A), and an off-diagonal part, each unit with the others’ past (S); the group average mixes the two, Eq. (13). The self + social model (14) gives each part its own couplings, aτa_{\tau} and JτJ_{\tau}, and adds a field for each unit, hih_i, and for each frame, gtg_t. (b) Synthetic units with own memory of depth 3 and no interaction (N=30N = 30, 40 replicates, mean ± s.d.): couplings returned by the group-average analysis in its original implementation (open squares) and with its exact likelihood (filled diamonds), against the prediction of Eq. (25) (dashed); circles, social couplings of the self + social model. Inset: fraction of data sets in which a social coupling is declared, for N=10N = 10, 30 and 100. (c) Mean-field phase diagram of the collective speed with one delayed coupling JJ, in units of Jc=12/L2J_c = 12/L^2, and bias θ~\tilde{\theta}: two stable states (shaded, solid boundary) for J>JcJ > J_c, oscillations (dashed boundary) for J<−JcJ < -J_c; dots, the critical points. (d) Group average on the symmetric line θ~=0\tilde{\theta} = 0: one steady state (J=0.5JcJ = 0.5J_c, N=200N = 200), collective stop-and-go (J=1.15JcJ = 1.15J_c, N=40N = 40), and oscillations of period 6 for a negative coupling at delay 3 (N=200N = 200). L=ln⁡100L = \ln100 throughout.

θit=hi+gt+∑τ=1Ksaτxit−τ+∑τ=1KcJτsit−τ,(14)\theta_i^t=h_i+g_t+\sum_{\tau=1}^{K_s}a_\tau x_i^{t-\tau}+\sum_{\tau=1}^{K_c}J_\tau s_i^{t-\tau}, \tag*{(14)}

with p(xit∣past)=eθitxit/Z(θit)p(x_i^t\mid\mathrm{past})=e^{\theta_i^t x_i^t}/Z(\theta_i^t) and units independent of each other given the past of all. The self couplings aτa_\tau capture individual persistence, playing the same role as the memory couplings in the single-walker model (Sec. II C). The social couplings JτJ_\tau act on sit−τs_i^{t-\tau}, the mean log-speed at frame t−τt-\tau of all other units (global coupling) or of the kk units nearest to ii (local coupling). The time fields gtg_t absorb whatever affects all units at once. The model of Ref. [22] is the special case hi=Hh_i = H, gt=0g_t = 0, aτ=Jτ/Na_{\tau} = J_{\tau}/N, s=ms = m.

Statistical mechanics of the memory chain

The stationary law

In Eq. (14) a unit’s own past and the past of its neighbors enter in exactly the same way, as a field on its next step weighted by a coupling. Formally, the unit’s own previous step is one more neighbor, the one that is always at distance zero: a memory is an interaction with one’s own past, and an interaction is a memory of somebody else’s. The two differ in what can produce them. Own memory can come from inertia, physiology or the persistence of a behavioral state; a coupling to the others’ past requires that the unit perceives them. A drive common to all units, such as a change of temperature, also correlates them, but it is neither memory nor interaction, and the time fields gtg_t are there to absorb it (Sec. IV C). Own memory and social coupling are kept in separate terms because the data offer them separately, in the diagonal and off-diagonal blocks of the lagged correlations of Figure 2(a). For the same reason the single-walker model is not the trivial case N=1N = 1 of the collective one: it is the diagonal term that must be modeled before the off-diagonal one can be read.

Directions of motion are modeled in the same way, with planar instead of Heisenberg spins. The heading of unit ii, a unit vector nit\mathbf{n}_i^t, is drawn from the von Mises law p(nit∣past)=eθit⋅nit/[2πI0(∣θit∣)]p(\mathbf{n}_i^t \mid\text{past}) = e^{\boldsymbol{\theta}_i^t \cdot\mathbf{n}_i^t}/[2\pi I_0(|\boldsymbol{\theta}_i^t|)], the planar spin of Ref. [22], with the field θit=hi+gt+∑τaτnit−τ+∑τJτsit−τ\boldsymbol{\theta}_i^t = \mathbf{h}_i + \mathbf{g}_t + \sum_{\tau} a_{\tau}\mathbf{n}_i^{t-\tau} + \sum_{\tau} J_{\tau}\mathbf{s}_i^{t-\tau} built as in Eq. (14) from fields in the plane and from the mean heading si\mathbf{s}_i of the neighbors (Appendix G). The modulus ∣θit∣|\boldsymbol{\theta}_i^t| is the concentration of the law: for small deviations, the inverse square of the angular spread of the heading about the direction of θit\boldsymbol{\theta}_i^t.

With one lag, θ(x)=h+Jx\theta(x) = h + Jx, the causal chain (6) satisfies detailed balance with respect to

π(x)∝ehxZ(h+Jx),π(x) p(y∣x)∝eh(x+y)+Jxy,(15)\pi(x) \propto e^{h x} Z(h + Jx), \qquad\pi(x)\,p(y \mid x) \propto e^{h(x+y)+Jxy}, \tag*{(15)}

as one checks by inserting Eq. (2) (Appendix A). The joint law of two consecutive flights is a two-site Boltzmann weight of Ising type, with continuous spins on [0,L][0,L], and every stationary property of the walk follows from it.

The stationary law has a simple reading. In a reversible chain, the weight of a flight xx is the total weight of the pairs it forms with its successor, ∫0Ldy eh(x+y)+Jxy=ehxZ(h+Jx)\int_0^L dy\,e^{h(x+y)+Jxy} = e^{hx}Z(h + Jx). The first factor is the bare power law. The second counts the successors: for J>0J > 0 a long flight forms favorable pairs with long successors, so the factor Z(h+Jx)Z(h + Jx) grows with xx, roughly as eJxLe^{JxL} once the field h+Jxh + Jx is positive, and it lifts the tail of the distribution. Figure 1(d) shows the effect for three chains, marked A, B and C in the phase diagram of Figure 1(c). They share the bare exponent, μbare=2\mu_{\mathrm{bare}} = 2, and differ only in the coupling JJ: J1L=0.5J_1L = 0.5, 1.5 and 2.5, and each give one curve in Figure 1(d). For chain A, with the weakest coupling, the stationary law is barely distinguishable from the renewal one; for chain B the tail bends upward before the cutoff; for chain C most flights sit at ℓmax⁡\ell_{\max}. The three chains lie in three different regions of the phase diagram, and the next section explains what separates them.

Duality and condensation

Section II B showed that, once flights remember each other, the upper cutoff cannot be removed: a positive coupling makes long flights favor long successors, and only ℓmax⁡\ell_{\max} keeps them finite. What, then, does a positive memory do to a walk? It may leave a power-law histogram, only heavier-tailed, as for chain A; or runs of long flights may take over and pile the flights up at ℓmax⁡\ell_{\max}, as for chain C. The question matters for data. A walker on the far side of this change would no longer look like a Lévy walker at all, and the location of the change is the scale against which the coupling of a real walker is strong or weak. We answer it with three standard tools of statistical mechanics. A symmetry of the pair weight, a duality, locates the change exactly without solving the chain, as the Kramers–Wannier duality locates the critical temperature of the two-dimensional Ising model [29]. For wide ranges a large-deviation estimate of the stationary law yields a free energy, whose minima show that the change is a first-order transition. Finite ranges, those of the data, are then treated exactly with Eq. (15).

Exchange long and short flights, ℓ→ℓmin⁡ℓmax⁡/ℓ\ell\to\ell_{\min}\ell_{\max}/\ell, that is, x→L−xx \to L-x. A flight close to ℓmin⁡\ell_{\min} becomes one close to ℓmax⁡\ell_{\max} and vice versa, while the geometric mean ℓmin⁡ℓmax⁡\sqrt{\ell_{\min}\ell_{\max}}, the midpoint x=L/2x=L/2 of the logarithmic range, stays where it is. For a renewal walker this maps the exponent μ\mu onto 2−μ2-\mu, a law that favors short flights onto one that favors long ones. With memory, the pair weight eh(x+y)+Jxye^{h(x+y)+Jxy} keeps its form: the coupling is unchanged and the field becomes −h−JL-h-JL, up to a constant. A chain at (h,J)(h,J) and one at (−h−JL,J)(-h-JL,J) are thus the same chain read upside down: whatever the first does near ℓmin⁡\ell_{\min}, the second does near ℓmax⁡\ell_{\max}. We call two such chains dual to each other, and a chain that is its own dual self-dual. The self-dual chains are those with h=−JL/2h=-JL/2. Their stationary law is symmetric about the midpoint, so exactly half of their flights are longer than ℓmin⁡ℓmax⁡\sqrt{\ell_{\min}\ell_{\max}}, for every range. With μbare=1−h\mu_{\mathrm{bare}}=1-h, the self-dual line is the coupling

Jcond=2(μbare−1)L=2Jup,Jup=μbare−1L.(16)J_{\mathrm{cond}}=\frac{2(\mu_{\mathrm{bare}-1})}{L}=2J_{\mathrm{up}},\qquad J_{\mathrm{up}}=\frac{\mu_{\mathrm{bare}}-1}{L}. \tag*{(16)}

Both thresholds have a direct meaning. Take μbare>1\mu_{\mathrm{bare}}>1, a rule that by itself favors short flights. After a flight at the cutoff, x=Lx=L, the field is h+JL=JL−(μbare−1)h+JL=JL-(\mu_{\mathrm{bare}}-1), and it is positive, so that the next flight is more likely long than short, when J>JupJ>J_{\mathrm{up}}. Above this coupling a run of long flights can sustain itself. Whether the walker spends most of its time in such runs is decided by the duality: below JcondJ_{\mathrm{cond}} it lives among short flights, above it among long ones. The natural order parameter is therefore the fraction of flights longer than the fixed point of the duality,

Π=∫L/2Ldx π(x)=Prob⁡(ℓ>ℓmin⁡ℓmax⁡),(17)\Pi=\int_{L/2}^{L}dx\,\pi(x)=\operatorname{Prob}(\ell>\sqrt{\ell_{\min}\ell_{\max}}), \tag*{(17)}

computed with the exact stationary law (15). The duality maps Π\Pi onto 1−Π1-\Pi, so that Π=1/2\Pi=1/2 on the self-dual line, and Π\Pi tends to 0 or to 1 on either side of it. The ratio

Φ=JJup=JLμbare−1(18)\Phi=\frac{J}{J_{\mathrm{up}}}=\frac{JL}{\mu_{\mathrm{bare}}-1} \tag*{(18)}

is the natural control parameter, with Φ=1\Phi=1 at the first threshold and Φ=2\Phi=2 at the second.

For wide ranges the change becomes a sharp transition. From Eq. (2), Z(θ)≃eθL/θZ(\theta)\simeq e^{\theta L}/\theta for θL≫1\theta L\gg1, Z(θ)≃1/∣θ∣Z(\theta)\simeq1/|\theta| for θL≪−1\theta L\ll-1 and Z(0)=LZ(0)=L, so that

ln⁡Z(θ)=Lmax⁡(θ,0)+O(ln⁡L).(19)\ln Z(\theta)=L\max(\theta,0)+O(\ln L). \tag*{(19)}

the normalization of one flight is dominated by flights near ℓmax⁡\ell_{\max} when its field is positive and by flights near ℓmin⁡\ell_{\min} when it is negative (Appendix B). Inserting this into π(x)∝ehxZ(h+Jx)\pi(x)\propto e^{hx}Z(h+Jx), at fixed α=μbare−1>0\alpha=\mu_{\mathrm{bare}}-1>0 and β=JL\beta=JL, shows that the stationary law obeys a large-deviation principle in LL,

π(x)≃e−LF(x/L),F(u)=αu−max⁡(βu−α,0),(20)\pi(x)\simeq e^{-L F(x/L)},\qquad F(u)=\alpha u-\max(\beta u-\alpha,0), \tag*{(20)}

with u=x/L∈[0,1]u=x/L\in[0,1] [Fig. 1(e)]. The logarithmic range LL plays the role of system size and FF that of a free energy per unit size. Because both factors of π\pi are exponentials in xx, FF is piecewise linear and its minima can only sit at the ends, u=0u=0 (flights near ℓmin⁡\ell_{\min}) and u=1u=1 (flights near ℓmax⁡\ell_{\max}). For β<2α\beta<2\alpha the global minimum is u=0u=0 and Π→0\Pi\to0: the walker is in a Pareto phase, with a power-law histogram. For β>2α\beta>2\alpha the global minimum is u=1u=1 and Π→1\Pi\to1: the flights condense at the cutoff. The transition, on the self-dual line, is first order, with Π\Pi jumping from 0 to 1. Between the two thresholds, α<β<2α\alpha<\beta<2\alpha, the end u=1u=1 is a local minimum: a run of flights near ℓmax⁡\ell_{\max} is metastable, and it lasts for a number of flights that grows exponentially with LL (Appendix B); J=JupJ=J_{\mathrm{up}} is the spinodal. At finite LL the jump is smoothed over a width of order 1/L1/L, and the curves Π(Φ)\Pi(\Phi) for different ranges cross at the self-dual point Φ=2\Phi=2, Π=1/2\Pi=1/2 [Fig. 5(b)], as observable do at first-order transitions in finite systems [30].

Both thresholds vanish as ℓmax⁡/ℓmin⁡→∞\ell_{\max}/\ell_{\min}\to\infty and this reflects how the coupling scales. The coupling acts through JLJL, the largest change of field that one flight can impose on the next, and it is JLJL that must be held fixed as the range grows, much as the couplings of a mean-field magnet must scale with the inverse number of spins. At fixed JJ a wider range makes the same coupling stronger, and on the half-line every positive coupling lies beyond condensation, which is another way of saying that the chain does not exist there. At fixed Φ\Phi the limit L→∞L\to\infty is well defined, and it is the limit in which the transition becomes sharp. The cutoff is therefore a physical ingredient of a Lévy walk with memory, not a regularization to be removed at the end. Real data span one to two and a half decades, where the transition is a broad crossover, but its location still organizes the phase diagram in which the walkers of Sec. V fit [Fig. 1(c)].

Nothing in the duality requires a single lag or detailed balance. Since Z(−θ)=e−θLZ(θ)Z(-\theta)=e^{-\theta L}Z(\theta), exchanging long and short flights, the next one and all the previous ones, maps the causal kernel (6) of any depth onto itself, with the couplings unchanged and the field h→−h−JtotLh\to-h-J_{\mathrm{tot}}L, where Jtot=∑τJτJ_{\mathrm{tot}}=\sum_\tau J_\tau. For K>1K>1 the chain is not reversible, and its stationary law, which is unique, has no closed form. Yet the self-dual chains, Jtot=2(μbare−1)/LJ_{\mathrm{tot}}=2(\mu_{\mathrm{bare}}-1)/L, still have a stationary law symmetric about L/2L/2, and therefore Π=1/2\Pi=1/2; and with non-negative couplings a run of flights at the cutoff sustains itself when Jtot>(μbare−1)/LJ_{\mathrm{tot}}>(\mu_{\mathrm{bare}}-1)/L, with μbare=1−h\mu_{\mathrm{bare}}=1-h the exponent after a run of the shortest flights, as before. The two lines of the phase diagram of Figure 1(c) thus apply at any depth, with JtotJ_{\mathrm{tot}} in place of J1J_1 and Φ=JtotL/(μbare−1)\Phi= J_{\mathrm{tot}}L/(\mu_{\mathrm{bare}}-1), and only its shading, computed from the exact law (15), is specific to K=1K=1; the same total coupling controls the collective speed (Sec. III D). A fit with K=1K=1 to a walker with a deeper, positive memory returns a lag-1 coupling that absorbs part of the deeper couplings, larger than J1J_1 and smaller than JtotJ_{\mathrm{tot}}, so that its coordinates place the walker short of where it actually sits (§ 2 B).

The stationary law counts flights. A walker that moves at constant speed spends in each flight a time proportional to its length, so the fraction of time spent in flights of log length xx is the length-biased law πtime(x)∝exπ(x)∝e(h+1)xZ(h+Jx)\pi_{\mathrm{time}}(x) \propto e^x\pi(x) \propto e^{(h+1)x}Z(h+Jx), familiar from renewal theory [6], with free energy F(u)−uF(u)-u. The bare factor is that of a walker with exponent μbare−1\mu_{\mathrm{bare}}-1; the memory factor is unchanged. For wide ranges, a walker with μbare<2\mu_{\mathrm{bare}}<2 spends most of its time in flights near ℓmax⁡\ell_{\max} even without memory, the ballistic regime of the renewal Lévy walk. For μbare≥2\mu_{\mathrm{bare}}\ge2 time condenses at JL=2(μbare−1)−1J_L=2(\mu_{\mathrm{bare}}-1)-1, that is, at Φ=2−1/(μbare−1)\Phi=2-1/(\mu_{\mathrm{bare}}-1), between the spinodal and the condensation of the flights: measured in time rather than in flights, runs of long flights take over earlier.

Memory dresses the exponent

A histogram does not know in which order the flights came. An i.i.d. truncated-Pareto fit to stationary flights matches their mean log length and returns μ^=1−Λ−1(⟨x⟩π)\hat{\mu}=1-\Lambda^{-1}(\langle x\rangle_{\pi}). For J>0J>0 this exponent is smaller than μbare\mu_{\mathrm{bare}} [Figure 5(c)]: memory packs long flights into runs, the histogram is heavier-tailed than the rule that generates it, and a walker with memory looks more Lévy than its one-step rule. On the self-dual line ⟨x⟩π=L/2\langle x\rangle_{\pi}=L/2 and μ^=1\hat{\mu}=1 exactly, for every range. Beyond it μ^<1\hat{\mu}<1, and deep in the condensed phase μ^<0\hat{\mu}<0 [Figure 5(c)]. On [0,L][0,L], an effective parameter μ^=1−θ^<1\hat{\mu}=1-\hat{\theta}<1 describes a histogram that rises toward ℓmax⁡\ell_{\max}, θ^>0\hat{\theta}>0, a law that the half-line cannot host and that the condensed phase requires. Put differently, the local exponent μt=1−θt\mu_t=1-\theta_t fluctuates with the recent past, a superstatistics [31] generated by the dynamics itself. The exponent of a histogram is thus not a property of the search rule alone; it also depends on the memory and on the range over which it is measured. In real walkers the difference exceeds half a unit (§ 2).

A critical point for the collective speed

Groups raise a question that single walkers do not: can a delayed coupling between walkers order the group as a whole? Take NN units with a global delayed coupling and no own memory, that is, (14) with aτ=0a_\tau=0, sis_i the mean of all other units, a common field hi=Hh_i=H and no time fields. The group average mtm_t plays the role of a magnetization. It is the collective log-speed, close to 0 when the whole group crawls and close to LL when it runs. Two parameters control it. One is the total coupling Jtot=∑τJτJ_{\mathrm{tot}}=\sum_\tau J_\tau, the strength with which the past speed of the group feeds back on its present. The other is a bias. Exchanging slow and fast, m→L−mm\to L-m, maps the model onto itself with H→−H−JtotLH\to-H-J_{\mathrm{tot}}L, the duality of Sec. III B at the level of the group; its symmetric point is H=−JtotL/2H=-J_{\mathrm{tot}}L/2, and

θ~=H+JtotL2(21)\tilde{\theta}=H+\frac{J_{\mathrm{tot}}L}{2} \tag*{(21)}

measures the distance from it, positive when the group is biased toward running.

For N→∞N\to\infty the units are independent given the past, and mtm_t follows the deterministic delayed map

mt=Λ(H+∑τJτmt−τ)(22)m_t=\Lambda\left(H+\sum_\tau J_\tau m_{t-\tau}\right) \tag*{(22)}

with Λ\Lambda the Langevin response (3). A steady state m∗m^*, with field θ∗\theta^*, loses stability when a root zz of $1=\Lambda'(\theta^*)\sum_\tau J_\tau z^{-\tau}$ crosses the unit circle (Appendix G). For positive couplings the first root to cross is z=1z=1, a fold at which a second stable state appears. Since the susceptibility of one flight never exceeds $L^2/12 (Sec. II A), this requires

Jtot>Jc=12L2(23)J_{\mathrm{tot}}>J_c=\frac{12}{L^2} \tag*{(23)}

with a cusp at Jtot=JcJ_{\mathrm{tot}}=J_c, θ~=0\tilde{\theta}=0 [Figure 2(c)]. Above JcJ_c the group switches at random between a slow and a fast state, a collective stop-and-go whose residence times grow with NN [Figure 2(d)]. A negative coupling at delay dd makes the group oscillate instead: the map splits into dd independent sub-chains, each of which undergoes a period doubling at ∣J∣=Jc|J|=J_c, and any lag-1 inertia puts them in phase, so that the period is 2d2d. Near both thresholds the fluctuations of the group average diverge, NVar⁡(m)→Λ′/[1−(Λ′J)2]N\operatorname{Var}(m)\to\Lambda'/[1-(\Lambda'J)^2] for one lag.

Own memory adds to the social feedback. With a lag-1 self coupling a≥0a\ge0, each unit at a steady state is the chain of (15) in the field H+Jtotm∗H+J_{\mathrm{tot}}m^*, and the steady state loses stability when Jtotχ=1J_{\mathrm{tot}}\chi=1, where χ=∑τ≥0R(s)\chi=\sum_{\tau\ge0}R(s) is the integrated response of one unit to a pulse of field. What enters is the response, not the integrated autocorrelation, which is 50% larger at a=0.2a=0.2. For L=ln⁡100L=\ln100 and a=0.2a=0.2 the threshold drops to Jc(a)=1.77JcJ_c(a)=1.77J_c, against $0.65J_c$ from the naive estimate Λ′(0)(a+J)=1\Lambda'(0)(a+J)=1, and the theory reproduces the simulated fluctuations within 1% away from the threshold and within 4% at $J=0.6J_c [Appendix G, Figure 9(b)].

Figure 9. Synthetic collectives. (a) A drive common to all units, without interaction (40 replicates): fraction of data sets in which a social coupling is declared by the group-average analysis, by a global coupling, by a local coupling, and by a local coupling with time fields; right, a planted local coupling J2=0.3J_2 = 0.3 under the same drive, inferred without and with time fields (mean ±\pm s.d.). (b) Fluctuations of the collective log-speed versus JJ on the line θ~=0\tilde{\theta} = 0, without (open circles) and with own memory a=0.2a = 0.2 (squares); lines, the theory of Sec. III D; dotted, the shifted threshold Jc(a)=0.71JcJ_c(a) = 0.71J_c. L=ln⁡100L = \ln100.

The threshold Jc=12/L2J_c=12/L^2 exists because the support of each speed is compact, and it vanishes as the range grows. It is a scale-free and delayed counterpart of the speed criticality reported for starling flocks [32], where the interactions are instantaneous.

From trajectories to couplings

Fitting and choosing the depth

For NN walkers, i=1,…,Ni=1,\ldots,N, with flights xi,tx_{i,t}, the field of (6) becomes θi,t=hi+∑τJτxi,t−τ\theta_{i,t}=h_i+\sum_\tau J_\tau x_{i,t-\tau}, with one field per walker and shared couplings. The log-likelihood stays concave, and Newton’s method finds its maximum in a few iterations (Appendix C). The cost is negligible. For one larval condition (6 to 59 larvae, 349 to 4240 flights) the whole scan of depths K=0,…,6K = 0, \ldots, 6, with one field per larva, takes 0.1–0.6 s on a single core of a desktop computer; pooling all 241 larvae, with 241 fields and up to six couplings for 20 948 flights, takes 5 s. The same machinery accommodates fields that change every BB flights, which absorb slow drifts of the exponent and leave to the couplings only the short-range memory, and known covariates, such as the distance from a wall. Short tracks bias the couplings of a fit with one field per walker by an amount of order 1/Ti1/T_i [33], which we measure on surrogates in which the flights of each walker are permuted.

The depth is chosen by comparing models with K=0,…,Kmax⁡K = 0, \ldots, K_{\max}, fitted on the same flights, through an information criterion, the Akaike information criterion, AIC =−2l+2k= -2l + 2k, or the Bayesian information criterion, BIC =−2l+kln⁡no= -2l + k \ln n_o, with kk parameters and non_o predicted flights [34, 35]. The choice is not innocent. On renewal data AIC selects K∗>0K^* > 0 with asymptotic probability

PAIC=1−exp⁡[−∑k=1Kmax⁡1kP(χk2>2k)],(24)P_{\mathrm{AIC}} = 1 - \exp\left[-\sum_{k=1}^{K_{\max}} \frac{1}{k} P\left(\chi_k^2 > 2k\right)\right], \tag*{(24)}

equal to 0.248, 0.267, 0.284 and 0.288 for Kmax⁡=4K_{\max} = 4, 6, 12 and ∞\infty, however long the data. This classical consequence of Spitzer’s combinatorial lemma [36, 37] makes AIC inconsistent for the order of a chain, and cross-validation with a fixed training fraction, asymptotically equivalent to it [38, 39], inherits the same bias. BIC is consistent [40, 41]. Heavy tails play no role here, since in the log variable every sufficient statistic is bounded. We select the depth with BIC and calibrate every claim against surrogate data.

On walkers generated by the model itself with random parameters, the procedure does what it should (Appendix D, Figure 6). Planted and inferred couplings agree, and their differences, in units of the Fisher errors (10), have mean −0.01-0.01 and standard deviation 0.970.97. BIC recovers the planted depth in 78% of the walkers and never selects a deeper chain, whereas AIC does so in 24%. On renewal walkers the false-positive rate of AIC stays at the level of Eq. (24) from 250 to 16 000 flights, and that of BIC vanishes as the data grow.

Figure 6. Validation on planted walkers. (a) Planted versus inferred couplings J1J_1, J2J_2, J3J_3 for 200 walkers of T=3000T = 3000 flights, with bare exponents drawn uniformly in [1.3,2.5][1.3, 2.5], couplings of random sign and modulus in [0.04,0.20][0.04, 0.20], and ℓmax⁡/ℓmin⁡=102\ell_{\max}/\ell_{\min} = 10^2; inset: the field h′=1−μbareh' = 1 - \mu_{\mathrm{bare}}. (b) Errors in units of the Fisher standard errors, pooled over all parameters, against the standard normal law. (c) Selected depth minus planted depth: BIC never overestimates it, and underestimates it only when the last coupling is weaker than about three standard errors; AIC overestimates it in a quarter of the walkers. (d) Fraction of renewal walkers (μbare=2\mu_{\mathrm{bare}} = 2, ℓmax⁡/ℓmin⁡=103\ell_{\max}/\ell_{\min} = 10^3, 300 replicates per length) declared to have memory by AIC, blocked cross-validation and BIC; dotted lines, the asymptotic values of Eq. (24) for AIC and P(χ12>ln⁡T)P(\chi_1^2 > \ln T) for BIC.

What else looks like memory

A real trajectory can mimic memory in ways that a planted walker cannot, and three of them matter here (Appendix E, Figure 7). Walkers differ: two flights of the same fast walker are both long, and a model with one field for all reads this as memory, at the largest depth allowed. One field per walker removes the effect, which is why we never pool walkers without their own fields. Flights are not observed but cut out of noisy tracks, and noise occasionally breaks a long flight into two long pieces, which manufactures a positive correlation; merging consecutive pieces that are nearly collinear undoes it, and a pipeline null, which rebuilds each track from its own flights in random order and analyzes it again, measures whatever memory the pipeline itself creates. Finally, the variable matters: the linear statistic ℓtℓt−1\ell_t\ell_{t-1} is dominated by a handful of extreme flights and misses a memory that the log statistic xtxt−1x_t x_{t-1} detects. Different mechanisms of dependence also leave different signatures in how the selected depth grows with the length of the data, which helps to tell a finite memory from a slowly decaying one.

Figure 7. How memory is missed or invented, on synthetic walkers. (a) Power to detect a weak memory with the log statistic xtxt−1x_t x_{t-1} and with the linear statistic ℓtℓt−1\ell_t \ell_{t-1} (BIC; 200 replicates per point). (b) Inferred lag-1 coupling for 40 walkers with individual exponents μi∼U(1.2,2.2)\mu_i \sim U(1.2, 2.2) and T=1000T = 1000 flights each, with a common field (coral) or one field per walker (indigo); dashed, planted values. (c) Selected depth for a renewal Lévy walk sampled at fixed times with localization noise: true flights, flights segmented from the track, and segmented flights after merging nearly collinear pieces. (d) Mean selected depth (±\pm s.e.) versus the number of flights for five mechanisms with truncated-Pareto marginals: renewal, a MaxEnt chain of depth 3 (dotted: its true depth), a Gaussian-copula AR(2) process, a walker switching between two hidden states, and long-range memory (Gaussian copula of fractional Gaussian noise with Hurst exponent 0.75).

Reading interactions from a group

For groups, three results, proved in Appendix G and tested on synthetic collectives in Table III, organize the inference.

experimentgroup averageself + social
own memory a=(0.25,0.10)a = (0.25, 0.10), local J3=0.35J_3 = 0.35 (40)delay 3 in 22/40, 1 in 13/40; spurious J1=0.28J_1 = 0.28, J2=0.12J_2 = 0.12(Ks∗,Kc∗)=(2,3)(K_s^*, K_c^*) = (2, 3) in 38/40; a^=(0.245,0.095)\hat{a} = (0.245, 0.095), J^3=0.348±0.024\hat{J}_3 = 0.348 \pm0.024
own memory of depth 3, no interaction (N=10,30,100N = 10, 30, 100; 40 each)declared in 100% (exact likelihood: 97–100%)declared in 1/120; Ks=3K_s = 3 in 116/120
common drive, no interaction (40)declared in 100%global 100%, local 100%, local with time fields 0%
common drive, local J2=0.3J_2 = 0.3 (40)declared in 100%local: J^2=0.42\hat{J}_2 = 0.42; local with time fields: J^2=0.300±0.012\hat{J}_2 = 0.300 \pm0.012
group-average model true, J1=0.25J_1 = 0.25, J4=0.35J_4 = 0.35 (N=5N = 5–100100; 60 each)J^4=0.43±0.06\hat{J}_4 = 0.43 \pm0.06 at N=5N = 5, 0.35±0.040.35 \pm0.04 at N=100N = 100exact likelihood: J^4=0.34±0.03\hat{J}_4 = 0.34 \pm0.03 at N=5N = 5, 0.35±0.040.35 \pm0.04 at N=100N = 100
own memory, local delay Δ=1,2,4,6\Delta= 1, 2, 4, 6 (30 each)delay recovered in 100, 73, 40, 17%delay recovered in 100% for every Δ\Delta
directions, persistent turning, no interaction (30)declared in 30/30 (delay 1)declared in 0/30
directions, persistence and local J3J_3 (30)delay 3 in 0/30 (always 1)declared in 30/30, delay 3 in 30/30

Table III. Synthetic collectives: the analysis of the group average of [22] (depth τM∗\tau_M^* selected by AIC, delay given by arg⁡max⁡τ∣Jτ∣\arg\max_\tau|J_\tau|) against the self + social model (14) (depths by BIC). “Declared”: a nonzero social coupling is selected. Speed-­Vicsek model, L=ln⁡100L = \ln100, 1500 frames, N=50N = 50 unless stated; replicates in parentheses.

The mean-field measure is the exact likelihood of a causal model. The factorized measure of Ref. [22], evaluated on the data, is a product of normalized laws, one for each unit and frame, with the field θt=H+∑τJτmt−τ\theta_t = H + \sum_{\tau} J_{\tau}m_{t-\tau} computed from the observed past. It is therefore exactly the likelihood of the causal chain with this field. This chain is not the path measure (12), just as for single walkers the causal chain is not the path measure (Sec. II); but it is a well-defined model whose likelihood can be maximized exactly, with no further approximation. The Gaussian autoregressive moment approximation of Ref. [22] overestimates planted couplings by 24% in groups of five units, whereas the exact likelihood estimator remains unbiased across group sizes.

The group average contains own memory. Let the units be independent, each with its own memory and autocovariance Ci(τ)C_i(\tau). A model of the group average then acquires delayed couplings, because the autocorrelation of the average contains the autocorrelation of each unit, Eq. (13). Linearizing the inversion of Ref. [22], the fitted couplings converge to

J∗=ϕΛ′(θˉ),ϕ=Rˉ−1cˉ,J^* = \frac{\phi}{\Lambda'(\bar{\theta})}, \qquad\phi= \bar{R}^{-1}\bar{c},
Rˉττ′=Cˉ(∣τ−τ′∣),cˉτ=Cˉ(τ),(25)\bar{R}_{\tau\tau'} = \bar{C}(|\tau-\tau'|), \qquad\bar{c}_{\tau} = \bar{C}(\tau), \tag*{(25)}

the Yule–Walker coefficients of the mean individual autocovariance Cˉ=N−1∑iCi\bar{C} = N^{-1}\sum_i C_i, divided by the susceptibility of one unit. The factors of NN cancel, so these couplings do not shrink with the size of the group. In simulations without interactions the group-average analysis declares a delayed coupling in every data set, for N=10N = 10, 30 and 100 alike, with coefficients that follow Eq. (25) lag by lag (Figure 2(b)): (0.468, 0.225, 0.177) against the predicted (0.459, 0.230, 0.156) at N=30N = 30. These couplings are not an error of the analysis. They are the memories of the units, measured through their average, and a unit’s own past is as legitimate a source of delayed correlation as the past of its neighbors; but the two are memories of a different nature, and the average cannot separate them. In the validation of Ref. [22] on the Vicsek model, a peak at the first delay was correctly attributed to the inertia of each particle; Eq. (25) shows that an inertia lasting longer than one frame produces peaks at longer delays as well. The self + social model assigns own memory to the couplings aτa_\tau: with regressors that leave out the unit itself, its social score vanishes exactly when units do not interact, and it declares a coupling in 1 of 120 interaction-free data sets.

Common drives look like interactions. A field shared by all units, such as temperature, illumination or a pulse of chemokine, correlates units that never interact. Time fields gtg_t absorb it, but they also absorb a global coupling: once each frame has its own field, the mean of the other units at an earlier frame is a function of that frame plus a multiple of the unit’s own past, and global coupling and common drive become indistinguishable. A local coupling, which differs from unit to unit within a frame, survives. Local coupling with time fields is the only reading that declares no coupling under a drive alone and recovers a planted coupling without bias (Appendix G, Figure 9).

One last control is specific to real groups. In a time-shift surrogate each unit’s track is displaced in time by an independent random offset. The surrogate keeps every unit’s own memory, its heterogeneity and its marginal law, and it destroys every synchrony between units, both interactions and common drives. A coupling that survives in the surrogates is not an interaction.

Walkers and groups in the data

We now apply the estimator of Sec. IV to five open data sets (Table I), in two steps. Single walkers come first: Drosophila larvae and termites, analyzed on the clock of their flights, where we ask whether each walker is a renewal process, how deep its memory is, and where it sits in the phase diagram of Sec. III. Groups follow: wild baboons and homing pigeons, analyzed on a common clock of frames, where we ask whether a unit responds to the past of its neighbors once its own memory and the drives common to the group are accounted for. Zebrafish T cells close the section as a negative control for both questions.

systemcontent and source
Drosophila larvae304 tracks at 2 Hz, up to 1 h, 10 genotype–temperature conditions, 240 × 240 mm agar arenas [1]; Dryad doi:10.5061/dryad.7m0cfxpq0, mirror Zenodo 4996872 (CC0)
termite workers75 focal C. cumulans workers, 2 Hz for 6 h, Petri dishes of ≈ 49 mm [43]; Zenodo 3628061 (CC-BY 4.0)
T cells1106 tracks of zebrafish and mouse T cells and Dictyostelium [3]; GitHub erjerison/TCellMigration (MIT)
baboons26 GPS-collared members of a troop of olive baboons (Papio anubis), 1 Hz from 06:00 to 18:00 on 14 days [24]; Movebank Data Repository doi: 10.5441/001/1.kn0816jn (CC0) [44]
pigeonsthree flocks of homing pigeons (6, 10 and 8 tracked birds), 41 releases, GPS at 1 Hz (5 Hz for some birds) [25]; Dryad doi:10.5061/dryad.4tmpg4fp6 (CC0) [45]

Table I. Data sets.

All single walkers go through the same pipeline (Appendix F): flights are cut out of each track with a corridor of half-width ε=0.5\varepsilon= 0.5 mm, nearly collinear pieces are merged, ℓmin⁡=1\ell_{\min} = 1 mm, flights shorter than ℓmin⁡\ell_{\min} are set to ℓmin⁡\ell_{\min}, and ℓmax⁡\ell_{\max} is the longest flight of the condition (larvae) or of the track (termites). The flights then span L=3L = 3–66 ee-folds, one to two and a half decades.

Drosophila larvae

Sims et al. [1] filmed Drosophila larvae crawling for up to one hour on plain agar, without odor, light or food, and found Lévy-like flight statistics that persisted when large parts of the nervous system were switched off. Neurons were targeted with the GAL4–UAS system. The driver BL expresses in the brain lobes and in part of the subesophageal ganglion, BLsens in the same regions and in all sensory neurons, MB247 in the mushroom bodies, a center of learning and memory. The targeted neurons were either silenced with shibire<sup>ts</sup>, a temperature-sensitive mutant of dynamin that blocks synaptic transmission above about 30 °C [42] (the larvae were tested at 33 °C, some controls also at the permissive 22 °C), or killed by expressing the pro-apoptotic genes reaper and hid (rpr/hid). Larvae that carry only the driver (BL/+, MB247/+) or only the effector (shi/+) are controls. Because the Lévy statistics survived without brain and senses, Sims et al. traced them to the central pattern generator for locomotion in the ventral nerve cord. In an environment controlled so tightly, these data are ideal to ask whether the intrinsic walk of the larva is a renewal process.

The 241 tracks with at least 17 flights, 20 948 flights in ten conditions, are fitted condition by condition with one field per larva and K≤6K \le6 (Table II). Renewal is rejected in seven of the ten conditions [Fig. 3(a)]. The memory is positive, long flights tending to follow long flights, and short, one to four flights deep. It does not depend on how the flights are cut, and in six of the seven conditions it survives when the field of each larva is re-estimated every 25 flights, so it is not a slow drift of the exponent; in BL>shi it disappears, and is better described as a slow modulation (Appendix F). The nulls are clean: within-larva permutations select K∗>0K^* > 0 in 1 of 300 surrogates, and the pipeline null in none of 50. Of the three conditions compatible with renewal, BLsens>shi has too few flights (349) to decide, and shi/+ at 22 °C has a lag-1 coupling three standard errors from zero that BIC does not retain; only BL/+ at 22 °C shows no trace of memory. Temperature matters by itself. The two control genotypes tested at both temperatures have K∗=0K^* = 0 at 22 °C and K∗=1K^* = 1 at 33 °C, and their lag-1 coupling grows from −0.004±0.019-0.004 \pm0.019 to 0.071±0.0160.071 \pm0.016 in BL/+, by three standard errors, and from 0.088±0.0300.088 \pm0.030 to 0.127±0.0130.127 \pm0.013 in shi/+, within errors. BL/+ carries no effector, so heat alone appears to make the walk more persistent, independently of the silencing that it triggers in the lines that express shibire<sup>ts</sup>; for those lines, the reference is the controls at 33 °C.

The memory is strongest in the BLsens>rpr,hid larvae, whose brain lobes and sensory neurons are dead: J1=0.31±0.05J_1 = 0.31 \pm0.05, eight standard deviations from the permutation null. In the logic of Ref. [1], the memory between flights is generated below the brain, together with the Lévy-like statistics, and needs neither the brain nor sensory feedback.

Six of the seven conditions with memory sit at Φ≃0.7\Phi\simeq0.7–1.01.0 [Fig. 1(c)], close to the spinodal and about half way to condensation; BL>shi, whose memory is a slow modulation, sits at 0.35. Replacing the longest observed flight by the side or the diagonal of the 240 × 240 mm arena changes Φ\Phi by at most 0.2, because μbare\mu_{\mathrm{bare}} and J1J_1 readjust with LL. The exponent is visibly depressed [Fig. 3(d)]: the one-step rule has μbare=1.54\mu_{\mathrm{bare}} = 1.54–1.771.77 (2.72 for the ablated larvae, a value raised by the 28% of their flights that fall below ℓmin⁡\ell_{\min}; Appendix F), the histogram μ^=1.41\hat{\mu} = 1.41–1.631.63 (2.52). The median observed μ^\hat{\mu} of every condition is 0.035 below that from the exact stationary law (15) of the K=1K = 1 fits, and for the conditions with K∗>1K^* > 1, whose chains have no stationary law in closed form, by simulations of the chains fitted at the selected depth. Over the full range of flights a truncated log-normal law describes the histogram better than a truncated power law in eight conditions out of ten, so “Lévy” here means at most two decades of approximate scaling; the memory is the same with either single-flight law (Appendix F).

Termites

Castiblanco et al. [2, 43] tracked focal workers of the termite Cornitermes cumulans for 6 h at 2 Hz, in Petri dishes about 49 mm across, together with nestmates at different densities. Each of the 75 tracks contains 673 to 12 091 flights (median 3746), enough to analyze every termite on its own, with K≤10K \le10.

Figure 3. Single walkers. (a) Drosophila larvae: lag-1 coupling with one field per larva (±2\pm2 s.e.) and, on the right, the depth K∗K^* selected by BIC; filled symbols, K∗>0K^*>0; grey bands, ±2\pm2 s.d. over 30 within-larva permutations of the flights. Circles, controls; squares, neurons silenced with shibirets{}^{ts}; diamond, brain lobes and sensory neurons ablated (genotypes in Appendix F). (b) Depth selected in each of 75 termites (ochre), and by the within-track permutation and pipeline nulls (grey), which select K∗=0K^*=0. (c) Memory kernel of the termites, from fits with K=10K=10: single termites (thin lines), median and interquartile range. (d) Exponent of the histogram of all flights, μ^\hat{\mu}, against the exponent of the one-step rule, μbare\mu_{\mathrm{bare}}, for the larval conditions with memory (medians over larvae, symbols as in (a)) and for each termite; dashed, the diagonal of renewal walkers.

Every termite remembers. BIC selects a depth between 1 and 8, with a median of 4 [Fig. 3(b)], and the lag-1 coupling of the fit at the selected depth is positive in all 75 tracks, J1=0.34±0.10J_1 = 0.34\pm0.10 (mean ±\pm s.d. over termites); the memory kernel decays over about five flights [Fig. 3(c)]. Within-track permutations select memory in 0.3% of the surrogates, and the pipeline null gives K∗=0K^*=0 in 74 of 75 tracks. With fields re-estimated every 50 or 25 flights the lag-1 coupling stays significant in every termite (median z=21z=21 and 18, minimum 6.3).

Termites, like many insects, keep close to walls, a behavior known as thigmotaxis: they spend 30%, 59% and 79% of the time within 3, 6 and 9 mm of the wall of the dish. The memory could therefore have been geometric, long flights along the wall following each other. It is not. Adding the wall state of each flight as a covariate leaves the lag-1 coupling unchanged (median 0.42 without and 0.41–0.43 with it, for the three bands) and the selected depth unchanged (median 4), and on runs of consecutive flights far from the wall the coupling is even larger, J1≃0.49J_1\simeq0.49 (Appendix F).

The termites sit further into the phase diagram than the larvae, at Φ=1.0\Phi=1.0–3.5 (median 1.46) [Fig. 1(c)]: all of them beyond the spinodal, and 7% beyond the condensation line, consistent with an arena that bounds their longest flights. These coordinates come from fits with K=1K=1, whose lag-1 coupling, 0.42 in the median, absorbs about two thirds of the total coupling of the selected depth, Jtot=0.70J_{\mathrm{tot}}=0.70. In the coordinates in which the duality holds at any depth, Φ=JtotL/(μbare−1)\Phi=J_{\mathrm{tot}}L/(\mu_{\mathrm{bare}}-1) (Sec. III B), the termites sit deeper, at a median of 1.73 (1.48–2.44), again all beyond the spinodal and 7% beyond the self-dual line. The cutoff does not move them either: with ℓmax⁡\ell_{\max} set for every termite to the 49 mm diameter of the dish rather than to its longest flight, Φ\Phi has a median of 1.41, all termites remain beyond the spinodal, and 3% are beyond the self-dual line. Their exponents are the most dressed [Fig. 3(d)]. The one-step rule has a median μbare=2.07\mu_{\mathrm{bare}}=2.07, the histogram μ^=1.49\hat{\mu}=1.49: read from the histogram, the exponent is off by more than half a unit, and five termites, beyond the self-dual line, have μ^<1\hat{\mu}<1 (Sec. III C). The apparent exponent grows with the density of nestmates (medians 1.18, 1.51 and 1.59 at densities 0.08, 0.12 and 0.20), and it does so through the one-step rule: μbare\mu_{\mathrm{bare}} grows from 1.72 to 2.11 and 2.25, while Φ\Phi changes little, from 1.61 to 1.45 and 1.37. In a more crowded dish termites draw shorter flights, as they would if encounters with nestmates interrupted them, with a memory of nearly unchanged strength; the same trends hold when the flights below ℓmin⁡\ell_{\min} are left out (Appendix F).

Baboons and pigeons

A wild troop of olive baboons [24, 44], 26 animals tracked by GPS every second for 14 days, is a group whose members share a clock and whose positions define neighbors. We use a clock of 10 s, each day being a co-recorded group (6×1046\times10^4 frames in all), and both variables, log-speeds and headings, a log heading being defined for steps of at least 1 m (Appendix F). Analyzed through its group average, the troop has a long memory: the selected depth has a median of 9.5 delays over days for headings and is 10, the largest tried, for log-speeds. Time-shifted baboons give the same depths, 10 in 82% of the day replicates for headings and in all of them for log-speeds [Fig. 4(f)]. The depth is thus each baboon’s own persistence (a^1=0.70\hat{a}_1=0.70 for headings, 0.23 for log-speeds), seen through the group average as in Eq. (25).

The self + social model, with baboon and time fields, finds in addition a delayed alignment with the three nearest neighbors, J1=0.449±0.007J_1=0.449\pm0.007 at 10 s (in a troop of this size the time fields inflate heading couplings by about 5%; Appendix G), which decays over a minute [Fig. 4(a)]; on a clock of 30 s the first coupling is the same, 0.447±0.0080.447\pm0.008. Three controls single it out. Time-shifted baboons keep a coupling of 0.10±0.010.10\pm0.01 at the shortest delays, because animals that pass the same place at different times head the same way, a field fixed in space that time fields cannot absorb; the data exceed it fourfold. The coupling lives at the nearest neighbors: 0.233 ±\pm 0.004 with the single nearest, then 0.140, 0.095 and 0.044 with the second, third and sixth, and zero with the twelfth Figure 4(b). And it is asymmetric: neighbors ahead along the group heading weigh 0.374 ±\pm 0.006, those behind 0.214 ±\pm 0.006, against 0.050 and 0.034 for time-shifted baboons Figure 4(c). A baboon thus turns toward where its nearest neighbors, those ahead above all, were heading 10 to 30 s earlier, in line with the following of initiators documented in this troop [24]; a path walked first by those ahead would act in the same direction, and fields fixed in space would be needed to tell the two apart. Log-speeds tell the same story on a smaller scale. J1=0.052±0.002J_1 = 0.052 \pm0.002 against 0.017±0.0010.017 \pm0.001 for shifted baboons. Read with a global coupling and no time fields, the same headings give J1=0.79J_1 = 0.79 Figure 4(a), squares, the alignment plus the common motion of the troop.

Figure 4. Groups. Top: a wild baboon troop [24] (14 days, clock 10 s, headings). (a) Couplings of a baboon’s heading to the mean heading of its three nearest neighbors at delay τ\tau, with baboon and time fields (±2\pm2 s.e.); grey, mean ±2\pm2 s.d. over 20 troops in which every baboon is shifted in time; open squares, a global coupling without time fields. (b) Coupling at 10 s to a single neighbor of given distance rank, all ranks fitted jointly. (c) Couplings to the neighbors ahead (filled) and behind (open) along the group heading, among the six nearest; grey, time-shifted troops (solid, ahead; dashed, behind). Bottom: homing-pigeon flocks [25] (41 releases, clock 1 s). (d) As (a), for the nearest neighbor. (e) Couplings at 1 s to a single neighbor of given rank, relative to the nearest, for headings (filled) and log-speeds (open); grey, time-shifted flocks. (f) Depth τM\tau_M selected by the group-average analysis, as a fraction of the largest depth tried (marked on the right, in frames of the clock of each system), on the data (coral) and on time-shifted units (grey): median and interquartile range over days (baboons), releases (pigeons) and surrogates; for the T cells, 16 fish pooled.

Homing pigeons [25, 45], three flocks released 41 times, form small groups of three to eight birds per frame, which we follow on a clock of 1 s. On this scale flight is nearly ballistic, and a bird’s heading is extrapolated from its last three, a^τ=(185,−82,21)\hat{a}_{\tau} = (185, -82, 21), that is, from its direction and

its rate of turn. These numbers are large because they are concentrations. Multiplying unit vectors, the couplings add up to the modulus ∣θ∣|\theta| of the von Mises law, whose inverse square root is the angular spread of the heading Sec. II D. At 1 s the heading of a pigeon departs from its extrapolation by a few degrees, which requires ∣θ∣|\theta| of order 10210^2; at 10 s a baboon turns far more, and its couplings are of order one. The group-average analysis again returns the depths of time-shifted birds, 1 to 3 s in 80% of the releases against 91% for shifted birds Figure 4(f). The self + social model couples each bird to its nearest neighbor with Jτ=(17.6±0.6,−11.0±0.8,3.8±0.8)J_{\tau} = (17.6 \pm0.6, -11.0 \pm0.8, 3.8 \pm0.8), against (0.6±0.4,−0.2±0.4,−0.4±0.6)(0.6 \pm0.4, -0.2 \pm0.4, -0.4 \pm0.6) for shifted birds Figure 4(d). The alternating signs repeat those of own memory: a bird follows both the last heading of its neighbor and its last turn. In flocks of three to eight birds the time fields, one per frame, inflate all heading couplings by a common factor, an effect of incidental parameters [46] that on synthetic flocks with these couplings amounts to 1.9, 1.5 and 1.3 for three, five and eight birds (Appendix G). The values above are therefore too large in scale, but not in sign, in their ratios or in their comparison with the time-shifted birds, which share flocks and fields; log-speed couplings show no such inflation. In flocks this small the heading coupling does not decay over the three nearest neighbors, whereas speeds match the nearest one most Figure 4(e); log-speeds are coupled with J1=3.8±0.1J_1 = 3.8 \pm0.1, against 0.5±0.20.5 \pm0.2 for shifted birds. Nor is the coupling stronger toward birds ahead (3.5±0.33.5 \pm0.3 ahead, 5.3±0.35.3 \pm0.3 behind among the three nearest): pigeons follow their leaders with delays of fractions of a second [47], within one frame of this clock, and a model of delayed couplings sees only the interactions slower than its frame.

A negative control: T cells

T cells close the analysis as a negative control, first for single walkers. Jerison and Quake [3] tracked T cells, a class of leukocytes, as they migrate in vivo through the tissue of living zebrafish, and showed that the apparent heavy tails of the steps of these cells come from differences between cells, so any memory found with one field for all cells should be heterogeneity in disguise. It is. With one field for all cells, every group of T cells (and of Dictyostelium amoebae from the same data set) shows deep memory, and it still does after the steps of each cell are shuffled (K∗=5K^{*} = 5–66 in 49 of 50 surrogates), which can only be heterogeneity. With one field per cell the shuffled data give K∗=0K^{*} = 0 in every surrogate, the memory of mouse T cells disappears, and zebrafish T cells and Dictyostelium keep a short persistence (J1≃0.14J_1 \simeq0.14–0.150.15 per frame; Appendix F).

The same cells also test the group analysis. Zebrafish T cells co-recorded within each fish on a common clock of 45 s (16 fish, 712 cells, 85 016 steps) remember their own speed for about four frames (a^1≃0.20\hat{a}_1 \simeq0.20). The group-average analysis selects a delay of 8 frames, the largest tried, and it selects the same delay in 20 of 20 time-shifted surrogates [Fig. 4(f)]: the delay is own memory. A weak coupling to the three nearest cells, J1=0.021±0.006J_1 = 0.021 \pm0.006, vanishes once time fields are included, 0.005±0.0070.005 \pm0.007; what remains is a drive shared within each fish.

These findings characterize the relevant timescale of speed correlations rather than ruling out immune interactions broadly. While immune cells interact biochemically, synaptically, and collectively during target swarming [20, 48, 49, 50, 51], in the baseline tissue conditions of Ref. [3] these interactions do not manifest as delayed speed correlations on a 45 s clock. The zebrafish T cells therefore provide a clean empirical negative control: a benchmark collective where apparent delays detected by group averaging stem entirely from individual cellular persistence.

The same model and the same controls thus return different answers for different groups: a delayed alignment of baboons with their nearest neighbors, stronger toward those ahead; a flock-wide coupling for pigeons, whose leader–follower delays are shorter than a frame; and no delayed coupling between the speeds of T cells. In none of the three could the answer be read off the group average, whose selected depth is in each case the own memory of the units.

Discussion

Lévy walks are usually judged by the histogram of their flights, while the renewal hypothesis on which the textbook model rests, that every flight is drawn afresh, is seldom tested directly. To our knowledge, this work is one of the first to test it with a model of the sequence of flights whose depth the data select, and the first to do so with maximum entropy. The renewal Lévy walk turns out to be a convenient idealization, and most of the walkers analyzed here do not follow it. Larvae and termites remember their recent flights, positively and over a few flights, and the memory survives every control we could think of: one field per individual, fields that drift along the track, other ways of cutting tracks into flights, permutation and pipeline nulls, and, for the termites, the wall that they follow. In the larvae it is strongest when brain lobes and sensory neurons have been ablated, which places its origin, together with that of the Lévy-like statistics [1], below the brain. Part of the dependence between flights may come from switches between behavioral states, which a chain of flights describes as memory; couplings within each state would apportion the two [52].

Memory changes what a histogram means. A walker that packs long flights into runs has a heavier-tailed histogram than the rule it follows at each turn, by more than half a unit of exponent in the termites. An exponent read from a histogram, often compared with the value μ=2\mu= 2 of optimal search [5], need not be the exponent of the rule that generates the walk. Memory also gives the cutoffs a physical role: the coupling acts through JLJL, the flights condense at the largest scale beyond a self-dual coupling, and over the one or two decades accessible to experiments the walk feels that transition well before reaching it: every termite has crossed its spinodal. Two extensions follow directly: a joint model of the length and the direction of flights, with couplings between speed and turning [3], and the transport properties of Lévy walks whose flights are coupled in this way, to which renewal theory does not apply, and in which the time spent in runs of long flights condenses before their number does (Sec. III B).

In groups, the same formalism separates what the group average mixes: each unit’s memory of its own past, drives common to all units, and the influence of the others. Read through the average, own memory appears as a delayed coupling whose strength does not decrease with the size of the group, and a common drive as a coupling at any delay. Read with the self + social model, the delays found in zebrafish T cells are own memory and a drive shared within each fish, baboons align with where their nearest neighbors, those ahead above all, were heading 10 to 30 s earlier, and pigeons couple to their whole flock from one second to the next. The recipe applies to any attempt to infer delayed interactions from trajectories: model units, not their average; give each unit its own field and memory and each frame its own field; couple units to their neighbors rather than to the group; compare with time-shifted units; and check how a coupling depends on the distance and on the position of the neighbor. Fields fixed in space, such as trails or a homing route, survive both time fields and time shifts, and are the natural next ingredient. Finally, the collective speed has a critical point of its own, at Jc=12/L2J_c = 12/L^2, set by the largest susceptibility of a single flight: a delayed positive coupling between scale-free speeds produces collective stop-and-go, a negative one oscillations, and own memory lowers the threshold.

Data and code availability

All trajectories analyzed in this work are publicly available [1, 3, 43, 44, 45]. All code to reproduce the analyses and figures is openly available at https://github.com/coscienza-research/levy-walks-maxent.

Acknowledgments

We are grateful to the authors of Refs. [1, 2, 3, 24, 25] for making their data public. A.B., A.L. acknowledge financial support from the Italian National Institute for Higher Mathematics (INdAM) through the GNFM group. Additionally, A.B. acknowledges support from INFN, Sezione di Roma 1. A.B. acknowledges the grant NEEDLE from Sapienza Università di Roma. A.L. acknowledges support from the project ULTR-ACLOCK from Sapienza Università di Roma. The authors acknowledge the use of the Lagrange Multi-GPU Server at the Department of Mathematics, Sapienza University of Rome, for computational resources supporting this work.

One flight and the chain with one lag

a. Single-site law. For p(x)∝eθxp(x) \propto e^{\theta x} on [0,L][0,L], Z(θ)=(eθL−1)/θZ(\theta) = (e^{\theta L}-1)/\theta and ln⁡Z(θ)=θL/2+ln⁡[2sinh⁡(θL/2)/θ]\ln Z(\theta) = \theta L/2+\ln[2\sinh(\theta L/2)/\theta], so that

dln⁡Zdθ=L2+L2coth⁡θL2−1θ=Λ(θ),d2ln⁡Zdθ2=Λ′(θ),(26)\frac{d\ln Z}{d\theta}=\frac{L}{2}+\frac{L}{2}\coth\frac{\theta L}{2}-\frac{1}{\theta}=\Lambda(\theta),\qquad\frac{d^{2}\ln Z}{d\theta^{2}}=\Lambda'(\theta), \tag*{(26)}

which is Eq. (3) [Fig. 5(a)]. With u=2x/L−1u=2x/L-1, p(u)∝ebup(u)\propto e^{bu} on [−1,1][-1,1] with b=θL/2b=\theta L/2, and ⟨u⟩=L(b)\langle u\rangle=\mathcal{L}(b): this is the law of cos⁡ϑ\cos\vartheta for a classical unit vector with Boltzmann weight ebcos⁡ϑe^{b\cos\vartheta}, since the area element sin⁡ϑ dϑ dφ=−d(cos⁡ϑ) dφ\sin\vartheta\,d\vartheta\,d\varphi=-d(\cos\vartheta)\,d\varphi is uniform in cos⁡ϑ\cos\vartheta. The maximum of Λ′\Lambda' is at θ=0\theta=0, where L′(0)=1/3\mathcal{L}'(0)=1/3 gives Λ′(0)=L2/12\Lambda'(0)=L^{2}/12. Adding the constraint ⟨x2⟩\langle x^{2}\rangle gives p(x)∝eθx−βx2p(x)\propto e^{\theta x-\beta x^{2}}, a log-normal law truncated to [ℓmin⁡,ℓmax⁡][\ell_{\min},\ell_{\max}], which we use as a nested alternative, with integrals computed by Gauss–Legendre quadrature.

b. Detailed balance. With π(x)∝ehxZ(h+Jx)\pi(x)\propto e^{hx}Z(h+Jx) and the kernel p(y∣x)=e(h+Jx)y/Z(h+Jx)p(y|x)=e^{(h+Jx)y}/Z(h+Jx),

π(x) p(y∣x)∝ehx+(h+Jx)y=eh(x+y)+Jxy,(27)\pi(x)\,p(y|x)\propto e^{hx+(h+Jx)y}=e^{h(x+y)+Jxy}, \tag*{(27)}

which is symmetric in (x,y)(x,y); π\pi is therefore stationary and the chain reversible. Under x→L−xx\to L-x, y→L−yy\to L-y the exponent becomes 2hL+JL2−(h+JL)(x+y)+Jxy2hL+JL^{2}-(h+JL)(x+y)+Jxy, the same weight with h→−h−JLh\to-h-JL; the self-dual line is h=−JL/2h=-JL/2.

c. Path versus causal measure. The path measure (5) with K=1K=1 is a reversible Markov chain whose kernel is the Doob transform of its transfer operator, ppath(y∣x)=ehy+Jxyφ(y)/[λ0φ(x)]p_{\mathrm{path}}(y|x)=e^{hy+Jxy}\varphi(y)/[\lambda_{0}\varphi(x)], with φ\varphi the Perron eigenfunction of the kernel eh(x+y)/2+Jxye^{h(x+y)/2+Jxy} on [0,L][0,L] and λ0\lambda_{0} its eigenvalue.

ehy+Jxyφ(y)/[λ0φ(x)]e^{hy+Jxy}\varphi(y)/[\lambda_{0}\varphi(x)], with φ\varphi the Perron eigenfunction of the kernel eh(x+y)/2+Jxye^{h(x+y)/2+Jxy} on [0,L][0,L] and λ0\lambda_{0} its eigenvalue. The causal kernel is the same expression with φ≡1\varphi\equiv1 and normalization Z(h+Jx)Z(h+Jx). Since ln⁡φ(y)=J⟨x⟩0y+O(J2)\ln\varphi(y)=J\langle x\rangle_{0}y+O(J^{2}), with ⟨x⟩0\langle x\rangle_{0} the mean at J=0J=0, the two families coincide to first order in JJ after the shift hcausal=hpath+J⟨x⟩0h_{\mathrm{causal}}=h_{\mathrm{path}}+J\langle x\rangle_{0}, and they differ at order J2J^{2} through an effective log-normal curvature that grows near the thresholds. Fitted to T=6000T=6000 flights generated by either family, the two return J^=0.095\hat{J}=0.095 and 0.0990.099, with log-likelihoods within 2 nats.

The path measure has the same duality, with self-dual line h=−JLh=-JL instead of h=−JL/2h=-JL/2. In the path measure each flight interacts with both its neighbors in time, so a run of flights at the cutoff exerts on a flight a field h+2JLh+2JL, against h+JLh+JL in the causal chain, and the self-dual coupling is half as large at the same bare field. This difference in the self-dual couplings reflects the shift in the baseline field: because hcausalh_{\mathrm{causal}} and hpathh_{\mathrm{path}} differ by J⟨x⟩0J\langle x\rangle_{0}, matching nominal fields do not correspond to the same walk. Throughout this work, we focus exclusively on the causal formulation. We verified numerically, with the transfer operator on 160 Gauss–Legendre nodes, that on the self-dual line of the path measure Π=1/2\Pi=1/2 for every LL, and that the crossover sharpens with LL as for the causal chain.

Large-range theory of the condensation

For θL→+∞\theta L\to+\infty, ln⁡Z(θ)=θL−ln⁡θ+o(1)\ln Z(\theta)=\theta L-\ln\theta+o(1); for θL→−∞\theta L\to-\infty, ln⁡Z(θ)=−ln⁡∣θ∣+o(1)\ln Z(\theta)=-\ln|\theta|+o(1). With h=−αh=-\alpha, J=β/LJ=\beta/L and x=uLx=uL, the field after a flight xx is θ=−α+βu\theta=-\alpha+\beta u, and

ln⁡π(uL)=−αuL+Lmax⁡(βu−α,0)+O(ln⁡L),(28)\ln\pi(uL)=-\alpha uL+L\max(\beta u-\alpha,0)+O(\ln L), \tag*{(28)}

which is Eq. (20). F(u)F(u) is piecewise linear: it increases with slope α\alpha for u<α/βu<\alpha/\beta and, if β>α\beta>\alpha, decreases with slope α−β\alpha-\beta beyond. The end u=1u=1 is thus a local minimum for β>α\beta>\alpha (spinodal, J=JupJ=J_{\mathrm{up}}) and the global one for β>2α\beta>2\alpha (coexistence, J=JcondJ=J_{\mathrm{cond}}), where F(1)=2α−βF(1)=2\alpha-\beta changes sign. The mass near each minimum is e−LFe^{-LF} up to algebraic prefactors, so Π→Θ(β−2α)\Pi\to\Theta(\beta-2\alpha) as L→∞L\to\infty, a first-order jump. At finite LL the exact condition for a secondary maximum of π\pi at the cutoff is JΛ(h+JL)>μbare−1J\Lambda(h+JL)>\mu_{\mathrm{bare}}-1, which tends to J>JupJ>J_{\mathrm{up}} for wide ranges; below JcondJ_{\mathrm{cond}} its weight is exponentially small, π(L)/π(0)∼e(2h+JL)L\pi(L)/\pi(0)\sim e^{(2h+JL)L}.

Metastability can be seen directly. Starting a chain at x=Lx=L in the window α<β<2α\alpha<\beta<2\alpha, the first flight shorter than ℓmin⁡ℓmax⁡\sqrt{\ell_{\min}\ell_{\max}} occurs after a mean number of flights that grows exponentially with LL: at β=1.8α\beta=1.8\alpha, from 4 at ℓmax⁡/ℓmin⁡=102\ell_{\max}/\ell_{\min}=10^{2} to 9 at 10410^{4} and 73 at 10810^{8} (4000 simulated chains each). In this window a walker that enters a run of long flights stays in it for a time set by the range, the dynamical signature of a metastable phase.

Estimation

a. Likelihood and Newton’s method. Writing θi,t=w⋅zi,t\theta_{i,t}=w\cdot z_{i,t}, with ww collecting fields and couplings and zi,tz_{i,t} the corresponding regressors (indicators of the walker or block, lagged flights, covariates), the negative log-likelihood −l=∑i,t[ln⁡Z(θi,t)−θi,txi,t]-l=\sum_{i,t}[\ln Z(\theta_{i,t})-\theta_{i,t}x_{i,t}] has gradient ∑[Λ(θ)−x]z\sum[\Lambda(\theta)-x]\boldsymbol{z} and Hessian ∑Λ′(θ)zzT\sum\Lambda'(\theta)\boldsymbol{z}\boldsymbol{z}^{\mathsf{T}}, positive semi-definite. We use Newton’s method with a backtracking line search, started from the renewal solution, which converges in a few iterations to a gradient below 10−810^{-8} per flight. The Hessian at the optimum is the observed Fisher information [10]; the sandwich covariance I−1GI−1\mathbf{I}^{-1}\mathbf{G}\mathbf{I}^{-1}, with G\mathbf{G} the sum of outer products of the per-flight scores, guards against misspecification and is used for the couplings of the fits with one field per walker. All depths K≤Kmax⁡K\leq K_{\max} are fitted on the same flights, those with at least Kmax⁡K_{\max} predecessors, so that they can be compared. The timings quoted in Sec. IV A use a dense Hessian on a single thread.

b. Centering and the bare exponent. In the fits the lags are centered, θt=h+∑τJτ(xt−τ−c)\theta_t=h+\sum_\tau J_\tau(x_{t-\tau}-c), with cc the mean of xx (of each track, with one field per walker), which decorrelates the field from the couplings. The bare exponent is μbare=1−h′\mu_{\mathrm{bare}}=1-h', with h′=h−c∑τJτh'=h-c\sum_\tau J_\tau the field after a run of the shortest flights; its standard error follows from the delta method.

c. Fields per walker, local fields and covariates. With one field per walker, zi,t\boldsymbol{z}_{i,t} contains the indicator of walker ii; with local fields, the indicator of the block of BB flights to which tt belongs (the last block is merged with the previous one if shorter than B/2B/2); a known covariate wi,tw_{i,t}, such as the wall state of a flight, adds a column, θt→θt+gwt\theta_t\to\theta_t+g w_t. The incidental-parameter bias of the couplings, of order 1/Ti1/T_i [33], is measured on surrogates in which the flights of each walker (or of each block) are permuted, and the zz-scores of Table II are computed against these permutation distributions.

Model selection and validation

a. AIC and BIC under the null. For nested models of depths 0,…,Kmax⁡0,\ldots,K_{\max}, under the null the likelihood-ratio statistics of successive increments are asymptotically independent χ12\chi_1^2 variables, so that Δk=∑j≤k(χ1,j2−2)\Delta_k=\sum_{j\leq k}(\chi_{1,j}^2-2) is a random walk with negative drift, and AIC selects the depth at which it is largest. Spitzer’s combinatorial lemma gives the probability that the maximum is attained at k=0k=0, hence Eq. (24) [36, 37]. Replacing the penalty 22 by ln⁡n0\ln n_0 (BIC) makes the drift diverge, and the false-positive rate decreases as P(χ12>ln⁡n0)P(\chi_1^2>\ln n_0) to leading order. Cross-validation with a fixed training fraction estimates the same expected out-of-sample log-likelihood as AIC and is asymptotically equivalent to it [38]; it becomes consistent only if the training fraction vanishes [39]. Our blocked cross-validation splits each track into five contiguous folds separated by gaps of Kmax⁡K_{\max} flights.

b. Planted walkers. Walkers generated by the causal chain with random parameters (Figure 6) lie along the diagonal of planted versus inferred couplings, and the errors in units of the Fisher standard errors have mean −0.01-0.01 and standard deviation 0.970.97. BIC recovers the planted depth in 78% of the walkers and never selects a deeper one; when it errs, the last coupling is below detection. AIC selects a deeper chain in 24% of the walkers. On renewal walkers the false-positive rate of AIC stays at the level of Eq. (24) for every length from 250 to 16 000 flights, that of blocked cross-validation is slightly higher (28–35%), and that of BIC vanishes as P(χ12>ln⁡T)P(\chi_1^2>\ln T). The rates are the same, 21–25% for AIC and at most 0.75% for BIC, for exponents μ=1.5\mu=1.5–2.5 and for ranges up to five decades.

What can look like memory

a. The variable. The statistic ℓtℓt−1\ell_t\ell_{t-1}, the natural guess in linear space, is dominated by a handful of extreme flights. For a weak memory, a Gaussian-copula autoregression with truncated-Pareto marginals and correlation ρ=0.1\rho=0.1 (T=4000T=4000), the log statistic xtxt−1x_tx_{t-1} detects it in 98% of the walkers and the linear one in none [Fig. 7(a)].

b. Heterogeneity. With 40 memoryless walkers whose exponents are spread over [1.2,2.2][1.2,2.2], a model with a common field selects the maximal depth in every replicate and returns J1≃0.11J_1\simeq0.11 for a planted 0.05. One field per walker removes both the false positives and the bias [Fig. 7(b)].

c. Corridor segmentation. Positions are sampled at fixed times with noise, and flights must be cut out of the track. A flight is the longest stretch of track that stays within a corridor of half-width ε\varepsilon around the segment joining its end points [53, 54]; the track is scanned from its start, each flight being extended until a point leaves the corridor, and its length is the distance between its end points.

d. Merging. Localization noise displaces single points out of the corridor and splits a long flight into two long pieces, a positive correlation between consecutive lengths that the analysis reads as memory: a renewal Lévy walk segmented in this way shows K∗=2K^* = 2–3 [Fig. 7(c)], and the lag-1 autocorrelation of ln⁡ℓ\ln\ell rises from 0.02 to 0.21. We

merge consecutive pieces whose headings differ by less than θc=20∘\theta_c = 20^\circ, which restores K∗=0K^* = 0 while leaving genuine memory detectable. Applied to true flights with independent turning angles, merging deletes boundaries independently of the lengths, an i.i.d. thinning of the renewal process, which therefore remains renewal; applied to noise-split pieces, it restores the original flights. The test of Figure 7(c) uses renewal Lévy walks of 3000 flights with μ=2\mu= 2 over three decades, uniformly random directions and unit speed, sampled at Δt=0.25\Delta t = 0.25 with Gaussian localization noise of standard deviation 0.02, and segmented with ε=0.1\varepsilon= 0.1 and ℓmin⁡=1\ell_{\min} = 1.

e. Pipeline null. On real data the track is cut at its flight boundaries; the pieces, each with its own sub-sampled points, are reshuffled, rotated, and reconnected with turning angles drawn from the empirical distribution; the whole pipeline (segmentation, merging, fit) is then run again on the rebuilt track. Any memory found there is produced by the pipeline.

f. Signatures of mechanisms. Mechanisms of dependence differ in how the selected depth grows with the length of the data Figure 7(d). K∗K^* stays at zero for a renewal walk and saturates at the true order for a finite memory. It grows slowly for a walker that switches between hidden states, whose dependence decays geometrically and becomes resolvable lag after lag, and without bound for long-range memory.

Data sets and controls on single walkers

a. Preprocessing. Table I lists the data. For the larvae and the termites, flights below ℓmin⁡=1\ell_{\min}=1 mm (5–13% of all flights in the larval conditions, 28% for the two lines with silenced or ablated sensory neurons, and a median of 15%, 2–30%, of the flights of a termite) are set to ℓmin⁡\ell_{\min}. For the larvae, ℓmax⁡\ell_{\max} is the longest flight of the condition. For the termites, ℓmax⁡\ell_{\max} is the longest flight of each track (26–45 mm), and the wall state of a flight is the fraction of its points within 3, 6 or 9 mm of the wall, the arena being estimated from the track as the circle that contains 99.5% of its points. For the T cells the variable is the displacement per frame, with ℓmin⁡\ell_{\min} at the 5th percentile. For the collective analyses, ℓmin⁡\ell_{\min} is at the localization floor (5th percentile) and steps above the 99.95th percentile are treated as tracking glitches. Baboon positions are taken every 10 s (every 30 s for the robustness check) and pigeon positions every second, keeping the first fix of each second for the birds logged at 5 Hz. A heading is defined for steps of at least 1 m (baboons, about four times the GPS error) or 3 m (pigeons); a unit that moves less contributes a zero vector to its own lags and to its neighbors’ regressors, and its heading at that frame, being undefined, is left out of the likelihood. Each day (baboons) or release (pigeons) is a co-recorded group, with its own unit and time fields.

b. Larvae. Table II details the ten conditions. The memory does not depend on the segmentation, with ϵ∈{0.25,0.5,1}\epsilon\in\{0.25,0.5,1\} mm and ℓmin⁡∈{0.5,1,2}\ell_{\min}\in\{0.5,1,2\} mm, and in six of the seven conditions with memory it survives fields re-estimated every 50 or 25 flights Figure 8(a); in BL>shi it does not. Over the full range [ℓmin⁡,ℓmax⁡][\ell_{\min},\ell_{\max}] a truncated log-normal law with ⟨x2⟩\langle x^2\rangle also fixed, describes the histogram better than a truncated power law in eight conditions out of ten (ΔBIC=286\Delta\mathrm{BIC}=286–1625); the power law is competitive only for the larvae with silenced or ablated sensory neurons. This does not contradict tail fits above a data-chosen xmin⁡x_{\min} [55], but “Lévy” here refers to two decades at most. The memory is the same with either single-flight law (Table II, z25z_{25}).

Controls on real walkers

Figure 8. Controls on real walkers. (a) Drosophila larvae: zz-score of J1J_1 against permutation nulls for five segmentation settings (corridor half-width ε\varepsilon and ℓmin⁡\ell_{\min}, in mm; boxed, the setting of Table II), and with fields re-estimated every 50 or 25 flights, against permutations within blocks. (b) Termites: lag-1 coupling of a K=1K=1 fit with and without a wall field (band of 6 mm), one point per termite. (c) T cells and Dictyostelium [3]: depth selected after shuffling the steps within each cell, with a common field (crosses) or one field per cell (open circles), and on the real data with one field per cell (filled).

c. Flights below ℓmin⁡\ell_{\min}. Setting the flights below ℓmin⁡\ell_{\min} to ℓmin⁡\ell_{\min} places a point mass at x=0x=0, which the continuous law (2) does not have, and removes the memory term from the field of the next flight. The alternative is to condition on ℓ≥ℓmin⁡\ell\geq\ell_{\min}. The law eθXZ(θ)e^{\theta_X}Z(\theta) on [0,L][0,L] is exactly that of a flight conditioned to exceed ℓmin⁡\ell_{\min}, so the flights below ℓmin⁡\ell_{\min} can be dropped from the likelihood as responses and kept, at x=0x=0, among the lags. In the seven larval conditions with memory this lowers J1J_1 by 23–41%. The coupling stays positive in all of them, and at least 2.5 standard errors from zero in all but BL>shi, whose memory is a slow modulation. The bare exponent drops as well, most in the ablated larvae, from 2.72 to 2.09; their coupling, J1=0.19±0.04J_1=0.19\pm0.04, remains the largest of all conditions. Since both enter Φ=J1L/(μbare−1)\Phi=J_1L/(\mu_{\mathrm{bare}}-1), Φ\Phi moves by at most 0.2. In the termites, conditioning lowers the median J1J_1 of the K=1K=1 fits from 0.42 to 0.28 and the median μbare\mu_{\mathrm{bare}} from 2.07 to 1.67, and leaves every termite beyond the spinal (median Φ=1.61\Phi=1.61); μbare\mu_{\mathrm{bare}} still grows with the density of nestmates (medians 1.46, 1.68 and 1.75) while Φ\Phi decreases slightly (1.78, 1.58 and 1.48). Dropping also the flights that follow one below ℓmin⁡\ell_{\min}, or giving them a field of their own, changes the larval couplings of the conditions with memory by less than 0.025.

d. Termites and the wall. With the wall state of each flight as a covariate, the lag-1 coupling is unchanged in every termite Figure 8(b). The wall field improves BIC by a few units for the typical termite (median −3.5 at 6 mm) and by much more for a few, without affecting their memory.

e. T cells. With a common field, shuffled T cells select K∗=5K^*=5–6 in 49 of 50 surrogates, the maximal depth in 43; with one field per cell, K∗=0K^*=0 in every surrogate Figure 8(c). The steps are log-normal rather than power-law distributed, by 10210^2–10410^4 BIC units.

The collective model

a. Estimation. The self + social model (14) is fitted by Newton’s method with a sparse Hessian (unit and time fields) and a dense block for the shared couplings. The block of the time fields is diagonal, because each row belongs to one frame, so each Newton step eliminates it exactly (a Schur complement) and solves the remaining dense system for unit fields and couplings, a few hundred parameters; with 6 × 10410^4 time fields (baboons at 10 s) a fit takes seconds, with the same optimum and standard errors as a sparse factorization. Unit and time fields have one flat direction per co-recorded group, hi→hi+Δh_i \to h_i+\Delta, gt→gt−Δg_t \to g_t-\Delta, fixed by a vanishing ridge on the gtg_t; the flat directions are common to all models compared, so BIC differences are unaffected. Self and social depths are selected jointly by BIC on common rows. For directions, p(nit∣past)∝eθit⋅nitp(n_i^t|\mathrm{past}) \propto e^{\theta_i^t\cdot n_i^t} is a von Mises law [56] for the unit vector nitn_i^t of the step, with θit=hi+gt+∑τατnit−τ+∑τJτsit−τ\theta_i^t=h_i+g_t+\sum_\tau\alpha_\tau n_i^{t-\tau}+\sum_\tau J_\tau s_i^{t-\tau}, the planar spin of Ref. [22], where sit−τs_i^{t-\tau} is the mean unit vector of the neighbors; its negative log-likelihood Λ\Lambda in [0][0] is convex, and the time-field block is two-by-two block diagonal.

conditionmanipulationlarvaeflightsK∗K^*J1J_1zshz_{\mathrm{sh}}z25z_{25}Φ\Phi
BL/+, 22 °Ccontrol2419760−0.004±0.019-0.004 \pm0.0190.20.3 / 0.10.07
shi/+, 22 °Ccontrol19136600.088±0.0300.088 \pm0.0303.23.3 / 3.50.56
rpr,hidrpr,hid controlcontrol59424010.074±0.0120.074 \pm0.01212.36.6 / 8.20.77
BL/+, 33 °Ccontrol26233710.071±0.0160.071 \pm0.0165.33.6 / 4.80.69
shi/+, 33 °Ccontrol29260510.127±0.0130.127 \pm0.01311.210.4 / 7.41.02
MB247/+control21163020.139±0.0210.139 \pm0.0217.76.4 / 6.50.86
MB247>shimushroom bodies silenced22210330.168±0.0210.168 \pm0.0219.78.3 / 6.71.04
BL>shibrain lobes silenced17236640.058±0.0250.058 \pm0.0252.8−2.1-2.1 / −2.3-2.30.35
BLsens>shibrain lobes and sensory neurons silenced63490−0.063±0.106-0.063 \pm0.106−0.2-0.2−2.2-2.2 / −1.9-1.9−0.32-0.32
BLsens>rpr,hidrpr,hidbrain lobes and sensory neurons ablated18197620.307±0.0450.307 \pm0.0458.25.0 / 4.00.72

Table 2. Memory between consecutive flights of Drosophila larvae. BL drives expression in the brain lobes and part of the subesophageal ganglion, BLsens also in all sensory neurons, MB247 in the mushroom bodies; “shi” is the temperature-sensitive shibirets_{\mathrm{ts}}, which silences the targeted neurons at 33 °C, and rpr,hidrpr,hid the pro-apoptotic genes that kill them; X/+ and shi/+ carry a single transgene. K∗K^*: depth selected by BIC with one field per larva. J1J_1: lag-1 coupling of the fit with K=1K=1 (± s.e.). zshz_{\mathrm{sh}}: J1J_1 against 30 within-larva permutations of the flights. z25z_{25}: the same with fields re-estimated every 25 flights, against permutations within blocks (truncated power law / truncated log-normal single-flight law). Φ=J1L/(μbare−1)\Phi=J_1L/(\mu_{\mathrm{bare}}-1): median over larvae. The permutation null selects K∗>0K^*>0 in 1 of 300 surrogates, the pipeline null in none of 50.

b. Exactness of the mean-field measure. The measure PAP_A of Ref. [22] factorizes over units and frames with one-body weights exitθit/Z(θt)e^{x_i^t\theta_i^t}/Z(\theta_t), the first τM\tau_M frames being fixed by delta functions; evaluated at the data it is ∏t,ip(xit∣past)\prod_{t,i}p(x_i^t|\mathrm{past}) with θt=H+∑τJτmτt\theta_t=H+\sum_\tau J_\tau m_\tau^t. Concavity follows as for Eq. (8). The stationarity conditions ∑t,i[xit−Λ(θt)]=0\sum_{t,i}[x_i^t-\Lambda(\theta_t)]=0 and ∑t,i[xit−Λ(θt)]mt−τ=0\sum_{t,i}[x_i^t-\Lambda(\theta_t)]m_{t-\tau}=0 characterize the exact estimator, whereas

the original implementation [22] imposes Λ(θt)≃mt\Lambda(\theta_t)\simeq m_t frame by frame and solves it by least squares after the inversion Gt=Λ−1(mt)G_t=\Lambda^{-1}(m_t), a convenient moment approximation.

c. Aggregation. Let units be conditionally independent given their own pasts and jointly stationary. For a model of the group average alone, the expected score for JτJ_\tau at J=0J=0 is E[∑i(xit−mˉ)mt−τ]=N−1∑i,jCov⁡(xit,xjt−τ)=C^(τ)\mathbb{E}[\sum_i(x_i^t-\bar m)m_{t-\tau}]=N^{-1}\sum_{i,j}\operatorname{Cov}(x_i^t,x_j^{t-\tau})=\hat C(\tau) per frame, of order one: J=0J=0 is not a solution whenever there is own memory. Model Gt≃θ~+(mt−m~)/Λ′(θ~)G_t\simeq\tilde\theta+(m_t-\tilde m)/\Lambda'(\tilde\theta), the regression of GtG_t on lags of mm is 1/Λ′1/\Lambda' times the autoregression of mm on its own lags; since Cov⁡(mt,mt−τ)=N−1C^(τ)\operatorname{Cov}(m_t,m_{t-\tau})=N^{-1}\hat C(\tau), the factors N−1N^{-1} cancel in the Yule–Walker equations, which gives Eq. (25). For the self + social model with leave-one-out regressors, the tower property gives E[(xit−E[xit∣xi<t])mt−τ(−i)]=0\mathbb{E}[(x_i^t-\mathbb{E}[x_i^t|x_i^{<t}])m_{t-\tau}^{(-i)}]=0, because m(−i)m^{(-i)} is independent of unit ii: the social score vanishes at the truth.

d. Common drives. A shared stationary field utu_t with autocovariance CuC_u induces Cov⁡(xti,xt−τj)≃Λ′2Cu(τ)\operatorname{Cov}(x_t^i,x_{t-\tau}^j) \simeq\Lambda^{\prime2}C_u(\tau) between non-interacting units, to linear order. With unit and time fields, the identity mt−τ(−i)=NtNt−1mt−τ−1Nt−1xt−τim_{t-\tau}^{(-i)} = \frac{N_t}{N_{t-1}}m_{t-\tau} - \frac{1}{N_{t-1}}x_{t-\tau}^i (NtN_t units in the frame) shows that the global regressor is a function of the frame, absorbed by gtg_t, plus a multiple of the own lag. For τ≤Ks\tau\le K_s a global coupling is not identifiable (exactly so when NtN_t is constant); for τ>Ks\tau> K_s it estimates −(Nt−1)-(N_t-1) times the omitted own memory at that lag. A local regressor is not in the span of the time fields and own lags unless all neighborhood means coincide. On synthetic data [Figure 9(a)], every reading except local coupling with time fields declares a coupling under a common drive alone, and only that reading recovers a planted local coupling without bias.

e. Mean-field theory. By the law of large numbers, mt→Λ(H+∑τJτmt−τ)m_t \to\Lambda(H + \sum_\tau J_\tau m_{t-\tau}). Linearizing around a fixed point gives the characteristic equation 1=Λ′(θ∗)∑τJτz−τ1 = \Lambda'(\theta^*)\sum_\tau J_\tau z^{-\tau}. For non-negative couplings, f(z)=Λ′∑τJτz−τf(z) = \Lambda' \sum_\tau J_\tau z^{-\tau} is decreasing on z>0z > 0 and ∣f(z)∣≤f(∣z∣)|f(z)| \le f(|z|), so a root with ∣z∣≥1|z| \ge1 exists if and only if f(1)=Λ′Jtot≥1f(1) = \Lambda'J_{\mathrm{tot}} \ge1; when the delays have no common divisor the critical root is z=1z = 1 alone (a fold). Since Λ′≤L2/12\Lambda' \le L^2/12, with equality at θ=0\theta= 0, bistability requires Jtot>12/L2J_{\mathrm{tot}} > 12/L^2, the cusp being at θ~=0\tilde{\theta} = 0, m=L/2m = L/2. For a single delay dd the map decouples into dd sub-chains yn(r)=mnd+ry_n^{(r)} = m_{nd+r} obeying yn+1=Λ(H+Jyn)y_{n+1} = \Lambda(H + Jy_n); for J<0J < 0 each undergoes a flip at Λ′∣J∣=1\Lambda'|J| = 1, and a lag-1 term a1>0a_1 > 0 in the characteristic equation zd=Λ′J+Λ′a1zd−1z^d = \Lambda'J + \Lambda'a_1z^{d-1} favors the in-phase mode, of period 2d2d. For finite NN and one lag, δmt=Λ′Jδmt−1+ηt\delta m_t = \Lambda'J\delta m_{t-1} + \eta_t with Var⁡η=Λ′/N\operatorname{Var}\eta= \Lambda'/N gives NVar⁡(m)=Λ′/[1−(Λ′J)2]N\operatorname{Var}(m) = \Lambda'/[1-(\Lambda'J)^2] [Figure 9(b)].

f. Own memory in mean field. With lag-1 self coupling a≥0a \ge0, propagation of chaos makes each unit, at a stationary state m∗m^*, an independent chain with field heff=H+Jtotm∗h_{\mathrm{eff}} = H + J_{\mathrm{tot}}m^* and stationary law π(x)∝eheffxZ(heff+ax)\pi(x) \propto e^{h_{\mathrm{eff}}x}Z(h_{\mathrm{eff}} + ax), (15). The self-consistency is m∗=Ψ(H+Jtotm∗)m^* = \Psi(H + J_{\mathrm{tot}}m^*), with Ψ(h)≡Eh[x]\Psi(h) \equiv\mathbb{E}_h[x], and the symmetry line is H+(Jtot+a)L/2=0H + (J_{\mathrm{tot}} + a)L/2 = 0. A field perturbation propagates as δmt=∑s≥0R(s) δht−s\delta m_t = \sum_{s\ge0}R(s)\,\delta h_{t-s}, with R(s)=Cov⁡(xs,ϵ0)R(s) = \operatorname{Cov}(x_s,\epsilon_0) the response of one unit, $\epsilon_0 = x_0 - \mathbb{E}[x_0|\mathrm{past}] being the innovation; for a≥0a \ge0, R(s)≥0R(s) \ge0, the argument above applies to 1=R^(z)Jτz−τ1 = \hat{R}(z)J_\tau z^{-\tau}, and stability is lost at Jtotχ=1J_{\mathrm{tot}}\chi= 1 with χ=∑sR(s)=∂Ψ/∂h\chi= \sum_s R(s) = \partial\Psi/\partial h. To leading order in 1/N1/N, NVar⁡(m)=∫dω2πSx(ω)∣1−J^(ω)R^(ω)∣−2N\operatorname{Var}(m) = \int\frac{\mathrm{d}\omega}{2\pi} S_x(\omega)|1-\hat{J}(\omega)\hat{R}(\omega)|^{-2}, with SxS_x the spectrum of one unit. We compute RR, SxS_x and χ\chi from the transition matrix of the chain on 400 Gauss–Legendre nodes.

Synthetic collectives

The speed-­Vicsek model places NN units in a periodic box; headings follow Vicsek alignment [57], and log-speeds are drawn from Eq. (14) with planted own memory, local (three nearest neighbors) or global couplings and, when stated, a common Ornstein–Uhlenbeck drive; steps are then recomputed from the positions, as in an experiment. Individual fields are drawn from U(−1.3,−0.5)U(-1.3,-0.5). Table III collects the experiments. Directions behave like speeds: for units with persistent turning and no interaction, the group-average analysis of directions declares delayed interactions in every replicate, the self + social von Mises model in none. With AIC instead of BIC, the self + social model itself declares spurious couplings in 27% of interaction-free data sets, the value of Eq. (24) again.

Time-shift null

In a time-shift surrogate every unit’s track is shifted by an independent random circular offset, which keeps its own memory, heterogeneity and marginal law and destroys every synchrony between units, interactions and common drives alike; a permutation of frames destroys own memory as well, and therefore tests memory and synchrony together.

Time fields in small groups

A time field is estimated from the NtN_t units present in its frame. Since the number of fields grows with the number of frames while NtN_t stays fixed, this is an incidental-parameter problem [46], and the shared couplings need not converge to their true values. We measured the effect on synthetic groups in which every unit is coupled to one other unit, drawn at random in each frame, with unit fields and a common drive. For log-speeds it is negligible: with a self coupling 0.4 and a social coupling 0.3, the fits with time fields return social couplings 0.32, 0.32, 0.30 and 0.30 for 3, 5, 8 and 26 units, against 0.30, 0.31, 0.30 and 0.30 without them.

For headings it is not, because in the von Mises law a coupling is also a concentration, and a field per frame absorbs part of the angular spread, just as a mean direction estimated from a few samples underestimates the dispersion about it. All couplings are then inflated by a common factor. For weakly concentrated headings (a1=0.7a_1 = 0.7, J1=0.45J_1 = 0.45) the factor is close to Nt/(Nt−1)N_t/(N_t-1): 1.56, 1.29, 1.16 and 1.05 for 3, 5, 8 and 26 units. For headings as concentrated as those of the pigeons [aτ=(185,−82,21)a_\tau= (185,-82,21), Jτ=(17.6,−11.0,3.8)J_\tau= (17.6,-11.0,3.8)] it is 1.9, 1.5 and 1.3 for 3, 5 and 8 units, the ratio of social to self coupling being preserved within 8%, and it disappears without time fields. A null coupling acquires at most a small positive offset, between 1 and 2.5 for three units and below 1 for five, against self couplings of order 10210^2, which the time-shifted surrogates of the same groups carry as well. Signs and ratios of heading couplings, and their comparison with time-shifted surrogates, are therefore unaffected, whereas their absolute values in small groups are upper bounds.

Neighbors in real groups

The local regressor of unit ii at delay τ\tau is the mean of the variable over the units of distance ranks r0+1,…,r1r_0+1,\ldots,r_1 from ii at the emission frame t−τt-\tau: the three nearest for baboons, and the nearest one for pigeons, whose flocks have three to eight birds in a frame, so that a larger neighborhood would be the whole flock and, as shown above, not identifiable with time fields. The decay with distance is measured by single-neighbor regressors of ranks 1, 2, 3, 6 and 12 (baboons) or 1, 2 and 3 (pigeons), fitted jointly with three delays each; the asymmetry, by splitting the six (baboons) or three (pigeons) nearest neighbors into those ahead of and those behind ii along the group heading, the direction of the mean step at t−τt-\tau. Anchoring the neighborhood at the current position of ii instead (the units that at t−τt-\tau were nearest to where ii is now) also picks up fields fixed in space, such as trails, which time fields cannot absorb. In the time-shift null the positions are shifted with the steps, so the neighbors of a shifted unit are whoever passed near the same place at another time: the null removes synchrony but keeps fields fixed in space, and its coupling to the nearest neighbor need not vanish.

References

References

  1. [1]D. W. Sims, N. E. Humphries, N. Hu, V. Medan, and J. Berni, Optimal searching behaviour generated intrinsically by the central pattern generator for locomotion, eLife 8, e50316 (2019).DOI
  2. [2]J. Castiblanco, P. F. Cristaldo, L. R. Paiva, and O. DeSouza, Social context modulates scale-free movements in a social insect, J. Theor. Biol. 542, 111106 (2022).DOI
  3. [3]E. R. Jerison and S. R. Quake, Heterogeneous T cell motility behaviors emerge from a coupling between speed and turning in vivo, eLife 9, e53933 (2020).DOI
  4. [4]N. E. Humphries, N. Queiroz, J. R. M. Dyer, N. G. Pade, M. K. Músyk, K. M. Schaefer, D. W. Fuller, J. M. Brunnschweiler, T. K. Doyle, J. D. R. Houghton, G. C. Hayes, C. S. Jones, L. R. Noble, V. J. Wearmouth, E. J. Southall, and D. W. Sims, Environmental context explains Lévy and Brownian movement patterns of marine predators, Nature 465, 1066 (2010).DOI
  5. [5]G. M. Viswanathan, S. V. Buldyrev, S. Havlin, M. G. E. da Luz, E. P. Raposo, and H. E. Stanley, Optimizing the success of random searches, Nature 401, 911 (1999).pubmed.ncbi.nlm.nih.gov/10553906
  6. [6]V. Zaburdaev, S. Denisov, and J. Klafter, Lévy walks, Rev. Mod. Phys. 87, 483 (2015).
  7. [7]A. M. Edwards, R. A. Phillips, N. W. Watkins, M. P. Freeman, E. J. Murphy, V. Afanasyev, S. V. Buldyrev, M. G. E. da Luz, E. P. Raposo, H. E. Stanley, and G. M. Viswanathan, Revisiting Lévy flight search patterns of wandering albatrosses, bumblebees and deer, Nature 449, 1044 (2007).pubmed.ncbi.nlm.nih.gov/17960243
  8. [8]G. H. Pyke, Understanding movements of organisms: it’s time to abandon the Lévy foraging hypothesis, Methods Ecol. Evol. 6, 1 (2015).DOI
  9. [9]A. M. Reynolds, Current status and future directions of Lévy walk research, Biol. Open 7, bio030106 (2018).DOI
  10. [10]E. Aghion, P. G. Meyer, V. Adlakha, H. Kantz, and K. E. Bassler, Moses, Noah and Joseph effects in Lévy walks, New J. Phys. 23, 023002 (2021).DOI
  11. [11]E. T. Jaynes, Information theory and statistical mechanics, Phys. Rev. 106, 620 (1957).DOI
  12. [12]W. Bialek, A. Cavagna, I. Giardina, T. Mora, E. Silvestri, M. Viale, and A. M. Walczak, Statistical mechanics for natural flocks of birds, Proc. Natl. Acad. Sci. USA 109, 4786 (2012).DOI
  13. [13]T. Mora, A. M. Walczak, L. Del Castillo, F. Ginelli, S. Melillo, L. Parisi, M. Viale, A. Cavagna, and I. Giardina, Local equilibrium in bird flocks, Nat. Phys. 12, 1153 (2016).pubmed.ncbi.nlm.nih.gov/27917230
  14. [14]Y. Roudi and J. Hertz, Mean field theory for nonequilibrium network reconstruction, Phys. Rev. Lett. 106, 048702 (2011).pubmed.ncbi.nlm.nih.gov/21405370
  15. [15]H. C. Nguyen, R. Zecchina, and J. Berg, Inverse statistical problems: from the inverse Ising problem to data science, Adv. Phys. 66, 197 (2017).DOI
  16. [16]S. Pressé, K. Ghosh, J. Lee, and K. A. Dill, Principles of maximum entropy and maximum caliber in statistical physics, Rev. Mod. Phys. 85, 1115 (2013).DOI
  17. [17]H. Ge, S. Pressé, K. Ghosh, and K. A. Dill, Markov processes follow from the principle of maximum caliber, J. Chem. Phys. 136, 064108 (2012).DOI
  18. [18]O. Marre, S. El Boustani, Y. Frégnac, and A. Destexhe, Prediction of spatiotemporal patterns of neural activity from pairwise correlations, Phys. Rev. Lett. 102, 138101 (2009).pubmed.ncbi.nlm.nih.gov/19392405
  19. [19]A. Cavagna, I. Giardina, F. Ginelli, T. Mora, D. Piovani, R. Tavarone, and A. M. Walczak, Dynamical maximum entropy approach to flocking, Phys. Rev. E 89, 042707 (2014).pubmed.ncbi.nlm.nih.gov/24827278
  20. [20]E. Agliari, P. J. Sáez, A. Barra, M. Piel, P. Vargas, and M. Castellana, A statistical inference approach to reconstruct intercellular interactions in cell migration experiments, Sci. Adv. 6, eaay2103 (2020).DOI
  21. [21]F. Alemanno, M. Cavo, D. Delle Cave, A. Fachechi, R. Rizzo, E. D’Amone, G. Gigli, E. Lonardo, A. Barra, and L. L. del Mercato, Quantifying heterogeneity to drug response in cancer-stroma kinetics, Proc. Natl. Acad. Sci. USA 120, e2122352120 (2023).DOI
  22. [22]E. Agliari, F. Alemanno, A. Barra, M. Castellana, D. Lotito, and M. Piel, Inverse modeling of time-delayed interactions via the dynamic-entropy formalism, Phys. Rev. E 110, 024301 (2024).DOI
  23. [23]E. W. Montroll and M. F. Shlesinger, Maximum entropy formalism, fractals, scaling phenomena, and 1/f noise: a tale of tails, J. Stat. Phys. 32, 209 (1983).DOI
  24. [24]A. Strandburg-Peshkin, D. R. Farine, I. D. Couzin, and M. C. Crofoot, Shared decision-making drives collective movement in wild baboons, Science 348, 1358 (2015).
  25. [25]R. S. Mehlhausen-Franks and S. J. Portugal, Changing flight and flocking dynamics of homing pigeons (Columba livia d.) over heterogeneous landscapes, Ecol. Evol. 15, e71902 (2025).
  26. [26]J. P. Burg, Maximum Entropy Spectral Analysis, Ph.D. thesis, Stanford University (1975).
  27. [27]T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. (Wiley, Hoboken, NJ, 2006).
  28. [28]B. D. Ziebart, J. A. Bagnell, and A. K. Dey, The principle of maximum causal entropy for estimating interacting processes, IEEE Trans. Inf. Theory 59, 1966 (2013).DOI
  29. [29]H. A. Kramers and G. H. Wannier, Statistics of the two-dimensional arrangement. Part I, Phys. Rev. 60, 252 (1941).DOI
  30. [30]K. Binder and D. P. Landau, Finite-size scaling at first-order phase transitions, Phys. Rev. B 30, 1477 (1984).DOI
  31. [31]C. Beck and E. G. D. Cohen, Superstatistics, Physica A 322, 267 (2003).
  32. [32]W. Bialek, A. Cavagna, I. Giardina, T. Mora, O. Pohl, E. Silvestri, M. Viale, and A. M. Walczak, Social interactions dominate speed control in poising natural flocks near criticality, Proc. Natl. Acad. Sci. USA 111, 7212 (2014).DOI
  33. [33]S. Nickell, Biases in dynamic models with fixed effects, Econometrica 49, 1417 (1981).DOI
  34. [34]H. Akaike, A new look at the statistical model identification, IEEE Trans. Autom. Control 19, 716 (1974).DOI
  35. [35]G. Schwarz, Estimating the dimension of a model, Ann. Stat. 6, 461 (1978).DOI
  36. [36]R. Shibata, Selection of the order of an autoregressive model by Akaike’s information criterion, Biometrika 63, 117 (1976).DOI
  37. [37]M. Woodroofe, On model selection and the arc sine laws, Ann. Stat. 10, 1182 (1982).DOI
  38. [38]M. Stone, An asymptotic equivalence of choice of model by cross-validation and Akaike’s criterion, J. R. Stat. Soc. B 39, 44 (1977).DOI
  39. [39]J. Shao, Linear model selection by cross-validation, J. Am. Stat. Assoc. 88, 486 (1993).DOI
  40. [40]R. W. Katz, On some criteria for estimating the order of a Markov chain, Technometrics 23, 243 (1981).DOI
  41. [41]I. Csiszár and P. C. Shields, The consistency of the BIC Markov order estimator, Ann. Stat. 28, 1601 (2000).
  42. [42]T. Kitamoto, Conditional modification of behavior in Drosophila by targeted expression of a temperature-sensitive shibire allele in defined neurons, J. Neurobiol. 47, 81 (2001).pubmed.ncbi.nlm.nih.gov/11291099
  43. [43]J. Castiblanco, P. F. Cristaldo, L. R. Paiva, and O. DeSouza, Dataset on termite trajectories in experimental arenas under varying social context, Zenodo, doi:10.5281/zenodo.3628061 (2019).DOI
  44. [44]M. C. Crofoot, R. W. Kays, and M. Wikelski, Data from: Shared decision-making drives collective movement in wild baboons, Movebank Data Repository, doi:10.5441/001/1.kn0816jn (2015).DOI
  45. [45]R. S. Mehlhausen-Franks and S. J. Portugal, Data from: Changing flight and flocking dynamics of homing pigeons (Columba livia d.) over heterogeneous landscapes, Dryad, doi:10.5061/dryad.4tmpg4fp6 (2025).DOI
  46. [46]J. Neyman and E. L. Scott, Consistent estimates based on partially consistent observations, Econometrica 16, 1 (1948).
  47. [47]M. Nagy, Z. Ákos, D. Biro, and T. Vicsek, Hierarchical group dynamics in pigeon flocks, Nature 464, 890 (2010).DOI
  48. [48]E. Agliari, E. Biselli, A. De Ninno, G. Schiavoni, L. Gabriele, A. Gerardino, F. Mattei, A. Barra, and L. Subirano, Cancer-driven dynamics of immune cells in a microfluidic environment, Sci. Rep. 4, 6639 (2014).DOI
  49. [49]C. A. Sabatos, J. Doh, S. Chakravarti, R. S. Friedman, P. G. Pandurangi, A. J. Tooley, and M. F. Krummel, A synaptic basis for paracrine interleukin-2 signaling during homotypic T cell interaction, Immunity 29, 238 (2008).DOI
  50. [50]A. Gérard, O. Khan, P. Beemiller, E. Oswald, J. Hu, M. Matloubian, and M. F. Krummel, Secondary T cell–T cell synaptic interactions drive the differentiation of protective CD8+ T cells, Nat. Immunol. 14, 356 (2013).DOI
  51. [51]J. L. Galeano Niño, S. V. Pageon, S. S. Tay, F. Colakoglu, D. Kempe, J. Hywood, J. K. Mazalo, J. Cremascolo, M. A. Govendir, L. F. Dagley, K. Hsu, S. Rizzetto, J. Zieba, G. Rice, V. Prior, G. M. O’Neill, R. J. Williams, D. R. Nisbet, B. Kramer, A. I. Webb, F. Luciani, M. N. Read, and M. Biro, Cytotoxic T cells swarm by homotypic chemokine signalling, eLife 9, e56554 (2020).DOI
  52. [52]F. Stoye, A. Hoyer, and R. Langrock, Autoregressive hidden Markov models for high-resolution animal movement data, J. Agric. Biol. Environ. Stat. (2025), doi:10.1007/s13253-025-00705-6.DOI
  53. [53]I. Rhee, M. Shin, S. Hong, K. Lee, S. J. Kim, and S. Chong, On the Lévy-walk nature of human mobility, IEEE/ACM Trans. Netw. 19, 630 (2011).
  54. [54]N. E. Humphries, H. Weimerskirch, and D. W. Sims, A new approach for objective identification of turns and steps in organism movement data relevant to random walk modelling, Methods Ecol. Evol. 4, 930 (2013).
  55. [55]A. Clauset, C. R. Shalizi, and M. E. J. Newman, Power-law distributions in empirical data, SIAM Rev. 51, 661 (2009).
  56. [56]K. V. Mardia and P. E. Jupp, Directional Statistics (Wiley, Chichester, 2000).DOI
  57. [57]T. Vicsek, A. Czirók, E. Ben-Jacob, I. Cohen, and O. Shochet, Novel type of phase transition in a system of self-driven particles, Phys. Rev. Lett. 75, 1226 (1995).pubmed.ncbi.nlm.nih.gov/10060237

Paper details

vlnc:W_hca2s5s6
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents