We establish a dimension-free long-time reverse transportation, respectively Harnack inequality for the underdamped Langevin dynamics with non-convex potential. Specifically, we prove that for any two initial points z,z′ and Pt the underdamped Langevin semigroup, it holds \begin{equation} \mathrm{KL}(δ_z P_t|δ_{z'}P_t) \leq C\mathrm{e}^{-χt}|z-z'|(\mathcal{R}\vee|z-z'|) \end{equation} for all t>δ where δ>0 is arbitrarily small and C=C(δ),R,χ>0 are dimension free constants. In particular, our proof extends recent results which are restricted to either the convex underdamped or the non-convex but overdamped setting.
Introduction
In this article we are interested in the underdamped Langevin stochastic differential equation (SDE), that is, the stochastic process Zt=(Xt,Vt) satisfying
dXtdVt=Vtdt={−γVt−∇U(Xt)}dt+2γdWt(1)
with Brownian motion (Wt)t, a friction parameter γ>0 and a potential U:Rd→R. Specifically, for possibly non-convex U we derive a reverse transportation inequality for (ULD). That is, denoting the semigroup induced by (ULD) as Pt, we prove the existence of dimension-free constants C,χ,R>0 such that
KL(δzPt∣δz′Pt)≤Ce−χt∣z−z′∣(R∨∣z−z′∣),(2)
where KL denotes the Kullback–Leibler divergence. We may represent δzPt and δz′Pt as the laws of Zt respectively Zt′ which solve ULD with initial condition Z0=z, Z0′=z′ and z,z′∈R2d, that is,
We refer to section 4.6 for a short proof via Donsker-Varadhan variational formula.
A main obstruction in proving (2) is the fact that the initial distributions δz,δz′ are mutually singular whenever z=z′ prohibiting many arguments based on a direct application of Girsanov’s theorem to compare the two [SDEs] in (3).
As a remedy, one may consider coupling techniques using a third auxiliary process, a technique referred to as shifted Girsanov, cf. [13, 1, 2, 3]. More specifically, we consider an auxiliary bridge process (Ztaux)t interpolating between z′ and ZT, i.e., Z0aux=z′ and ZTaux=ZT at a prescribed time T>0. This allows us to write, KL(ZT∣ZT′)=KL(ZTaux∣ZT′aux). By designing the process (Ztaux)t appropriately, we can ensure that the path measures of (Ztaux)t and (Zt′)t are, indeed, mutually absolutely continuous hence allowing to estimate KL(ZT′∣ZT) using Girsanov.
Related Work and Contributions
Underdamped Langevin Due to its accelerating properties there is a vast literature on underdamped Langevin dynamics. The main technical difficulty of underdamped Langevin is the degeneracy of the Brownian motion, which led to Villani’s development of hypocoercivity [Villani, 2006]. In the machine learning community the research on underdamped Langevin was largely incited by [4]. For works considering the convex setting and synchronous coupling, see [6, 4, 12]. In the non-convex setting, reflection coupling with carefully designed distance functions has been fruitfully used to derive contraction results in Wasserstein distances [8, 7] (Schuh 2024). Furthermore, there is a vast literature on different discretizations of underdamped Langevin dynamics. Most notably, its structure is amenable to splitting methods where individual components of the drift are integrated alternatingly [11, 12]. A discretization scheme that has been particularly successful is the randomized midpoint scheme [2] (Shen and Lee 2019). Of all the cited works, the most closely related is undoubtedly [2]. There the authors employ the shifted Girsanov argument that is also used in the present article and leads to improved scaling in the condition number κ.
Shifted Girsanov and reverse-Transport- and Harnack Inequalities Dimension-free Harnack inequalities were first shown for heat semigroups on manifolds via semigroup methods in [Wang, 1997] and afterward via coupling techniques in [3]. By now there is an extensive body of literature regarding Harnack inequalities and their applications and we refer to [Wang, 2010a, 2013, 2010b, Wang and Yuan, 2011] for some overviews. In fact, [3] is the work pioneering the idea of using a third auxiliary process together with Girsanov’s theorem to derive Harnack type inequalities. More recently, the works of [1] and [2] used a shifted Girsanov arguments to establish reverse transport inequalities for the overdamped and underdamped Langevin dynamics. In [13] the techniques from [2] are applied to the overdamped Langevin diffusion in the non-logconcave setting. Finally, [9] derived reverse transportation inequalities for the underdamped Langevin diffusion via a chain of implications (cf. [Wang, 2013, Section 1.3]). However, in contrast to our results, their bounds do not converge to 0 as T→∞.
Contributions As mentioned above, our work can be seen as an extension of some of the results in [2, 13]. In particular, [2] provide a corresponding convergence result only for convex potentials2 and [13] for non-convex potentials but for the overdamped Langevin dynamics. Conversely the results in the present article cover the non-convex and underdamped setting. It should be mentioned, however, that [2, 13] provide additional results in other contexts. In particular, in [2] the authors also consider the discrete setting and in [13] results are also obtained for the, more general, Rényi divergence.
Notation and Assumptions
Notation Throughout x will be used for the position variable, v for the velocity, and z=(x,v) for the position-velocity pair and we note that several different variations of these symbols will appear (x,X,X′,Xaux etc.). The set of probability measures on Rd is denoted as P(Rd). We write μ≪ν when μ is absolutely continuous w.r.t. ν, and with dνdμ for the Radon-Nikodym derivative of μ w.r.t. ν. We define the Kullback-Leibler divergence as
We will denote for simplicity for two random variables X,Y
KL(X∣Y):=KL(law(X)∣law(Y)).(6)
The symbol O is used to denote complexity results omitting logarithmic factors. Our main assumptions about the potential U are L-smoothness and strong convexity outside a ball:
Assumption 3.1.The potential U∈C2(Rd) and there exist L,m,R>0 such that we have
LI⪰∇2U(x)⪰−LI,x∈Rd(7)
∇2U(x)⪰mI,∣x∣≥R.(8)
Proof of the main result
Set-up
To prove the above stated reverse transportation inequality we rely on the shifted composition principle introduced in [3] and recently rediscovered in [1, 2]. We explain and motivate the approach in the following.
Our goal is to bound the KL divergence between the law of two solutions of (ULD) initialized at z0,z0′∈R2d, respectively
Recall, however, that a naïve application of Girsanov’s theorem to these processes as-is will not lead to meaningful bounds as the different initializations render the respective path measures mutually singular. As a remedy, we introduce a deliberately designed interpolating auxiliary process Zaux which satisfies on one hand Z0aux=z0′ so that we may apply Girsanov’s theorem to compare Zaux and Z′. On the other hand, we design Zaux such that at a finite time T>0 it holds law(ZTaux)=law(ZT) which implies KL(ZT∣ZT′)=KL(ZTaux∣ZT′). In other words, the process Zaux constitutes a bridge from Z0′ to ZT. Let us now make this construction more concrete:
where (Wt)t and (Wt)t are two Brownian motions coupled in a deliberate way, which will be explained below. Crucially, the shift parameters ηtv,ηtx will be chosen to satisfy ηtv,ηtx→∞ as t→T ensuring that ZTaux=ZT at a finite time T. In addition, we have a second solution of (ULD) initialized at z0′
where we note that, technically, (10) is not defined on the same probability space as (AUX) (see section A for details). Applying Girsanov’s theorem to compare Zaux with Z′ then yields
where we used the hitting condition law(ZTaux)=law(ZT) and the data processing inequality. To now obtain the desired bounds, (2) respectively (4), it remains to estimate the above integral.
Proof outline The proof consists of the following steps:
Inspired by [13] we define a time t^∈[0,T] at which a regime transition happens. For t≥t^ we will choose ηtx,ηtv≫0. In this regime the shifts are strong, and a synchronous coupling, that is, dWt=dWt in (AUX) is sufficient to show contraction and prove the hitting condition ZTaux=ZT.
Conversely, for t<t^ we set ηtx=ηtv=0. In this regime, Ztaux and Zt are two conventional ULD processes. Thus, we employ a reflection coupling for Wt and Wt (cf. [8] (Schuh 2024)) which allows us to derive contraction in a deliberately designed distance without any shifts.
The result follows by concatenating the bounds in the two regimes.
The remainder of the article contains the proof details.
Coupling construction
It is well-known in the literature that purely synchronous coupling is unsuitable to derive contraction results for (ULD) in the non-convex setting (cf. [8]). Thus, we rely on a combination of synchronous and reflection coupling. More precisely, building on [8] (Schuh 2024) we first introduce new coordinates. Specifically, let us denote
Pt=Xt+γ−1Vt(12)
and analogously for the auxiliary process. Then (ULD) reads as
with (Wtrc)t, (Wtsc)t two independent Brownian motions and the reflector Rs=(I−2esesT) with et=Qt/∣Qt∣ and Qt=Pt−Ptaux. The two smooth cut-off functions sc,rc:R2d×R2d→[0,1] satisfy sc2+rc2=1. One may then check that Wt and Wt are, indeed, Brownian motions by Lévy’s characterization [10 Theorem 3.16]. While for t>t^ we have standard synchronous coupling, the construction for t<t^ is exactly the one from [Schuh, 2024] and we refer to this work for the details and limit ourselves to a high-level explanation here.
Essentially, the coupling should be synchronous whenever Qt=0 or Zt−Ztaux is large. The reason therefore is that in the first case, Pt=Ptaux and thus the first equation in (13) yields a contraction also in the X-component. In the second case, on the other hand, the convexity outside a ball of U provides contraction with synchronous coupling. Thus, the reflection coupling is active only in the intermediate regime, where Zt−Ztaux is small but not zero.
Contraction for t>t^
We begin by investigating the regime t>t^. In this setting, we define a slightly different twisted coordinate system than (12). Specifically, we set
The definition of the time-dependent friction parameter γt=γ+ηtv follows naturally from collecting the Vtaux-terms in (AUX). Note that P differs from P by the factor 2 in the bottom right entry of At. Moreover, we introduce the notation
Dt:=[Xt−XtauxVt−Vtaux],Tt:=AtDt(17)
for the difference processes in regular and twisted coordinates. Next, we fix the precise definition of the shift parameters.
Definition 4.1 (Shift parameters). We define the shift parameters for c0>0, as
where we introduce the notation Qt=−sym((A˙t+AtMt)At−1) with the symmetrization sym(M):=(M+MT)/2 for any quadratic matrix M. By [2 Lemma 3.13] for c0≥24, it holds for the smallest eigenvalue of Q
λmin(Qt)≥48(ηtv)2(25)
where we note that this bound is proven in [2 Lemma 3.13] in both the high and low friction settings. Inserting the lower bound and the definition of ηtv yields with c′=481
To proof the hitting condition, note that since E[∣Xt−Xtaux∣2]≤E[∣Tt∣2]→0 as t→T we directly obtain convergence of the x-component. For the v-component we have for c′c0>2
Thus, it holds Ztaux→ZT and Zt′→ZT′ both in L2. Indeed, L2 convergence implies weak convergence of the laws and therefore, by (joint) weak lower semicontinuity of the KL we do, in fact, have
Remark 4.1. Note that, if we were to set t^=0 the bound in (29) would not tend to zero as T→∞ since ω<0. The exponential decay therefore has to be established in [0,t^].
Remark 4.2. Note that the above arguments – especially the application of Girsanov to bound the KL – rely on strong existence and uniqueness of solutions of the occurring SDEs which is not trivially given due to the singular coefficients ηsν,ηsx. However, for any t<T, strong existence and uniqueness on [0,t] follow from standard results due to Lipschitz-continuity. While ηsν,ηsx exhibit a discontinuity at s=t^, we have strong existence and uniqueness, on [0,t^) as well as [t^,t] leading to a unique solution on [0,t] by concatenation. This is sufficient for the limit argument in (31).
Contraction for t<t^
In view of (29) it remains to bound E[∣Tt^∣2]. Given that ηtν=ηtx=0 for t∈[0,t^) this means we have to obtain a contraction result for regular (ULD). Readily available results, however, do not directly yield satisfying rates. Indeed, we can identify three groups of contraction results:
Strongly convex: For instance [4, 6] provide contraction in the L2-norm under the assumption of a strongly logconcave target using synchronous coupling. However, since we consider the non-logconcave setting, we cannot apply these results.
Non-logconcave: In L2 exponential decay in [8] is established using reflection and synchronous coupling even in the non-logconcave case. However, the convergence deteriorates exponentially in the dimension.
Lastly, using similar techniques as in [8], in [Schuh, 2024] dimension-free exponential decay was proven in the L1-norm.
Our goal is to apply the above mentioned L1-convergence result from [Schuh, 2024] which we state explicitly in the following.
Lemma 4.3 (Adapted from Theorem 5 and Remark 3 in [Schuh, 2024]). Let assumption 3.1 hold. Let further γ2≥m2(L+m)2 then it holds for some dimension free constants χ,C>0 and all 0≤s≤t<t^
EP[∣Tt∣]≤Ce−χ(t−s)EP[∣Ts∣].(39)
In order to apply lemma 4.3 we have to go from the L2 to the L1 norm. By Hölder’s inequality we have
E[∣Tt^∣2]≤E[∣Tt^∣]∥Tt^∥L∞(P).(40)
Thus, to conclude, we are left to derive an a.s. uniform bound of Tt^.
Lemma 4.4. Let assumption 3.1 hold and assume γ≥2L. Then, for t∈[0,t^] a.s.
Now we make a case distinction. Let R>0 be such that for ∣Xt−Xtaux∣>R it holds Ht⪰2mI. This can be ensured for R≍mLR, cf. lemma B.1. Then, for ∣Xt−Xtaux∣≤R the second row of (44) yields
where we symmetrized the matrix for the last equality. The eigenvalues of the above matrix are the solutions λ of the equation
0=(2γ+λ)2−(2γ−γμ)2(49)
with μ an eigenvalue of Ht. An explicit computation reveals that if γ2≥2μ the largest eigenvalue is −γμ and since μ>2m it holds
d∣Tt∣2≤−γm∣Tt∣2dt.(50)
In total, since γ≥2L it follows that t↦∣Tt∣2 is decreasing when
∣Tt∣2≳R2≳m2L2R2.(51)
Combining both cases, noting a.s. path-continuity, accounting for the initialization distance and equivalence of the twisted norm to the Euclidean norm yields the desired result.
Putting everything together
Theorem 4.1. Let assumption 3.1 be satisfied and γ2>m2(L+m)2. Fix δ>0. There exist dimension free constants C, R, χ depending only on the problem parameters L, m, R and C in addition on δ such that for T>δ
KL(ZT∥ZT′)≤C(R∨∣z0−z0′∣)e−χT∣z0−z0′∣.(52)
The constants R is polynomial in the problem parameters.
Remark 4.3. Note that the rate χ is the exact same convergence rate of [Schuh, 2024]. While R is only polynomial, C,χ deteriorate exponentially in the problem parameters. All constants are independent of the dimension d.
Harnack inequalities
It is well known that reverse transportation inequalities, such as in theorem 4.1, are dual to Harnack inequalities. We give a proof for completeness.
Lemma 4.5 (Logarithmic Harnack Inequality). Let Pt be the semigroup of (ULD) and z,z′∈R2d. Then theorem 4.1 is equivalent to
Ptlogf(z)≤C(R∨∣z−z′∣)e−χt∣z−z′∣+logPtf(z′),(56)
for all measurable, bounded, and strictly positivef.
Proof. “⇒”: By the Donsker–Varadhan theorem [5 Theorem 1.5.7] we have
Eμ[g]≤KL(μ∣ν)+logEν[eg],(57)
for probability measures μ,ν and any bounded and measurable test function g. Now let z,z′∈R2d and set μ=δzPt, ν=δz′Pt and set g=logf for smooth, bounded f satisfying f≥ε>0 for some ε. Inserting into (57) and using theorem 4.1 to bound the KL term yields
The result then follows by inserting the upper bound of the KL from theorem 4.1. For arbitrary bounded, measurable and strictly positive f, we may approximate f by fn=f∨n1. Then, by monotonicity we have
Taking the supremum over g yields the result again by Donsker–Varadhan. □
Conclusion, limitations and future work
We provided a proof for a long-term reverse transportation, respectively, Harnack inequality for the underdamped Langevin dynamics in the non-logconcave setting. The proof relies on a coupling construction with an interpolating auxiliary process. In particular, we retain the Wasserstein-1 convergence rates for the underdamped Langevin dynamics from [Schuh, 2024].
Limitations and Future work An interesting direction for future work is the adaptation of the results for convergence in Rényi divergence. As pointed out in [13] in this case it seems necessary to rely on a shift construction with bounded shifts. Moreover, we plan to combine our results with [14] to obtain convergence results for annealed underdamped Langevin dynamics in the non-convex setting.
Acknowledgements
This research was funded in whole or in part by the Austrian Science Fund (FWF) [10.55776/PAT4839425, 10.55776/F100800]. For open access purposes, the author has applied a CC BY public copyright license to any author-accepted manuscript version arising from this submission.
Rigorous arguments for the application of Girsanov’s theorem
Let (Ω,A,(Ft)t≥0,P) denote a filtered probability space satisfying the usual assumptions. For z0,z0′∈R2d and t^∈[0,T] we define the coupled SDE,
where the shift parameters ηtx,ηtv are to be defined later. For the coupling of the Brownian motions (Wt)t, (Wt)t we refer to § 4.2, respectively, [Schuh, 2024].
Next, define the measure Q via Nt:=−ηtx(Xt−Xtaux)−ηtv(Vt−Vtaux) and
where Mt is a function purely of (Zs,Zsaux)s≤t since also the Brownian motion (Wt)t can be expressed in terms of this process. By Girsanov’s theorem (Bt)t defined via B0=0 and
The Q-distribution of the first components (Xt,Vt)t in (AUX) is not directly tractable as it is unclear how the Brownian motion (Wt)t behaves under the change of measure, but it is also irrelevant for our purposes. If we denote as μSHIFTz0 the path measure of (AUX) in P and as μUDz0 the one in Q we have
with ∣⋅∣ the Lebesgue measure. One can easily verify that for ∣x−y∣≥R′, λ≤1∧R′2R, implying the desired result.
References
[1]J. M. Altschuler and S. Chewi. Shifted composition i: Harnack and reverse transport inequalities. IEEE Trans. Inf. Theory., 71(1):90–113, Jan. 2025. ISSN 0018-9448.arxiv.org/abs/2311.14520
[2]J. M. Altschuler, S. Chewi, and M. S. Zhang. Shifted composition iv: toward ballistic acceleration for log-concave sampling. In Proceedings of the 58th Annual ACM Symposium on Theory of Computing, pages 1739–1750, 2026.
[3]M. Arnaudon, A. Thalmaier, and F.-Y. Wang. Harnack inequality and heat kernel estimates on manifolds with curvature unbounded below. Bulletin des Sciences Mathématiques, 130(3):223–233, 2006. ISSN 0007-4497.DOI
[4]X. Cheng, N. S. Chatterji, P. L. Bartlett, and M. I. Jordan. Underdamped langevin mcmc: A non-asymptotic analysis. In Conference on learning theory, pages 300–323. PMLR, 2018.arxiv.org/abs/1707.03663
[5]S. Chewi. Log-concave sampling. Forthcoming, 2026. Available online at https://chewisinho.github.io/.
[6]A. S. Dalalyan and L. Riou-Durand. On sampling from a log-concave density using kinetic langevin diffusions. ArXiv, abs/1807.09382, 2018.
[7]A. Eberle and F. Lörler. Non-reversible lifts of reversible diffusion processes and relaxation times. Probability Theory and Related Fields, 194(1):173–203, Feb 2026. ISSN 1432-2064.
[8]A. Eberle, A. Guillin, and R. Zimmer. Couplings and quantitative contraction rates for langevin dynamics. The Annals of Probability, 2019.arxiv.org/abs/1703.01617
[9]A. Guillin and F.-Y. Wang. Degenerate fokker-planck equations : Bismut formula, gradient estimate and harnack inequality, 2012. URL https://arxiv.org/abs/1103.2817.
[10]I. Karatzas and S. Shreve. Brownian motion and stochastic calculus. springer, 2014.
[11]B. Leimkuhler and C. Matthews. Rational construction of stochastic numerical methods for molecular sampling. Applied Mathematics Research Express, 2013(1):34–56, 06 2012.
[12]B. J. Leimkuhler, D. Paulin, and P. A. Whalley. Contraction and convergence rates for discretized kinetic langevin dynamics. SIAM Journal on Numerical Analysis, 62(3):1226–1258, 2024.DOI
[13]J. Lu and Y. Wang. Long-time reverse transportation inequalities for non-globally-dissipative langevin dynamics, 2026.arxiv.org/abs/2512.18598