alphaFeedback

WorksMathematics

Discrete Exterior Calculus-based Whittle-Matérn Fields on Meshes

AI contributions
Not recorded for this paper
View details

Abstract

This work presents a sparse precision formulation for Whittle-Matérn fields based on Discrete Exterior Calculus. By treating the kk-cochain as the latent object to be modeled, we show that a single formulation can produce Whittle-Matérn fields for all kk and integer αα values. By utilising Whitney maps we can enable a push-forward of the prior on 1-cochains, enabling inference for discrete vector fields. We demonstrate this model on interpolation of vector fields on a sphere.

Introduction

Gaussian Processes (GPs) are a commonly-used tool for spatial modelling under uncertainty. A GP is a multivariate distribution where the joint distribution of every finite set of variables is Gaussian [16]. A GP is wholly defined by its mean and covariance functions, and the mean and variance of an unobserved spatial index is defined by the GP and any observed data. An isotropic GP is one where the covariance function is a function of the Euclidean distance between two spatial locations, and common GPs, such as the Matérn or squared exponential GPs, are isotropic.

However, on curved manifolds like spheres, Euclidean distance functions are not sufficient for defining spatial covariance, and using geodesic distance instead generally does not produce positive definite covariance. Borovitskiy et al. [6] introduce an alternative formulation for scalar covariance kernels defined on an arbitrary Riemannian manifold (M,g)(M, g) through the spectral decomposition of the Laplace-Beltrami operator −Δg-\Delta_g. Both Hutchinson et al. [12] and Robert-Nicoud et al. [17] extend this idea to modelling vector fields, the former through projected kernels, and the latter through applying derivative operators to the eigenfunctions of the Laplace-Beltrami to get vector fields. In particular, Robert-Nicoud et al. [17] show that Hodge-compositional processes can be constructed in this way, allowing separate parametrisations of the curling and diverging velocities in a vector field. Borovitskiy et al. [5] show that the spectral formulation of the Matérn GP can be applied to graphs and triangular meshes through the eigenpairs of the graph Laplacian, and show empirically that it converges to its smooth counterpart in the Riemannian setting. Yang et al. [21] propose a methodology for modelling functions on the edges of meshes, extending the formulation of intrinsic vector GPs with the graph Laplacian. Gillan et al. [9] show that the Hodge-compositional vector field model of Robert-Nicoud et al. [17] has a discrete analogue by substituting the discrete exterior calculus (DEC) cotangent Laplacian for −Δg-\Delta_g and showing that it can be used to model vector fields defined on the vertices of a manifold mesh. However, this precludes a sparse formulation. Alain et al. [2] develop a model for Matérn GPs over the components of a cellular complex, analogous to the simplicial complex of DEC, and propose a kernel for propagating information between different orders of cells. Alain and Takao [1] develop a similar model to Gillan et al. [9] using finite element exterior calculus, eliciting a similar covariance-based Hodge-compositional model without the restriction to mesh vertices.

Standard dense Gaussian-process calculations require O(N2)O(N^2) factorisation and O(N2)O(N^2) storage. The SPDE approach Lindgren et al. [14] explicitly constructs Matérn precision matrices for Gaussian Markov Random Fields (GMRFs) with respect to a mesh by discretising the SPDE using piece-wise linear basis functions, enabling sparse linear-algebra methods. As highlighted in a later review [13], this result can be generalised to smooth manifolds by replacing the Euclidean Δ\Delta with the equivalent manifold operator Δg\Delta_g. Nambiarajan (2026) show that a Gaussian Markov Random Field (GMRF) approximation for Whittle-Matérn fields can be built from DEC operators for fields on vertices and faces.

Background

Discrete Exterior Calculus

Exterior calculus is the calculus defined by generalising the derivative to operate on higher-degree differential forms [8]. A differential kk-form is a quantity that can be integrated over a kk-dimensional manifold; for example, the expression h(x)dxh(x)dx is a 1-form and can be integrated over a 1-dimensional line segment by

∫abh(x)dx\int_a^b h(x)dx

The discretisation of exterior calculus is called discrete exterior calculus (DEC) [11]. An implementation of most of the core theory is provided in the PyDEC library [3].

In the following, ω\omega, η\eta are smooth kk-forms, α\alpha, β\beta are discretised kk-forms, cochains, cc is a kk-chain, MM is the Riemannian manifold that is triangulated by the simplicial complex KK, and σk\sigma^k is a simplex of dimension kk. For an in-depth treatment see, e.g. Desbrun et al. [7].

Simplicial Complexes, Chains and Cochains

A smooth Riemannian manifold (M,g)(M,g) of dimension nn can be discretised as a finite collection of 0-, 1-, …\ldots, (n−1)(n-1)-, and nn-dimensional piecewise linear components. For a 2-dimensional manifold, these would be vertices (0-dimensional), edges (1-dimensional), and faces (2-dimensional). This collection of components is called a simplicial complex, KK, and the individual kk-dimensional components, σk\sigma^k, are called kk-simplices. We assume KK triangulates MM and that KK is embedded in Euclidean space with vertex positions chosen so that its lengths, areas and angles approximate those of (M,g)(M,g). We write K(k)K^{(k)} for the set of kk-simplices (e.g. K(1)K^{(1)} is the collection of edges on a triangulated surface) and Nk=∣K(k)∣N_k = |K^{(k)}|.

The orientation of a kk-simplex is the ordering of its vertices [v0,…,vk][v_0,\ldots,v_k], up to even permutations. The chain group Ck(K)C_k(K) is the abelian group generated by the oriented kk-simplices, where opposite orientations are negative. Fixing one orientation per simplex, Ck(K)C_k(K) is the free abelian group on K(k)K^{(k)},

Ck(K)={∑σk∈K(k)cσkσk:cσk∈Z}≅ZNk,(1)C_k(K) = \left\{ \sum_{\sigma^k \in K^{(k)}} c_{\sigma_k}\sigma^k : c_{\sigma_k} \in\mathbb{Z} \right\} \cong\mathbb{Z}^{N_k}, \tag*{(1)}

and we set Ck(K)=0C_k(K) = 0 for k<0k < 0 or k>nk > n. The orientations of individual simplices are an arbitrary choice.

A discrete kk-form, or kk-cochain, is a homomorphism α:Ck(K)→R\alpha: C_k(K) \to\mathbb{R}, and these form the cochain group

Ck(K):=Hom⁡(Ck(K),R).(2)C^k(K) := \operatorname{Hom}(C_k(K),\mathbb{R}). \tag*{(2)}

A cochain is determined by its values α(σk)\alpha(\sigma^k) on the simplices, and Ck(K)≅RNkC^k(K) \cong\mathbb{R}^{N_k}; a 0-cochain is a function on vertices, a 1-cochain a value on each oriented edge, and so on. We write

⟨α,c⟩:=α(c)=∑σk∈K(k)α(σk)cσk,α∈Ck(K), c∈Ck(K),(3)\langle\alpha,c\rangle:= \alpha(c) = \sum_{\sigma^k \in K^{(k)}} \alpha(\sigma^k)c_{\sigma_k}, \qquad\alpha\in C^k(K),\ c \in C_k(K), \tag*{(3)}

for the evaluation of a cochain on a chain.

The circumcentric dual of KK associates each kk-simplex σk\sigma^k with an (n−k)(n-k)-dimensional dual cell ⋆σk\star\sigma^k built from the circumcentres of the simplices containing σk\sigma^k. On a triangulated surface, the dual of a face is its circumcentre, the dual of an edge is the segment joining the circumcentres of its adjacent faces, and the dual of a vertex is the polygon joining the circumcentres of its incident faces. We write ∣σk∣|\sigma^k| and ∣⋆σk∣|\star\sigma^k| for the kk- and (n−k)(n-k)-dimensional volumes of a simplex and its dual cell, taking the volume of a point to be 1. On well-centred meshes (every simplex contains its circumcentre) all dual volumes are positive.

de Rham and Whitney Maps

Smooth and discrete forms are related through the de Rham and Whitney maps [19]. The de Rham map ψk\psi^k discretises a smooth kk-form ω\omega by integration over kk-simplices,

ψk(ω)(σk)=⟨ψk(ω),σk⟩:=∫σkω.(4)\psi^k(\omega)(\sigma^k)=\langle\psi^k(\omega),\sigma^k\rangle:=\int_{\sigma^k}\omega. \tag*{(4)}

ψkω\psi^k\omega is a well-defined cochain in Ck(K)C^k(K), and by linearity ⟨ψkω,c⟩=∫cω\langle\psi^k\omega,c\rangle=\int_c\omega for every chain c∈Ck(K)c\in C_k(K).

In the opposite direction, the Whitney map ϕk\phi^k interpolates a cochain α∈Ck(K)\alpha\in C^k(K) as a piecewise-smooth kk-form,

ϕkα=∑σk∈K(k)α(σk)Wσk.(5)\phi^k\alpha=\sum_{\sigma^k\in K^{(k)}}\alpha(\sigma^k)W_{\sigma^k}. \tag*{(5)}

Writing λi\lambda_i for the barycentric coordinate of vertex viv_i, equal to one at viv_i and zero at all other vertices, the Whitney forms of degree zero, one and two are

Wvi=λi,W[vi,vj]=λi dλj−λj dλi,Wf=1∣f∣dAf,(6)W_{v_i}=\lambda_i,\qquad W_{[v_i,v_j]}=\lambda_i\,\mathrm{d}\lambda_j-\lambda_j\,\mathrm{d}\lambda_i,\qquad W_f=\frac{1}{\lvert f\rvert}\mathrm{d}A_f, \tag*{(6)}

where f=[vi,vj,vl]f=[v_i,v_j,v_l] is a face on a triangulated surface and dAf\mathrm{d}A_f is its area form, oriented by the vertex ordering of ff. These satisfy ∫σkWσ′k=δσkσ′k\int_{\sigma^k}W_{\sigma^{\prime k}}=\delta_{\sigma^k\sigma^{\prime k}} for all σ,σ′∈K(k)\sigma,\sigma'\in K^{(k)}, so that

ψkϕk=I,(7)\psi^k\phi^k=I, \tag*{(7)}

i.e. interpolating a cochain and then discretising recovers it exactly.

Exterior Derivative

The discrete boundary operator ∂k:Ck(K)→Ck−1(K)\partial_k:C_k(K)\to C_{k-1}(K) is defined by

∂k[v0,…,vk]=∑i=0k(−1)i[v0,…,v^i,…,vk],(8)\partial_k[v_0,\ldots,v_k]=\sum_{i=0}^{k}(-1)^i[v_0,\ldots,\hat{v}_i,\ldots,v_k], \tag*{(8)}

where [v0,…,v^i,…,vk][v_0,\ldots,\hat{v}_i,\ldots,v_k] is the (k−1)(k-1)-dimensional simplex obtained by omitting the vertex viv_i [7]. ∂k\partial_k is represented by a sparse signed incidence matrix with entries in {0,±1}\{0,\pm1\}, and ∂k∂k+1=0\partial_k\partial_{k+1}=0.

The discrete exterior derivative, dk:Ck(K)→Ck+1(K)\mathrm{d}_k:C^k(K)\to C^{k+1}(K), is the discrete difference operator acting on kk-cochains. For any (k+1)(k+1)-chain cc, Stokes’ theorem can be written as an adjoint relationship

∫cdω=∫∂cω⟺⟨ψk+1dω,c⟩=⟨ψkω,∂k+1c⟩.(9)\int_c\mathrm{d}\omega=\int_{\partial c}\omega\Longleftrightarrow\langle\psi^{k+1}\mathrm{d}\omega,c\rangle=\langle\psi^k\omega,\partial_{k+1}c\rangle. \tag*{(9)}

We define dk\mathrm{d}_k as the adjoint of the discrete boundary operator,

⟨dkα,c⟩=⟨α,∂k+1c⟩,α∈Ck(K), c∈Ck+1(K).(10)\langle\mathrm{d}_k\alpha,c\rangle=\langle\alpha,\partial_{k+1}c\rangle,\qquad\alpha\in C^k(K),\ c\in C_{k+1}(K). \tag*{(10)}

It follows from ∂k∂k+1=0\partial_k\partial_{k+1}=0 that dk+1dk=0\mathrm{d}_{k+1}\mathrm{d}_k=0. Additionally, we can see that dk\mathrm{d}_k commutes with the de Rham map ψk\psi^k,

⟨dkψkω,c⟩=⟨ψkω,∂k+1c⟩=∫∂cω=∫cdω=⟨ψk+1dω,c⟩,(11)\langle\mathrm{d}_k\psi^k\omega,c\rangle=\langle\psi^k\omega,\partial_{k+1}c\rangle=\int_{\partial c}\omega=\int_c\mathrm{d}\omega=\langle\psi^{k+1}\mathrm{d}\omega,c\rangle, \tag*{(11)}

for any smooth kk-form ω\omega and c∈Ck+1(K)c\in C_{k+1}(K). Since a cochain is determined by its values on chains, dkψk=ψk+1d\mathrm{d}_k\psi^k=\psi^{k+1}\mathrm{d}, and dk\mathrm{d}_k introduces no discretisation error. In matrix form, dk\mathrm{d}_k is the transpose of the signed incidence matrix of ∂k+1\partial_{k+1}, and is simply a sparse difference matrix as a result of the sparsity of ∂k+1\partial_{k+1}.

Hodge Star

In the DEC framing, all metric information enters through an inner product on cochains. For smooth kk-forms on (M,g)(M,g), the L2L^2 inner product is

(ω,η)L2=∫Mg(ω,η) dV,g(ω,η)=∑i1<⋯<ikω(ei1,…,eik) η(ei1,…,eik),(12)(\omega,\eta)_{L^2}=\int_M g(\omega,\eta)\,\mathrm{d}V,\qquad g(\omega,\eta)=\sum_{i_1<\cdots<i_k}\omega(e_{i_1},\ldots,e_{i_k})\,\eta(e_{i_1},\ldots,e_{i_k}), \tag*{(12)}

where {ei}\{e_i\} is any local orthonormal frame. We seek a symmetric positive definite matrix ⋆k\star_k such that

(ψkω)⊤⋆k(ψkη)≈(ω,η)L2,(13)(\psi^k\omega)^\top\star_k(\psi^k\eta) \approx(\omega,\eta)_{L^2}, \tag*{(13)}

and define the discrete inner product

(α,β)k:=α⊤⋆kβ.(14)(\alpha,\beta)_k := \alpha^\top\star_k \beta. \tag*{(14)}

The natural choice is the Gram matrix of the Whitney forms, (⋆kW)σσ′=(Wσ,Wσ′)L2(\star_k^W)_{\sigma\sigma'} = (W_\sigma,W_{\sigma'})_{L^2}, for which (α,β)k=(ϕkα,ϕkβ)L2(\alpha,\beta)_k = (\phi^k\alpha,\phi^k\beta)_{L^2} exactly; ⋆kW\star_k^W is then the finite-element mass matrix of kk-cochains. In practice, DEC uses a diagonal (lumped) approximation of this mass matrix. For α=ψkω\alpha= \psi^k\omega, α(σk)=∫σkω≈ωˉσk∣σk∣\alpha(\sigma^k) = \int_{\sigma^k}\omega\approx\bar{\omega}_{\sigma^k}|\sigma^k|, and the ratio α(σk)/∣σk∣\alpha(\sigma^k)/|\sigma^k| approximates the average density of ω\omega along σk\sigma^k. Giving σk\sigma^k a region of measure proportional to ∣σk∣∣⋆σk∣|\sigma^k||\star\sigma^k| and summing density squared times volume gives

(ω,ω)L2≈∑σk∈K(k)(α(σk)∣σk∣)2∣σk∣∣⋆σk∣=∑σk∈K(k)∣⋆σk∣∣σk∣α(σk)2=α⊤⋆kα,(15)(\omega,\omega)_{L^2} \approx\sum_{\sigma^k\in K^{(k)}}\left(\frac{\alpha(\sigma^k)}{|\sigma^k|}\right)^2|\sigma^k||\star\sigma^k| = \sum_{\sigma^k\in K^{(k)}}\frac{|\star\sigma^k|}{|\sigma^k|}\alpha(\sigma^k)^2 = \alpha^\top\star_k\alpha, \tag*{(15)}

where ⋆k\star_k is the diagonal Hodge star,

⋆k=diag⁡(∣⋆σk∣∣σk∣)σk∈K(k).(16)\star_k = \operatorname{diag}\left(\frac{|\star\sigma^k|}{|\sigma^k|}\right)_{\sigma^k\in K^{(k)}}. \tag*{(16)}

⋆k\star_k is symmetric positive definite on well-centred meshes, where all ∣⋆σk∣|\star\sigma^k| are positive.

Co-derivative

The discrete co-derivative δk+1:Ck+1(K)→Ck(K)\delta_{k+1}: C^{k+1}(K) \to C^k(K) is defined as the adjoint of dkd_k with respect to the inner product in Eq. (14),

(dkα,β)k+1=(α,δk+1β)kfor all α∈Ck(K), β∈Ck+1(K).(17)(d_k\alpha,\beta)_{k+1} = (\alpha,\delta_{k+1}\beta)_k \qquad\text{for all }\alpha\in C^k(K),\ \beta\in C^{k+1}(K). \tag*{(17)}

Since ⋆k\star_k is symmetric positive definite, and hence invertible,

(dkα,β)k+1=α⊤dk⊤⋆k+1β=α⊤⋆k(⋆k−1dk⊤⋆k+1β),(18)(d_k\alpha,\beta)_{k+1} = \alpha^\top d_k^\top\star_{k+1}\beta= \alpha^\top\star_k\left(\star_k^{-1}d_k^\top\star_{k+1}\beta\right), \tag*{(18)}

so

δk+1=⋆k−1dk⊤⋆k+1.(19)\delta_{k+1} = \star_k^{-1}d_k^\top\star_{k+1}. \tag*{(19)}

Just as dkd_k is the adjoint of ∂k+1\partial_{k+1} under the pairing ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle, δk+1\delta_{k+1} is the adjoint of dkd_k under the inner product (⋅,⋅)k(\cdot,\cdot)_k.

Hodge-Laplacian

The discrete Hodge-Laplacian2 on kk-cochains is

Δk=dk−1δk+δk+1dk,(20)\Delta_k = d_{k-1}\delta_k + \delta_{k+1}d_k, \tag*{(20)}

with δ0=0\delta_0 = 0 and dn=0d_n = 0, since C−1(K)=Cn+1(K)=0C^{-1}(K) = C^{n+1}(K) = 0. Δk\Delta_k is self-adjoint and positive semidefinite with respect to (⋅,⋅)k(\cdot,\cdot)_k, since (Δkα,α)k=(dkα,dkα)k+1+(δkα,δkα)k−1≥0(\Delta_k\alpha,\alpha)_k = (d_k\alpha,d_k\alpha)_{k+1} + (\delta_k\alpha,\delta_k\alpha)_{k-1} \ge0. Δk\Delta_k as a matrix is not symmetric, but ⋆kΔk\star_k\Delta_k is.

Whittle-Matérn Fields

The Matérn covariance function for locations u,v∈Rn\mathbf{u},\mathbf{v}\in\mathbb{R}^n and Euclidean distance ∥⋅∥\lVert\cdot\rVert is defined as

r(u,v)=σ22ν−1Γ(ν)(κ∥v−u∥)νKν(κ∥v−u∥),(21)r(\mathbf{u},\mathbf{v}) = \frac{\sigma^2}{2^{\nu-1}\Gamma(\nu)}(\kappa\lVert\mathbf{v}-\mathbf{u}\rVert)^\nu K_\nu(\kappa\lVert\mathbf{v}-\mathbf{u}\rVert), \tag*{(21)}

where KνK_\nu is the modified Bessel function of the second kind with order ν>0\nu> 0, κ>0\kappa> 0 is a scaling parameter and σ2\sigma^2 is the marginal variance. The Matérn random field has mean-square derivatives of integer orders m<νm < \nu. Lindgren et al. [14] suggests a more natural interpretation of κ\kappa as a range parameter ρ\rho, with an empirical reparametrisation ρ=8νκ\rho= \frac{\sqrt{8\nu}}{\kappa} giving correlations near 0.1 when ∥v−u∥=ρ\lVert v-u\rVert= \rho. Whittle [20] formalises the Matérn GP as the solution to the SPDE

(κ2−Δ)α/2x(s)=W(s),(22)(\kappa^2-\Delta)^{\alpha/2}x(s)=\mathcal{W}(s), \tag*{(22)}

with the same κ>0\kappa> 0 and α=ν+n2\alpha= \nu+ \frac{n}{2}, and a white noise process W\mathcal{W}. Δ\Delta is the Euclidean Laplacian and the marginal variance of the field is given by

σ2=Γ(ν)Γ(ν+n/2)(4π)n/2κ2ν.(23)\sigma^2 = \frac{\Gamma(\nu)}{\Gamma(\nu+n/2)(4\pi)^{n/2}\kappa^{2\nu}}. \tag*{(23)}

Methodology

Whittle-Matérn Fields on kk-Cochains

When a Gaussian vector is defined implicitly by a linear system driven by Gaussian noise, its precision is defined by the system matrix and the noise covariance. Suppose

Sx=b,b∼N(0,Σb),(24)Sx=b,\qquad b\sim\mathcal{N}(0,\Sigma_b), \tag*{(24)}

with SS invertible. Then x=S−1bx=S^{-1}b is Gaussian with

Cov⁡(x)=S−1ΣbS−T,Q=Cov⁡(x)−1=STΣb−1S.(25)\operatorname{Cov}(x)=S^{-1}\Sigma_bS^{-\mathsf{T}},\qquad Q=\operatorname{Cov}(x)^{-1}=S^{\mathsf{T}}\Sigma_b^{-1}S. \tag*{(25)}

We can translate the Whittle-Matérn SPDE formulation in Eq. (22) to DEC by replacing −Δ-\Delta with the kk-form Hodge-Laplacian Δk\Delta_k as defined in Eq. (20).

(κ2+Δk)α/2x=W.(26)(\kappa^2+\Delta_k)^{\alpha/2}x=\mathcal{W}. \tag*{(26)}

Note the change of sign between Eqs. (22) and (26) since Δ\Delta is negative semi-definite and Δk\Delta_k is positive semi-definite.

To discretise Eq. (26) for α=2\alpha=2, we use its weak form: we require ((κ2+Δk)x,v)k=(W,ϕvk)L2((\kappa^2+\Delta_k)x,v)_k=(\mathcal{W},\phi_v^k)_{L^2} for all v∈Ck(K)v\in C^k(K). For each σ∈K(k)\sigma\in K^{(k)}, the left-hand side is the σ\sigma-th entry of ⋆k(κ2+Δk)x=Sx\star_k(\kappa^2+\Delta_k)x=Sx, and the right-hand side is bσ=(W,Wσ)L2b_\sigma=(\mathcal{W},W_\sigma)_{L^2}, giving Sx=bSx=b. Since κ2+Δk\kappa^2+\Delta_k is self-adjoint with respect to (⋅,⋅)k(\cdot,\cdot)_k, SS is symmetric, and its explicit form follows from the quadratic form uTSu=((κ2+Δk)u,u)ku^{\mathsf{T}}Su=((\kappa^2+\Delta_k)u,u)_k,

((κ2+Δk)u,u)k=((κ2+dk−1δk+δk+1dk)u,u)k=κ2(u,u)k+(δk−1δku,u)k+(δk+1dku,u)k=κ2(u,u)k+(δku,δku)k−1+(dku,dku)k+1=κ2∥u∥k2+∥δku∥k−12+∥dku∥k+12=κ2uT⋆ku+(δku)T⋆k−1(δku)+(dku)T⋆k+1(dku)=κ2uT⋆ku+uT⋆kdk−1⋆k−1−1dk−1T⋆ku+uTdkT⋆k+1dku=uTSu,(27)\begin{aligned} ((\kappa^2+\Delta_k)u,u)_k &=((\kappa^2+d_{k-1}\delta_k+\delta_{k+1}d_k)u,u)_k\\ &=\kappa^2(u,u)_k+(\delta_{k-1}\delta_k u,u)_k+(\delta_{k+1}d_k u,u)_k\\ &=\kappa^2(u,u)_k+(\delta_k u,\delta_k u)_{k-1}+(d_k u,d_k u)_{k+1}\\ &=\kappa^2\lVert u\rVert_k^2+\lVert\delta_k u\rVert_{k-1}^2+\lVert d_k u\rVert_{k+1}^2\\ &=\kappa^2u^{\mathsf{T}}\star_k u+(\delta_k u)^{\mathsf{T}}\star_{k-1}(\delta_k u)+(d_k u)^{\mathsf{T}}\star_{k+1}(d_k u)\\ &=\kappa^2u^{\mathsf{T}}\star_k u+u^{\mathsf{T}}\star_k d_{k-1}\star_{k-1}^{-1}d_{k-1}^{\mathsf{T}}\star_k u+u^{\mathsf{T}}d_k^{\mathsf{T}}\star_{k+1}d_k u\\ &=u^{\mathsf{T}}Su, \tag*{(27)} \end{aligned}

where

S=κ2⋆k+⋆kdk−1⋆k−1−1dk−1T⋆k+dkT⋆k+1dk=⋆k(κ2+Δk).\begin{aligned} S&=\kappa^2\star_k+\star_kd_{k-1}\star_{k-1}^{-1}d_{k-1}^{\mathsf{T}}\star_k+d_k^{\mathsf{T}}\star_{k+1}d_k\\ &=\star_k(\kappa^2+\Delta_k). \end{aligned}

S∈RNk×NkS\in\mathbb{R}^{N_k\times N_k} is sparse since ⋆k−1\star_k^{-1} is diagonal. Using ⋆kW\star_k^W would make the term ⋆kdk−1(⋆k−1W)−1dk−1T⋆k\star_kd_{k-1}(\star_{k-1}^W)^{-1}d_{k-1}^{\mathsf{T}}\star_k dense, which justifies our use of the lumped mass matrix. The white noise process W\mathcal{W} is a random linear functional such that

E[(W,v)L2(W,w)L2]=(v,w)L2.(28)\mathbb{E}[(\mathcal{W},v)_{L^2}(\mathcal{W},w)_{L^2}]=(v,w)_{L^2}. \tag*{(28)}

Using Whitney forms {Wσ}\{W_\sigma\} as a basis, bσ:=(W,Wσ)L2b_\sigma:=(\mathcal{W},W_\sigma)_{L^2}, and

Cov⁡(b)σσ′=E[bσbσ′]=E[(W,Wσ)L2(W,Wσ′)L2]=(Wσ,Wσ′)L2=∫Mg(Wσ,Wσ′) dV=(⋆kW)σσ′.(29)\operatorname{Cov}(b)_{\sigma\sigma'}=\mathbb{E}[b_\sigma b_{\sigma'}]=\mathbb{E}[(\mathcal{W},W_\sigma)_{L^2}(\mathcal{W},W_{\sigma'})_{L^2}]=(W_\sigma,W_{\sigma'})_{L^2}=\int_{\mathcal{M}}g(W_\sigma,W_{\sigma'})\,dV=(\star_k^W)_{\sigma\sigma'}. \tag*{(29)}

Approximating ⋆kW\star_k^W by the lumped mass matrix ⋆k\star_k gives b∼N(0,⋆k)b \sim\mathcal{N}(0,\star_k). Thus, when α=2\alpha=2, the weak form of Eq. (26) is

Sx=b,b∼N(0,⋆k),(30)Sx=b,\qquad b\sim\mathcal{N}(0,\star_k), \tag*{(30)}

and the precision matrix of xx is given by

Q2=S⋆k−1S.(31)Q_2=S\star_k^{-1}S. \tag*{(31)}

For general α≠2\alpha\ne2, the fractional power in Eq. (26) is most naturally defined after whitening. The discrete inner product satisfies

(u,v)k=uT⋆kv=(⋆k1/2u)T(⋆k1/2v),(32)(u,v)_k=u^{\mathsf{T}}\star_kv=(\star_k^{1/2}u)^{\mathsf{T}}(\star_k^{1/2}v), \tag*{(32)}

so the change of variables x~=⋆k1/2x\tilde{x}=\star_k^{1/2}x transforms the ⋆k\star_k inner product to the Euclidean one. The self-adjoint operator κ2+Δk\kappa^2+\Delta_k is then represented by the symmetric positive definite matrix

S~=⋆k1/2(κ2+Δk)⋆k−1/2=⋆k−1/2S⋆k−1/2,(33)\tilde{S}=\star_k^{1/2}(\kappa^2+\Delta_k)\star_k^{-1/2}=\star_k^{-1/2}S\star_k^{-1/2}, \tag*{(33)}

using S=⋆k(κ2+Δk)S=\star_k(\kappa^2+\Delta_k). The noise process becomes

b~=⋆k−1/2b∼N(0,⋆k−1/2⋆k⋆k−1/2)=N(0,I).(34)\tilde{b}=\star_k^{-1/2}b\sim\mathcal{N}(0,\star_k^{-1/2}\star_k\star_k^{-1/2})=\mathcal{N}(0,I). \tag*{(34)}

For α=2\alpha=2, Sx=bSx=b is equivalent to S~x~=b~\tilde{S}\tilde{x}=\tilde{b}. For general α\alpha the whitened form of Eq. (26) is

S~α/2x~=z,z∼N(0,I).(35)\tilde{S}^{\alpha/2}\tilde{x}=z,\qquad z\sim\mathcal{N}(0,I). \tag*{(35)}

Hence Cov⁡(x~)=S~−α\operatorname{Cov}(\tilde{x})=\tilde{S}^{-\alpha}. Transforming back via x=⋆k−1/2x~x=\star_k^{-1/2}\tilde{x} gives Cov⁡(x)=⋆k−1/2S~−α⋆k−1/2\operatorname{Cov}(x)=\star_k^{-1/2}\tilde{S}^{-\alpha}\star_k^{-1/2}, and so

Qα=⋆k1/2S~α⋆k1/2.(36)Q_\alpha=\star_k^{1/2}\tilde{S}^{\alpha}\star_k^{1/2}. \tag*{(36)}

For integer α\alpha, we can use telescoping to define QαQ_\alpha,

S~α=(⋆k−1/2S⋆k−1/2)(⋆k−1/2S⋆k−1/2)⋯(⋆k−1/2S⋆k−1/2)⏟α copies=⋆k−1/2S⋆k−1S⋆k−1⋯S⏟α copies of S⋆k−1/2,Qα=⋆k1/2⋆k−1/2S⋆k−1S⋆k−1⋯S⏟α copies of S⋆k−1/2⋆k1/2=S⋆k−1S⋆k−1⋯S⏟α copies of S=S(⋆k−1S)α−1,α∈N(37)\begin{aligned} \tilde{S}^{\alpha} &=\underbrace{(\star_k^{-1/2}S\star_k^{-1/2})(\star_k^{-1/2}S\star_k^{-1/2})\cdots(\star_k^{-1/2}S\star_k^{-1/2})}_{\alpha\ \text{copies}}\\ &=\star_k^{-1/2}\underbrace{S\star_k^{-1}S\star_k^{-1}\cdots S}_{\alpha\ \text{copies of }S}\star_k^{-1/2},\\ Q_\alpha &=\star_k^{1/2}\star_k^{-1/2}\underbrace{S\star_k^{-1}S\star_k^{-1}\cdots S}_{\alpha\ \text{copies of }S}\star_k^{-1/2}\star_k^{1/2}\\ &=\underbrace{S\star_k^{-1}S\star_k^{-1}\cdots S}_{\alpha\ \text{copies of }S}\\ &=S(\star_k^{-1}S)^{\alpha-1},\qquad\alpha\in\mathbb{N} \tag*{(37)} \end{aligned}

For α=1\alpha=1 this is Q1=SQ_1=S, and for α=2\alpha=2 it recovers Q2=S⋆k−1SQ_2=S\star_k^{-1}S. For non-integer α\alpha, S~α\tilde{S}^{\alpha} remains well defined through spectral powers but is dense, so QαQ_\alpha loses both its sparsity and the Markov property. We therefore restrict attention to integer α\alpha; fractional values can be handled by rational approximation [4].

The smoothness parameter is related to α\alpha by ν=α−n/2\nu=\alpha-n/2, and ν>0\nu>0 requires α>n/2\alpha>n/2. With integer α\alpha, ν\nu takes integer values when nn is even and half-integer when nn is odd. On a surface (n=2n=2), α=1\alpha=1 gives ν=0\nu=0, and so does not define a Matérn covariance function, but is still a well-defined random measure [14].

Implementation

Prior Sampling

To sample from N(0,Qα−1)\mathcal{N}(0,Q_\alpha^{-1}) we require LL such that LLT=QαLL^{\mathsf{T}}=Q_\alpha. We consider the cases where α=2m\alpha=2m and α=2m+1\alpha=2m+1 separately. When α=2m\alpha= 2m,

Qα=S(⋆k−1S)2m−1=S(⋆k−1S)2m−2⋆k−1S=(S(⋆k−1S)m−1⋆k−12)(S(⋆k−1S)m−1⋆k−12)T(38)Q_\alpha= S(\star_k^{-1}S)^{2m-1} = S(\star_k^{-1}S)^{2m-2}\star_k^{-1}S = \left(S(\star_k^{-1}S)^{m-1}\star_k^{-\frac{1}{2}}\right)\left(S(\star_k^{-1}S)^{m-1}\star_k^{-\frac{1}{2}}\right)^{\mathsf{T}} \tag*{(38)}
L=S(⋆k−1S)m−1⋆k−12.L = S(\star_k^{-1}S)^{m-1}\star_k^{-\frac{1}{2}}.

When α=2m+1\alpha= 2m+1,

Qα=(S⋆k−1)mS(S⋆k−1S)m=((S⋆k−1)mLS)((S⋆k−1)mLS)T(39)Q_\alpha= (S\star_k^{-1})^m S(S\star_k^{-1}S)^m = \left((S\star_k^{-1})^m L_S\right)\left((S\star_k^{-1})^m L_S\right)^{\mathsf{T}} \tag*{(39)}
L=(S⋆k−1)mLS,L = (S\star_k^{-1})^mL_S,

where

LSLST=S.(40)L_SL_S^{\mathsf{T}} = S. \tag*{(40)}

A sample xx is then given by x=L−Tzx = L^{-\mathsf{T}}z, z∼N(0,I)z \sim\mathcal{N}(0,I), i.e.

x={(S−1⋆k)m−1S−1⋆k12zα=2m(S−1⋆k)mLS−Tzα=2m+1(41)x = \begin{cases} (S^{-1}\star_k)^{m-1}S^{-1}\star_k^{\frac{1}{2}}z & \alpha= 2m \\ (S^{-1}\star_k)^mL_S^{-\mathsf{T}}z & \alpha= 2m+1 \end{cases} \tag*{(41)}

Figure 1 shows samples of kk-cochains on a unit sphere.

Sample of 0-cochain (function over points)

(a) Sample of 0-cochain (function over points)

Sample of 2-cochain (function over faces)

(b) Sample of 2-cochain (function over faces)

Sample of 1-cochain (function over edges)

(c) Sample of 1-cochain (function over edges)

Sample from Figure 1c, projected into the tangent vector space

(d) Sample from Figure 1c, projected into the tangent vector space (see § 4.3)

Figure 1. Samples of Whittle-Matérn fields on the kk-cochains of a unit icosphere with 4 subdivisions. κ=2\kappa= 2 and α=3\alpha= 3.

Posterior Conditioning

The posterior covariance Cov⁡(x∣y)=Qpost−1\operatorname{Cov}(x \mid y) = Q_{\mathrm{post}}^{-1} where

Qpost=Qα+ATR−1A.(42)Q_{\mathrm{post}} = Q_\alpha+ A^{\mathsf{T}}R^{-1}A. \tag*{(42)}

AA is an observation operator that maps the latent cochain to the observations, y=Ax+ϵy = Ax+\epsilon, and RR is the covariance of the observation noise, ϵ∼N(0,R)\epsilon\sim\mathcal{N}(0,R) e.g. for i.i.d noise with variance τ2\tau^2, R=τ2IR = \tau^2I. For R=τ2IR = \tau^2I, the posterior mean of xx is given by

E[x∣y]=Qpost−1(ATyτ2).(43)\mathbb{E}[x \mid y] = Q_{\mathrm{post}}^{-1}\left(\frac{A^{\mathsf{T}}y}{\tau^2}\right). \tag*{(43)}

Qpost−1Q_{\mathrm{post}}^{-1} is a dense matrix, but we can find the mean and take posterior samples without ever forming it explicitly. For the mean we employ two triangular solves

Qpost−1=LpostLpostT,Lpostw=ATR−1y,LpostTμ=w.(44)Q_{\mathrm{post}}^{-1} = L_{\mathrm{post}}L_{\mathrm{post}}^{\mathsf{T}}, \qquad L_{\mathrm{post}}w = A^{\mathsf{T}}R^{-1}y,\qquad L_{\mathrm{post}}^{\mathsf{T}}\mu= w. \tag*{(44)}

For posterior samples, we employ one additional triangular solve,

x=μ+Lpost−Tz,z∼N(0,I).(45)x = \mu+ L_{\mathrm{post}}^{-\mathsf{T}}z,\qquad z \sim\mathcal{N}(0,I). \tag*{(45)}

We can find the posterior marginal variance approximately through the Monte Carlo sample variance, or exactly by solving Takahashi equations to find only diag⁡(Qpost−1)\operatorname{diag}(Q_{\mathrm{post}}^{-1}) [18]. Figure 2 shows posterior inference on a 2-cochain on a sphere.

Observation Operators

The latent field is a cochain x∈Ck(K)x \in C^k(K) with prior N(0,Qα−1)\mathcal{N}(0,Q_\alpha^{-1}). Any observation that is a linear functional of the underlying form (e.g. an integral, a point value, or a vector) enters through the observation operator AA in y=Ax+ϵy = Ax+\epsilon, and the posterior of § 4.2 applies unchanged.

Mesh-aligned observations. If yiy_i is an integral over a chain c∈Ck(K)c \in C_k(K), then by the de Rham map ∫cω=⟨ψkω,c⟩\int_c \omega= \langle\psi^k\omega,c\rangle, so the corresponding row of AA is the coefficient vector of cc. For a single simplex this is a signed indicator, with sign given by the relative orientation. Note that this includes scalar values observed at vertices of the mesh.

Sample of 2-cochain

(a) Sample of 2-cochain

500 observed points

(b) 500 observed points

Posterior mean

(c) Posterior mean

Posterior standard deviation

(d) Posterior standard deviation

Figure 2. Posterior conditioning of the Whittle-Matérn field on a 2-cochain. RMSE = 1.24×10−51.24 \times10^{-5}

Point observations. For non-mesh aligned observations, we evaluate the Whitney map ϕxk\phi_x^k at the observation location pp as in Eq. (5), using the barycentric coordinates λv(p)\lambda_v(p) of pp. Only the Whitney forms of the face ff containing pp contribute, so each row of AA is sparse. For k=1k = 1, when observations are vectors rather than 1-forms, we use a vector proxy for ϕx1\phi_x^1,

v(p)=∑[va,vb]⊂∂fx([va,vb])(λa(p)∇λb−λb(p)∇λa),(46)\mathbf{v}(p) = \sum_{[v_a,v_b]\subset\partial f} x([v_a,v_b])\left(\lambda_a(p)\nabla\lambda_b-\lambda_b(p)\nabla\lambda_a\right), \tag*{(46)}

where ∇λi\nabla\lambda_i is constant on ff. An observed vector is compared with EpTv(p)E_p^{\mathsf{T}}\mathbf{v}(p), where Ep∈R3×2E_p \in\mathbb{R}^{3 \times2} is the observation’s local frame.

Vector-field priors. For a collection of points p1,…,pmp_1,\ldots,p_m, we can define the operator B:C1(K)→R2mB : C^1(K) \to\mathbb{R}^{2m} by evaluating EpiTv(pi)E_{p_i}^{\mathsf{T}}\mathbf{v}(p_i) at each pip_i. The prior on vector fields is the push-forward of the cochain prior through BB, v=Bx∼N(0,BQα−1BT)\mathbf{v} = Bx \sim\mathcal{N}(0, BQ_\alpha^{-1}B^{\mathsf{T}}). We can avoid constructing this dense covariance explicitly; samples are obtained by sampling xx as in Section 4.1 and applying BB, and vector observations enter inference through the corresponding rows of BB in AA.

Experiments

As a demonstration, we apply this model to interpolation of a vector field on a sphere. The data are monthly averaged uu and vv components of wind at the 500hPa pressure level for the month of July 2020, taken from the ERA5 atmospheric reanalysis dataset [10]3, scaled to have an average norm of 1. For observations we subsample the data to a 10∘×10∘10^\circ\times10^\circ grid, and infer back to the 0.25∘×0.25∘0.25^\circ\times0.25^\circ grid, giving 1,035,360 output locations. The ground truth data is shown in Figure 3 and the observations are shown in Figure 4.

Monthly average wind data from ERA-5 on a 0.25° × 0.25° grid

Figure 3. Monthly average wind data from ERA-5 on a 0.25∘×0.25∘0.25^\circ\times0.25^\circ grid, shown on the Robinson projection. Arrow colour and size indicates magnitude.

Observed wind vectors, downsampled from ground truth to a 10° × 10° grid

Figure 4. Observed wind vectors, downsampled from ground truth to a 10∘×10∘10^\circ\times10^\circ grid, shown on the Robinson projection. Arrow colour and size indicates magnitude.

We begin by generating an icosphere mesh with 5 subdivisions, producing a well-centred mesh with 10242 vertices, 30720 edges, and 20480 faces, and using PyDEC we assemble a simplicial complex. For hyperparameter values, we fix α=2\alpha= 2 (ν=1\nu= 1) and estimate ρ\rho by empirically measuring the spatial correlation of the observations. For our data this gives ρ=0.615\rho= 0.615 rad and so κ=4.597\kappa= 4.597.

Using the DEC operators defined by the simplicial complex, we construct Q2Q_2 for k=1k = 1 as in Eq. (31), giving a prior precision over the edges of the mesh. The sparsity pattern of this matrix is shown in Figure 5. We then construct our observation operator AA as the Whitney map for vector field priors described in § 4.3. Note that since we use an icosphere, neither the observations nor the ground truth are (necessarily) aligned with the vertices of the mesh. We set τ=0.001\tau= 0.001 and use R=τ2IR = \tau^2 I for the observation noise.

Sparsity pattern of $Q_2$

Figure 5. Sparsity pattern of Q2Q_2 when k=1k = 1. Matrix dimensions are 30720×3072030720 \times30720.

Using the procedure detailed in § 4.2, we obtain the posterior mean and standard deviation, shown in Figure 6 and Figure 7, respectively. The posterior estimate has a mean square error of 0.046 with respect to the ground truth, and the spatial distribution of square error is shown in Figure 8.

Posterior mean field

Figure 6. Posterior mean field, 0.25∘×0.25∘0.25^\circ\times0.25^\circ, conditioned on 10∘×10∘10^\circ\times10^\circ grid of observation vectors. Arrow colour and size indicates magnitude. MSE = 0.046

Posterior standard deviation of wind vector along the edges of the mesh

Figure 7. Posterior standard deviation of wind vector along the edges of the mesh, interpolated to lat/lon grid using φ0\varphi^{0}, the Whitney map for when k=0k = 0. Colour indicates size of standard deviation.

Square error of posterior mean field with respect to ground truth

Figure 8. Square error of posterior mean field with respect to ground truth. Colour indicates magnitude of error. Squared error is calculated as ∥x−μx∣y∥22\lVert\mathbf{x} - \boldsymbol{\mu}_{x\mid y} \rVert_{2}^{2}.

Conclusion

This work presents a sparse precision formulation for Whittle–Matérn fields for kk-cochains using DEC operators. By applying Whitney maps and introducing the Whitney observation operators, this model can be applied to any point, edge, areal, or vector field data, with observation and prediction locations anywhere on the underlying manifold. Future development will focus on boundary conditions and non-stationarity, as well as sparse approximations of Hodge-compositional covariance kernels.

References

  1. [1]Alain, M. and S. Takao (2026). Probabilistic modelling of vector fields using structure-preserving discretisation. In NeurIPS 2026 Workshop on AI for Stochastic Dynamics: From Theoretical Foundations to Scientific Applications.
  2. [2]Alain, M., S. Takao, B. Paige, and M. P. Deisenroth (2024, August). Gaussian Processes on Cellular Complexes.arxiv.org/abs/2311.01198
  3. [3]Bell, N. and A. N. Hirani (2012, November). PyDEC: Software and Algorithms for Discretization of Exterior Calculus. ACM Trans. Math. Softw. 39(1), 3:1–3:41.arxiv.org/abs/1103.3076
  4. [4]Bolin, D. and K. Kirchner (2020, April). The Rational SPDE Approach for Gaussian Random Fields With General Smoothness. Journal of Computational and Graphical Statistics 29(2), 274–285.
  5. [5]Borovitskiy, V., I. Azangulov, A. Terenin, P. Mostowsky, M. Deisenroth, and N. Durrande (2021, March). Matérn Gaussian Processes on Graphs. In Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, pp. 2593–2601. PMLR.arxiv.org/abs/2010.15538
  6. [6]Borovitskiy, V., A. Terenin, P. Mostowsky, and M. Deisenroth (he/him) (2020). Matérn Gaussian Processes on Riemannian Manifolds. In Advances in Neural Information Processing Systems, Volume 33, pp. 12426–12437. Curran Associates, Inc.arxiv.org/abs/2006.10160
  7. [7]Desbrun, M., A. N. Hirani, M. Leok, and J. E. Marsden (2005, August). Discrete Exterior Calculus.arxiv.org/abs/math/0508341
  8. [8]Fleming, W. H. (1987, June). Functions of Several Variables. Springer Science & Business Media.
  9. [9]Gillan, M., S. Siegert, and B. D. Youngman (2026, June). Discrete Gaussian vector fields on meshes. Stochastic Environmental Research and Risk Assessment 40(6), 161.arxiv.org/abs/2507.20024
  10. [10]Hersbach, H., B. Bell, P. Berrisford, G. Biavati, A. Horányi, J. Muñoz Sabater, J. Nicolas, C. Peubey, R. Radu, I. Rozum, D. Schepers, A. Simmons, C. Soci, D. Dee, and J.-N. Thépaut (2023). ERA5 monthly averaged data on pressure levels from 1940 to present.
  11. [11]Hirani, A. N. (2003). Discrete Exterior Calculus. Ph. D. thesis, California Institute of Technology.
  12. [12]Hutchinson, M., A. Terenin, V. Borovitskiy, S. Takao, Y. W. Teh, and M. P. Deisenroth (2021, December). Vector-valued Gaussian processes on riemannian manifolds via gauge independent projected kernels. In Proceedings of the 35th International Conference on Neural Information Processing Systems, NIPS ’21, Red Hook, NY, USA, pp. 17160–17169. Curran Associates Inc.arxiv.org/abs/2110.14423
  13. [13]Lindgren, F., D. Bolin, and H. Rue (2022, August). The SPDE approach for Gaussian and non-Gaussian fields: 10 years and still running. Spatial Statistics 50, 100599.DOI
  14. [14]Lindgren, F., H. Rue, and J. Lindström (2011). An explicit link between Gaussian fields and Gaussian Markov random fields: The stochastic partial differential equation approach. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 73(4), 423–498.DOI
  15. [16]Rasmussen, C. E. and C. K. I. Williams (2006). Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. Cambridge, Mass: MIT Press.DOI
  16. [17]Robert-Nicoud, D., A. Krause, and V. Borovitskiy (2024, April). Intrinsic Gaussian Vector Fields on Manifolds. In Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, pp. 1306–1314. PMLR.
  17. [18]Rue, H. and L. Held (2005). Gaussian Markov Random Fields: Theory and Applications (1 ed.), Volume 104 of Monographs on Statistics and Applied Probability. Milton: Chapman and Hall/CRC.
  18. [19]Whitney, H. (1957). Geometric Integration Theory. Princeton University Press.
  19. [20]Whittle, P. (1963). Stochastic Processes in Several Dimensions. Bulletin of the International Statistical Institute 40(2), 974–994.
  20. [21]Yang, M., V. Borovitskiy, and E. Isufi (2024, April). Hodge-Compositional Edge Gaussian Processes. In Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, pp. 3754–3762. PMLR.arxiv.org/abs/2310.19450

Paper details

vlnc:W_mm4mhvsj
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 1

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Mathematics

Not recorded for this paper · View statement →

Looking for related papers…
Contents