betaFeedback

WorksMathematics

Normal Equations and Discrete Energy Structures for High-Order Streamline Diffusion

Abstract

We analyse fully discrete Streamline Diffusion finite element methods, also known as SUPG methods, for time-dependent first-order systems with skew-symmetric spatial operators. To the best of our knowledge, this is the first stability and a priori error analysis of strongly consistent Streamline Diffusion finite elements combined with linear multistep schemes of order greater than two for multidimensional first-order hyperbolic systems. Local-in-time L2L^2-residual minimisation singles out δ=b0τδ=b_0τ, where δδ is the stabilisation parameter, ττ the time step, and b0b_0 the current-time coefficient in the method average. For this choice, each implicit linear system is a symmetric positive definite normal equation in a graph norm. A direct dual-residual estimate yields errors of order O(hk+1/2+τν)O(h^{k+1/2}+τ^ν) when δδ is proportional to hh and τ=O(h)τ=O(h), where hh is the mesh size, kk the polynomial degree, and νν the temporal order. Stability is established for the θθ-method and the Adams-Moulton methods AM3-AM5. The general-degree AM3 and AM4 estimates use strengthened CFL conditions; for continuous piecewise affine elements, an elementwise cancellation recovers the standard hyperbolic regime. AM5 and the explicit Adams-Bashforth methods AB3 and AB4 are stable under a standard hyperbolic CFL condition, though the explicit schemes do not have normal-equation structure. Order-matched acoustic tests recover orders two through five and material-residual rates one half-order lower. In a d'Alembert test with discontinuous initial data, normal-equation SUPG recovers second-order local P1\mathbb P_1 convergence away from the wave fronts, whereas the unstabilised error is close to half order. A two-dimensional compact-wave test shows improved localisation with modest dissipation.

Introduction

Problem Setting. Let I=(0,T)I=(0,T) be a finite time interval, let Ω⊂Rd\Omega\subset\mathbb{R}^{d} be a Lipschitz domain, and let nsysn_{\mathrm{sys}} denote the number of components. Set H=[L2(Ω)]nsys\mathcal{H}=[L^2(\Omega)]^{n_{\mathrm{sys}}}, with inner product (⋅,⋅)Ω(\cdot,\cdot)_{\Omega}, and let V⊂[H1(Ω)]nsys\mathcal{V}\subset[H^1(\Omega)]^{n_{\mathrm{sys}}} be a dense subspace that incorporates the boundary conditions. We assume that the time-independent first-order differential operator G:V→HG:\mathcal{V}\to\mathcal{H} is skew-symmetric on V\mathcal{V}, that is,

(GU,V)Ω=−(U,GV)Ω∀U,V∈V(1)(GU,V)_{\Omega}=-(U,GV)_{\Omega}\quad\forall U,V\in\mathcal{V} \tag*{(1)}

Given F:I→HF:I\to\mathcal{H} and U0∈HU_0\in\mathcal{H}, we seek U:[0,T]→HU:[0,T]\to\mathcal{H}, with U(t)∈VU(t)\in\mathcal{V} for t∈It\in I, that satisfies the Friedrichs-type initial-value problem

∂tU+GU=Fin I(2)\partial_t U+GU=F\quad\text{in }I \tag*{(2)}
U(0)=U0(3)U(0)=U_0 \tag*{(3)}

For the stationary theory of Friedrichs systems, we refer to [18, 20]; time-dependent formulations are considered in [4, 8]. In several space dimensions the operator acts on coupled fields, so the analysis must control the interaction between multistep time differences and the full system operator rather than a single scalar transport direction.

Skew-symmetry endows the continuous problem with a natural L2L^2-energy and yields energy stability for standard Galerkin finite element semidiscretisations. For smooth solutions, however, the resulting error estimates are typically suboptimal by one order. Stabilised methods commonly recover half an order and, more importantly for wave propagation, better preserve the local propagation of perturbations. The resulting discretisation errors can therefore reflect more closely the dynamics of perturbations in the continuous system, whereas dispersive errors generated by an unstabilised Galerkin method may pollute spatially separated regions.

The Transient Stabilisation Problem. For a conforming finite element space Vh⊂VV_h \subset V, the consistent semidiscrete Streamline Diffusion, or streamline upwind/Petrov–Galerkin (SUPG), formulation takes the following form: find Uh(t)∈VhU_h(t) \in V_h, with Uh(0)=Uh,0U_h(0) = U_{h,0}, where Uh,0U_{h,0} is a suitable approximation of U0U_0, such that

∫Ω(∂tUh+GUh)⋅(Vh+δGVh) dx=∫ΩF⋅(Vh+δGVh) dx∀Vh∈Vh(4)\int_{\Omega} (\partial_t U_h + G U_h) \cdot(V_h + \delta G V_h)\,dx = \int_{\Omega} F \cdot(V_h + \delta G V_h)\,dx \quad\forall V_h \in V_h \tag*{(4)}

Here δ>0\delta> 0 is the stabilisation parameter, with the dimension of time. Consistency requires the full evolution residual to be paired with the perturbed test function. The resulting cross term (∂tUh,δGVh)Ω(\partial_t U_h,\delta G V_h)_{\Omega} is the principal obstacle in the transient energy analysis.

This analytical difficulty is coupled to the algebraic character of the time step. For a general stabilisation parameter, an implicit Streamline Diffusion step is nonsymmetric. Explicit Petrov–Galerkin schemes instead inherit a generally nonsymmetric mass matrix and are subject to a hyperbolic Courant–Friedrichs–Lewy (CFL) condition. This distinction is especially relevant for nonlinear problems, where implicit methods require a nonlinear solve at every time step.

In the framework developed below, a method average with current coefficient b0b_0 admits the distinguished parameter choice δ=b0τ\delta= b_0\tau. This choice arises from local-in-time residual minimisation [5, 21] and makes the linear system at each time step a symmetric positive definite normal equation in the corresponding graph norm. Other choices of δ\delta remain useful for the stability analysis but do not in general produce a symmetric system. For an explicit Adams–Bashforth method, b0=0b_0 = 0, so no positive stabilisation parameter yields this normal-equation structure.

Main Contributions. We address these issues through a common operator and energy framework for transient Streamline Diffusion methods combined with the θ\theta-method and high-order Adams schemes. Beyond order two, the classical AA-stability route for linear multistep methods is unavailable [16]; stability must instead be recovered from method-dependent discrete energies that remain compatible with the spatial residual. The principal contributions are as follows. Here and below, hh denotes the mesh size, kk the spatial polynomial degree, τ\tau the time step, and ν\nu the temporal order.

  1. The fully discrete formulation separates the method average, the backward time difference, the material residual, and the perturbed test operator. This organisation exposes a common algebraic identity and distinguishes the residual-minimisation choice δ=b0τ\delta= b_0\tau from a general SUPG parameter.

  1. A direct dual-residual estimate leads to a fully discrete finite element error bound of order O(hk+1/2+τν)O(h^{k+1/2}+\tau^\nu) when δ∼h\delta\sim h and τ≲h\tau\lesssim h, under the stated regularity assumptions. The proof uses the ordinary L2L^2-projection, skew-symmetry, and discrete summation by parts.

  1. The abstract energy hypothesis is verified for the θ\theta-method and for the Adams–Moulton (AM) methods AM3–AM5. For general polynomial degree, the AM3 and AM4 results require strengthened CFL conditions. For continuous piecewise affine elements, an argument

based on elementwise constant gradients recovers stability and the error estimate under the standard hyperbolic CFL condition when τ≲δ≲h\tau\lesssim\delta\lesssim h. AM5 requires only the standard hyperbolic CFL condition for every degree covered by the abstract framework. Independent energy identities establish stability and error estimates for the Adams–Bashforth (AB) methods AB3 and AB4 under a standard hyperbolic CFL condition.

  1. The experiments separate temporal accuracy from spatial approximation. An order-matched one-dimensional acoustic test pairs a method of temporal order ν\nu with Pν−1\mathbb{P}_{\nu-1} elements and recovers orders two through five in the fully discrete final and graph errors; the material-residual errors follow the corresponding half-order sequence. A discontinuous solution constructed by d’Alembert’s formula shows second-order local P1\mathbb{P}_1 convergence for normal-equation SUPG in smooth regions separated from the wave fronts, whereas the unstabilised local error converges with order close to 1/21/2. A smooth two-dimensional compact-wave test provides complementary evidence of improved localisation.

Previous Work. Hughes and Brooks introduced the Streamline Upwind Petrov–Galerkin method for stationary hyperbolic problems in [7]. Johnson and co-workers subsequently gave a comprehensive analysis for stationary linear transport in [25], which also discusses the application of Streamline Diffusion to Friedrichs systems.

The extension to transient problems is more delicate because consistency requires the full space–time residual to be tested against the perturbed test function. The resulting cross term couples the discrete time derivative to the spatial differential operator. Bochev and co-workers established invertibility of the linear system in [6], but their result did not provide uniform control of error growth in time. For finite-difference time discretisations, tuning the stabilisation parameter was proposed as a means of controlling the cross term [26]. Space–time finite element methods with discontinuous Galerkin approximation in time offered another route [24, 25], at the cost of larger, fully coupled nonsymmetric systems. Higher-order space–time Streamline Diffusion analyses are available for specialised kinetic systems [1], while an upwind discontinuous Galerkin time discretisation with a space–time SUPG term has recently been analysed for scalar advection–diffusion [3]. These methods discretise time variationally and do not produce the separated linear multistep formulation considered here.

Discontinuous Galerkin methods combined with Runge–Kutta time integration were developed in [14] and became widely used for hyperbolic problems. For continuous finite elements, symmetric alternatives include subgrid viscosity [23], orthogonal subscales [15], local projection [2], and continuous interior penalty stabilisation [12]. When combined with explicit Runge–Kutta methods, these approaches reproduce important stability properties of discontinuous Galerkin schemes [10], although the stabilisation generally enlarges the spatial matrix stencil. High-order continuous finite elements with SUPG and Runge–Kutta or deferred-correction time integration have also been studied by fully discrete Fourier analysis on two-dimensional triangular meshes [27]. That analysis characterises linear stability and admissible CFL parameters, rather than deriving the system-level a priori energy and error estimates pursued here.

Uniform stability of the transient SUPG method for linear transport was established by Burman [9]. Testing with a linear combination of the solution and its time derivative yielded a stability estimate for any AA-stable time discretisation, including Crank–Nicolson and the second-order backward differentiation formula. The analysis was subsequently extended to convection–diffusion problems [13] and time-dependent coefficients [28]. More recently, stability has been proved for third- and fourth-order Runge–Kutta methods combined with Streamline Diffusion in space [19]. Thus the closest rigorous results either stop at second-order linear multistep schemes or use Runge–Kutta, discontinuous-in-time, or coupled space–time formulations. To the best of our knowledge, the present work provides the first stability and a priori error analysis of strongly consistent Streamline Diffusion finite elements combined with linear multistep schemes of order greater than two for multidimensional first-order hyperbolic systems. This is not merely a change of time integrator: the loss of AA-stability beyond order two leads to the method-dependent discrete energy mechanisms developed here for AM3–AM5 and AB3–AB4.

Outline. Section 2 introduces the operator setting, the time average and its adjoint, and the operators TδT_\delta, SδS_\delta, AτA_\tau, and PδP_\delta. Section 3 develops the abstract stability and error framework. Section 4 proves the θ\theta-method energy identity; Section 5 analyses AM3–AM5; and Section 6 derives the AB3 and AB4 energy and stability estimates. Section 7 presents the one- and two-dimensional acoustic experiments, and Section 8 summarises the results and open problems. Appendix A contains the horizon-uniform proof of the dual-residual estimate.

Abstract Setting and Formulation of the Method

We formulate the method for a real Hilbert space H\mathcal{H} with inner product (⋅,⋅)Ω(\cdot,\cdot)_\Omega and a dense subspace V⊂H\mathcal{V} \subset\mathcal{H}. The notation introduced here is used in all subsequent sections. The relations a≲ba \lesssim b and a∼ba \sim b mean, respectively, that a≤Cba \le Cb and cb≤a≤Cbcb \le a \le Cb, with positive constants cc and CC independent of the mesh size, time step, and final computed index unless stated otherwise.

Spatial Operator and Skew-Symmetry. Let GG be a linear operator satisfying

G:V⟶H(5)G : \mathcal{V} \longrightarrow\mathcal{H} \tag*{(5)}

and assume that the boundary conditions and the choice of V\mathcal{V} give

(GU,V)Ω=−(U,GV)Ω∀U,V∈V(6)(GU,V)_\Omega= -(U,GV)_\Omega\quad\forall U,V \in\mathcal{V} \tag*{(6)}

Consequently,

(GU,U)Ω=0∀U∈V(7)(GU,U)_\Omega= 0 \quad\forall U \in\mathcal{V} \tag*{(7)}

The analysis below is for a time-independent operator. Thus, every time difference and time average commutes with GG. Space- or time-dependent coefficients require additional commutator bounds and are not covered by the present statements.

Example: Acoustic Waves. Let c>0c > 0 be constant. Starting from the physical variables pp and vv, introduce the scaled velocity u=cvu = cv. The acoustic system becomes

∂tp+c∇⋅u=fin Ω×(0,T)(8)\partial_t p + c\nabla\cdot u = f \qquad\text{in } \Omega\times(0,T) \tag*{(8)}
∂tu+c∇p=cgin Ω×(0,T)(9)\partial_t u + c\nabla p = cg \qquad\text{in } \Omega\times(0,T) \tag*{(9)}

Set U=(p,u)U = (p,u), F=(f,cg)F = (f,cg), and

H=L2(Ω)×L2(Ω)d(10)\mathcal{H} = L^2(\Omega) \times L^2(\Omega)^d \tag*{(10)}

with the product inner product. The operator is

G(p,u)=(c∇⋅u,c∇p)(11)G(p,u) = (c\nabla\cdot u,c\nabla p) \tag*{(11)}

For periodic boundary conditions, or reflecting-wall boundary conditions for which the boundary pairing vanishes, integration by parts proves (2.2). The corresponding norm is

∥U∥Ω2=∥p∥Ω2+∥u∥Ω2=∥p∥Ω2+c2∥v∥Ω2(12)\lVert U\rVert_\Omega^2 = \lVert p\rVert_\Omega^2 + \lVert u\rVert_\Omega^2 = \lVert p\rVert_\Omega^2 + c^2\lVert v\rVert_\Omega^2 \tag*{(12)}

Thus the powers of cc in (2.4)–(2.5), the operator, and the energy are consistent.

Time Differences, Averages, and Their Adjoints

Let NN denote the final computed index, let τ>0\tau> 0, and set tn=nτt^n = n\tau for 0≤n≤N0 \le n \le N, with tN≤Tt^N \le T. Define the backward and forward time differences by

Dτ−Un=τ−1(Un−Un−1)(13)D_\tau^- U^n = \tau^{-1}(U^n-U^{n-1}) \tag*{(13)}
Dτ+Un=τ−1(Un+1−Un)(14)D_\tau^+ U^n = \tau^{-1}(U^{n+1}-U^n) \tag*{(14)}

For coefficients b0,…,bℓb_0,\ldots,b_\ell, define the method average

MτUn=∑j=0ℓbjUn−j(15)\mathcal{M}_\tau U^n = \sum_{j=0}^{\ell} b_j U^{n-j} \tag*{(15)}

Thus ℓ+1\ell+1 is the stencil length, and b0b_0 is the coefficient of the current value. The same notation is used for sampled exact functions and for the data. The first computed index is denoted by n0n_0, with n0≥ℓn_0 \ge\ell, and all earlier values required by the stencil are prescribed start-up data.

The average Mτ\mathcal{M}_\tau is not self-adjoint on a finite time interval. Extend a test sequence by zero outside n0≤n≤Nn_0 \le n \le N, and define its discrete adjoint average by

Mτ∗Vm=∑j=0ℓbjVm+j(16)\mathcal{M}_\tau^* V^m = \sum_{j=0}^{\ell} b_j V^{m+j} \tag*{(16)}

A change of summation index gives the exact identity

∑n=n0N(MτUn,Vn)Ω=∑m=n0−ℓN(Um,Mτ∗Vm)Ω(17)\sum_{n=n_0}^{N}(\mathcal{M}_\tau U^n,V^n)_\Omega = \sum_{m=n_0-\ell}^{N}(U^m,\mathcal{M}_\tau^*V^m)_\Omega \tag*{(17)}

In particular, Mτ∗Vm\mathcal{M}_\tau^*V^m cannot be replaced by MτVm\mathcal{M}_\tau V^m without additional symmetry and endpoint terms. The corresponding summation-by-parts identity is

References

  1. [1]M. Asadzadeh, P. Kowalczyk, and C. Standar. On hp-streamline diffusion and Nitsche schemes for the relativistic Vlasov–Maxwell system. Kinet. Relat. Models, 12(1):105–131, 2019.
  2. [2]R. Becker and M. Braack. A two-level stabilization scheme for the Navier–Stokes equations. In Numerical mathematics and advanced applications, pages 123–130. Springer, Berlin, 2004.
  3. [3]L. Beirão da Veiga, F. Dassi, and S. Gómez. SUPG-stabilized time-dependent diffusion-diffusion equation. Comput. Methods Appl. Mech. Engrg., 436:117722, 2025.
  4. [4]M. Berggren and L. Hägg. Well-posed variational formulations of Friedrichs-type systems. J. Differential Equations, 292:90–131, 2021.
  5. [5]O. Besson and G. de Montmollin. Space-time integrated least squares: a time-marching approach. Internat. J. Numer. Methods Fluids, 44(5):525–543, 2004.
  6. [6]P. B. Bochev, M. D. Gunzburger, and J. N. Shadid. Stability of the SUPG finite element method for transient advective-diffusion problems. Comput. Methods Appl. Mech. Engrg., 193(23-26):2301–2323, 2004.
  7. [7]A. N. Brooks and T. J. R. Hughes. Streamline upwind/Petrov–Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier–Stokes equations. Computer Methods in Applied Mechanics and Engineering, 32(1–3):199–259, 1982.
  8. [8]K. Burazin and M. Erceg. Non-stationary abstract Friedrichs systems. Mediterr. J. Math., 13(6):3777–3796, 2016.
  9. [9]E. Burman. Consistent SUPG-method for transient transport problems: stability and convergence. Comput. Methods Appl. Mech. Engrg., 199(17-20):1114–1123, 2010.
  10. [10]E. Burman, A. Ern, and M. A. Fernández. Explicit Runge-Kutta schemes and finite elements with symmetric stabilization for first-order linear PDE systems. SIAM J. Numer. Anal., 48(6):2019–2042, 2010.
  11. [11]E. Burman and J. Guzmán. Implicit-explicit multistep formulations for finite element discretisations using continuous interior penalty. ESAIM Math. Model. Numer. Anal., 56(1):349–383, 2022.
  12. [12]E. Burman and P. Hansbo. Edge stabilization for Galerkin approximations of convection-diffusion-reaction problems. Comput. Methods Appl. Mech. Engrg., 193(15-16):1437–1453, 2004.
  13. [13]E. Burman and G. Smith. Analysis of the space semi-discretized SUPG method for transient convection-diffusion equations. Math. Models Methods Appl. Sci., 21(10):2049–2068, 2011.
  14. [14]B. Cockburn and C.-W. Shu. TVB Runge–Kutta local projection discontinuous Galerkin finite element method for conservation laws. II. General framework. Math. Comp., 52(186):411–435, 1989.
  15. [15]R. Codina. Stabilization of incompressibility and convection through orthogonal sub-scales in finite element methods. Comput. Methods Appl. Mech. Engrg., 190(13-14):1579–1599, 2000.
  16. [16]G. G. Dahlquist. A special stability problem for linear multistep methods. Nordisk Tidskr. Informationsbehandling (BIT), 3:27–43, 1963.
  17. [17]E. Deriaz. Stability conditions for the numerical solution of convection-dominated problems with skew-symmetric discretizations. SIAM J. Numer. Anal., 50(3):1058–1085, 2012.
  18. [18]A. Ern and J.-L. Guermond. Discontinuous Galerkin methods for Friedrichs’ systems. I. General theory. SIAM J. Numer. Anal., 44(2):753–778, 2006.
  19. [19]A. Ern and J.-L. Guermond. L^2-stability of explicit Runge–Kutta methods with SUPG stabilization for transient transport problems. Research report hal-05363804, HAL, 2025. Available at https://hal.science/hal-05363804v1.
  20. [20]A. Ern, J.-L. Guermond, and G. Caplain. An intrinsic criterion for the bijectivity of Hilbert operators related to Friedrichs’ systems. Comm. Partial Differential Equations, 32(1-3):317–341, 2007.
  21. [21]T. Führer, R. González, and M. Karkulik. Well-posedness of first-order acoustic wave equations and space-time finite element approximation. IMA Journal of Numerical Analysis, page drae104, 03 2025.
  22. [22]M. L. Ghrist, B. Fornberg, and J. A. Reeger. Stability ordinates of Adams predictor-corrector methods. BIT, 55(3):733–750, 2015.
  23. [23]J.-L. Guermond. Stabilization of Galerkin approximations of transport equations by subgrid modeling. M2AN Math. Model. Numer. Anal., 33(6):1293–1316, 1999.
  24. [24]T. J. R. Hughes, L. P. Franca, and G. M. Hulbert. A new finite element formulation for computational fluid dynamics. VIII. The Galerkin/least-squares method for advective-diffusive equations. Comput. Methods Appl. Mech. Engrg., 73(2):173–189, 1989.
  25. [25]C. Johnson, U. Nävert, and J. Pitkäranta. Finite element methods for linear hyperbolic problems. Comput. Methods Appl. Mech. Engrg., 45(1-3):285–312, 1984.
  26. [26]G. Lube and D. Weiss. Stabilized finite element methods for singularly perturbed parabolic problems. Appl. Numer. Math., 17(4):431–459, 1995.
  27. [27]S. Michel, D. Torlo, M. Ricchiuto, and R. Abgrall. Spectral analysis of high order continuous FEM for hyperbolic PDEs on triangular meshes: influence of approximation, stabilization, and time-stepping. J. Sci. Comput., 94:49, 2023.
  28. [28]J. Zhang and X. Liu. Uniform stability of the SUPG method for the evolutionary convection-diffusion-reaction equation. Comput. Math. Appl., 124:1–6, 2022.

Paper details

vlnc:W_cmjx5d4p
Version
v1 · latest
Published
Added
License
CC BY 4.0
Usage

views · 0

downloads · 2

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

Not recorded for this paper

View statement
Looking for related papers…
Contents