betaFeedback

WorksComputer Science

AeroZoo: A Benchmark of Well-Posed Flow Problems for Foundation Models of Aerodynamics

Abstract

Neural surrogates for computational fluid dynamics (CFD) are trained and ranked on datasets that each vary one design family in one flow domain. Such datasets cannot test the least that an aerodynamic foundation model must do: predict CFD-quality incompressible flow in seconds for new shapes in new enclosures. On DrivAerML, larger models and longer training barely lower Transolver's error; doubling the training cases cuts it by about 12% up to 400 cases, exhausting the dataset. We introduce AeroZoo, a benchmark and training corpus of 3,815 time-mean solutions to the unsteady Reynolds-averaged Navier–Stokes (RANS) equations with a transition model, across seven geometry families, eight enclosure configurations and Reynolds numbers from 10310^3 to 10810^8. Each sample poses a well-posed PDE problem in the form a solver receives it: the boundary meshes grouped by condition type, the prescribed values and the fluid properties. The 2,816 samples with a stable time mean form the canonical benchmark: two tasks, engineering metrics and 22 frozen splits, disjoint in geometry, that hold out geometry families, enclosures, boundary-condition layouts and Reynolds ranges. On the random split, boundary-condition tokens cut GeoTransolver's median velocity error from 76.9% to 8.4% of the inlet speed in single-seed runs (uniform inlet flow: 11.0%). ISLA, a transformer for boundary-driven PDEs, reaches 5.3% over four seeds, about 4 times the change from a finer mesh. On the same test samples, a held-out geometry family barely changes ISLA's error relative to uniform flow, and a held-out enclosure or boundary-condition layout raises it 2.4 to 9.2 times. The data and the scoring code will be released.

Introduction

Neural surrogates for computational fluid dynamics (CFD) aim to predict in seconds the flow and aerodynamic loads that a solver computes in hours (Appendix § 8 defines CFD terms). Most 3D datasets sweep a single design in one fixed domain and boundary-condition layout (Table 1), such as 500 cases sweeping sedan morphs at one Reynolds number in DrivAerML (Ashton et al., [4]). These benchmarks made 3D surrogates practical and remain well suited to single-product optimization.

On a fixed design family, however, scaling models and compute hits diminishing returns once geometry count becomes the bottleneck. On DrivAerML, scaling Transolver (Wu et al., 2024b) at 400 training cases varies surface-pressure error by under 3% from 20 to 354 million parameters, and quadrupling compute lowers it by only about 4%. Only adding training cases still drives error down, by about 12% per doubling, toward a narrow dataset-level floor bracketed between target averaging noise and the scaling asymptote (Appendix § 15).

An aerodynamic foundation model must instead predict accurate flows across new geometries, enclosures and operating points under any consistent boundary conditions. AeroZoo measures the least that wide industrial use needs: CFD quality in seconds for incompressible flow at industrial Reynolds numbers (§ 7 names the next steps). Even in distribution, current surrogates miss their CFD targets by several times the solver’s numerical sensitivity (§ 6). Measuring how well they generalize to unfamiliar problems faces two obstacles:

  1. Breadth. Holding out another morph of the same shape family tests interpolation rather than out-of-distribution generalization.

  1. Posing. Existing datasets omit boundary conditions that they hold fixed, reducing learning to a shape-to-field map rather than the PDE solution operator ([26]). One shape yields different flows above a road, inside a tunnel or beside a second inlet (Figure 1); autoregressive models that roll flows forward like video frames lack this boundary and fluid specification too.

Four enclosure flow visualizations for one car

Figure 1. One car in four enclosures yields four distinct flows at the same inlet speed and Reynolds number: (a) open box, (b) ground-effect box, (c) confined box and (d) dual-inlet box (center-plane speed with streamlines; insets show full domain boundaries; xx along primary inlet, zz vertically). Within one car length of the body, the three single-inlet flows differ by 3 to 7% of UrefU_{\mathrm{ref}} (more than mesh refinement; § 6), no-slip tunnel walls in (c) raise drag by 13%, and the second inlet (d) changes near-body velocity by 152 to 177% and raises CxC_x from 0.026 to 0.55.

We introduce AeroZoo (Figure 2), 3,815 solved flow problems built to address both. Every sample poses a distinct geometry from seven families of blobs, CAD parts, cars, aircraft and streamlined bodies in one of eight enclosures, plus 161 body-free ducts, across sizes of 2 cm to 20 m and Reynolds numbers from 10310^3 to 10810^8 under one frozen numerical recipe. Each sample packages the complete boundary-value problem: boundary meshes grouped by condition type, face-wise prescribed values and fluid properties. As a benchmark and pretraining corpus, AeroZoo contributes:

The zoo: eight enclosure configurations—Open box, Ground-effect box, Confined box, Crossflow box, Dual-inlet box, Opposed sphere, Symmetry hemisphere and Internal duct—across seven geometry families—Blobs, Blender bluff, Procedural cars, Zero-to-CAD, Airframe Foundry, Streamlined and Blender streamlined—with inlet, outlet, no-slip wall and slip wall boundary types

Figure 2. The zoo: every tile is a distinct geometry posed as its own boundary-value problem. Columns show the eight enclosure configurations (sketched above by boundary type; opposed spheres may be smooth or lumpy) and rows the seven geometry families; each tile displays the first mean_stable sample in seed order (with a body for ducts), cut along the primary inlet velocity over its full fluid domain on its own scale (colorbar linear on 0–1 and 1–2.5).

  1. 3,815 well-posed problems (23.8 B cells) with stability labels and an error stack-up (§ 3 and § 6);

  1. a DomainMesh schema and input rule separating PDE inputs from scoring scales (§ 2);

  1. interior and boundary tasks, volume- and area-weighted metrics and 22 frozen splits (§ 4); and

  1. baseline results showing that boundary tokens cut Geo-Transolver’s median velocity error 9-fold, from 76.9% to 8.4%, and 4-fold relative to the best boundary-blind baseline; ISLA ([27]) reaches 5.3%, and on held-out splits its error grows most where the boundary conditions are new (§ 5 and § 6).

DatasetFamiliesEnclosuresOperating pointsSolverSamplesCells per sample
AeroZoo78Re 103Re\ 10^{3}–10810^{8}, continuousURANS mean, transition3,8150.6–24 M
DrivAerML (Ashton et al., [4])11onehybrid RANS–LES500 (484 public)160 M
WindsorML (Ashton et al., [2])11onewall-modeled LES355280–300 M
AhmedML (Ashton et al., [3])11oneDDES50015–20 M
DrivAerNet++ (Elrefaie et al., 2024)11oneRANS8,00024 M
SHIFT-SUV (Luminary Cloud, [19])1–two scalesDES>1,000–
DrivAerStar (Qiu et al., [25])11oneRANS12,00012 M
ShapeNet-Car (Umetani & Bickel, [30])11oneURANS mean889–
HiLiftAeroML (Ashton et al., [5])1110 incidenceswall-modeled LES1,800300–500 M
BlendedNet (Sung et al., [28])11about nine per bodyRANS8,8309–14 M
SuperWing (Yang et al., [34])11Mach, incidenceRANS28,856–
Emmi-Wing (Paischer et al., [23])11one per wingRANS29,727–
FlowBench, 3D part (Tali et al., [29])21Re 10Re\ 10–10310^{3}DNS500–
WindTunnel-20k (Inductiva, [15])–1four speeds, five yaw anglessteady RANS, 300 iterations19,812–

Table 1. AeroZoo spans seven geometry families and eight enclosure configurations, whereas most public 3D CFD datasets vary one design family and several use costlier scale-resolving solvers (Appendices § 8 and § 16; –: not stated).

A well-posed sample

A learning task is well-posed when its inputs determine its target, extending the usage of Sharpe [26] in the spirit of Hadamard’s requirement that a problem’s data determine its solution Hadamard [14]. An incompressible RANS problem with a fixed turbulence closure is posed by three things: the boundary of the fluid domain, the type of condition imposed on each part of it with the values that condition prescribes, and the fluid’s density and kinematic viscosity. A solver receives these and no more. For a learned model, the input is therefore the geometry together with its boundary conditions and fluid (Figure 1). A dataset that holds the conditions fixed can leave them out, and its models then learn a map from shape alone, valid only under those conditions; if it omits one that varies between its samples, identical inputs have different targets, and no model can fit both. Figure 3 shows how a sample’s tensors are divided.

Annotated DomainMesh sample and declared tensor roles

Figure 3. Each tensor has a single declared role, and only PDE inputs and query coordinates enter a model. (a) An Airframe Foundry aircraft in a ground-effect box at Re=3.5×106Re = 3.5 \times10^{6} (1.7∘1.7^\circ incidence, 5.4∘5.4^\circ sideslip, three contiguous slip and no-slip bands enlarged above), with a translucent center-plane speed cut. (b) Reference scales and run metadata are withheld for scoring and auditing (Appendix § 11).

Boundaries and their conditions. A sample merges the parts of the boundary that impose one type of condition into one triangle mesh. There are always four: an inlet that prescribes the velocity and turbulence quantities; an outlet that fixes the gauge pressure at zero; a no_slip wall; and a slip wall, which also stands in for planes of symmetry. A body may be partly no-slip and partly slip, and an enclosure wall may be either, so the condition type is an input: a model cannot infer it from the shape. The values each face prescribes are stored beside it. A duct with a bend or a dual-inlet box has no single inlet vector, so a model that uses one must compute it.

What a model may use. Only two scalars in global_data are inputs: kinematic viscosity ν\nu, and density ρ\rho (to convert kinematic pressure and shear to pascals). Reference scales in global_data/reference (Lref,Uref,qref=ρUref2/2L_{\mathrm{ref}}, U_{\mathrm{ref}}, q_{\mathrm{ref}} = \rho U_{\mathrm{ref}}^{2}/2 and force axis eF\mathbf{e}_{F}) normalize metrics (§ 4) and are withheld: a rectangular wing’s Reynolds number can be defined on its chord or its span, so handing LrefL_{\mathrm{ref}} to a model would leak dataset conventions (which body is primary and how it was measured). Instead, the input rule states:

  • A model may compute any function of one sample’s inputs: geometric features, a cheap solver (with its cost reported), or boundary-derived per-case scales such as length, speed and Reynolds number (derive_globals, Appendix § 12). Dividing coordinates by a derived length requires passing that length or its Reynolds number as an input so differently sized cases remain distinguishable.

  • Withheld from inputs: targets, cell volumes, body annotations (body_id), all other global_data keys and any statistic fitted on test samples.

Physical units. Samples are stored in SI units. Because length, speed and Reynolds number are drawn independently, (L,U,ν)(L,U,\nu) sweeps similarity orbits of Buckingham’s Π\Pi theorem across 10 decades of ν\nu (with 23% of samples between the viscosities of water and air; Appendix § 9.§ 5), preventing models from memorizing air or water constants and testing dimensional similarity (Bakarji et al., [8]; Villar et al. [31]; Sharpe [26]).

Interior points and cell volumes. Interior targets live at the finite-volume cell centroids, which serve as query coordinates. Evaluating at cell centroids scores predictions directly on native cells without interpolation; point density reflects wake and wall-layer refinement, and an optional independent-query mode decodes each query point from boundaries alone. Cell volumes span decades from walls to far field; they weight metrics and may weight training losses, while remaining withheld at inference. Each sample is a PhysicsNeMo DomainMesh (PhysicsNeMo Contributors, [24], Appendix § 11):

from physicsnemo.mesh import DomainMesh
sample = DomainMesh.load(path)  # lazy
inlet = sample.boundaries["inlet"]
bc = inlet.cell_data["prescribed", "dirichlet"]
u_in = bc["velocity"]           # [F, 3] m/s
physics = sample.global_data["physics"]
nu = physics["kinematic_viscosity"]  # m^2/s
x = sample.interior.points       # [N, 3] m
fields = sample.interior.point_data["solution"]
u = fields["velocity"]           # [N, 3] m/s

The dataset

Every sample is a different body, or a body-free duct, in its own enclosure at its own size, speed and viscosity. A case is a planned problem, fully determined by one seed and a frozen recipe, and a sample is a case that was solved and released. A case that fails is recorded and never replaced (Appendix § 9).

What varies. Each case draws a body from one of seven geometry families (Figure 4; the Zero-to-CAD family samples a public corpus of CAD programs (Ataei et al., [6]; Autodesk AI Lab, [7])), one of eight enclosure configurations, which differ in the boundary condition that each face imposes (Table 4), and a length, a speed and a Reynolds number, which set the viscosity (Table 5). Every case is rotated at random in 3D and most bodies are posed at a random orientation to the flow, so the flow direction cannot be inferred from the shape. With probability 0.03, a case adds a second body: a copy of its own body, 0.25 to 1 times its size and posed independently. Two thirds of bodies are split by parallel planes into two or three contiguous slip and no-slip bands (Figure 3a, Table 5). Under a uniform, irrotational inflow, no-slip walls are the only source of vorticity, so the bands test whether a surrogate locates boundary-layer onset from the prescribed wall types.

Figure 4. Every AeroZoo geometry family (three example bodies shown at left) exceeds the shape diversity of single-design sweeps (gray). Vendi scores (Friedman & Dieng, [11]) at 400 shapes (dots) and 126 shapes (diamonds, matching HiLiftAeroML; Appendix § 16).

Configuration (share)What its boundaries doDistances to the faces
Open box (14.4%)inlet opposite outlet; the four side faces slipinlet 0.8–2.2, outlet 2–5, sides 0.8–2.5
Ground-effect box (14.4%)as the open box, with one side face a no-slip groundinlet 0.7–2, outlet 1.5–4, sides 0.5–2, ground 0.05–0.3
Confined box (14.4%)inlet opposite outlet; all four side faces no-slipinlet 0.3–1, outlet 0.7–2, walls 0.1–0.7
Crossflow box (14.4%)outlet on a face adjacent to the inlet; one to three other faces no-slipinlet and outlet 0.5–2.5, sides 0.4–2, no-slip 0.1–0.8
Dual-inlet box (14.4%)a second inlet, 0.5 to 1.5 times as fast as the first, on a face adjacent to the first; outlet opposite the first; zero to three faces no-slipinlets 0.5–2, outlet 1–3, sides 0.4–2, no-slip 0.15–1
Opposed sphere (9%)a smooth or lumpy sphere with inlet and outlet caps on opposite sidessampled radius
Symmetry hemisphere (9%)half a sphere closed by a symmetry plane; inlet and outlet caps on the domesampled radius
Internal duct (10%)a passage of one of 10 shapes with inlet and outlet ends and no-slip walls (sometimes slip span walls); a body in half of themshape-dependent

Table 4. The eight enclosure configurations. Box distances are from the body to each face, in reference lengths, drawn uniformly per case; the whole case is then rotated at random.

QuantityHow it is set
Enclosureone of eight configurations, with the shares of Table 4
Reference length LrefL_{\mathrm{ref}}log-uniform, 0.02 to 20 m. The body is scaled so that its largest extent before rotation is LrefL_{\mathrm{ref}}; in a body-free duct, LrefL_{\mathrm{ref}} is the inlet’s hydraulic diameter
Inlet speed UrefU_{\mathrm{ref}}log-uniform, 0.25 to 50 m/s, on the primary inlet
Reynolds number ReReone of the five decades from 10310^3 to 10810^8, in equal shares; log-uniform within it
Viscosity ν\nuUrefLref/ReU_{\mathrm{ref}}L_{\mathrm{ref}}/Re
Density ρ\rho1.225 kg/m3^3 in every case
Inflow turbulenceintensity II log-uniform, 0.5% to 10%; length scale ℓ\ell log-uniform, 0.01 to 1Lref1L_{\mathrm{ref}}, with k=32(IUref)2k = \frac{3}{2}(IU_{\mathrm{ref}})^2 and ω=k1/2/(Cμ1/4ℓ)\omega= k^{1/2}/(C_\mu^{1/4}\ell)
Body orientationin the open, ground-effect and confined boxes, aligned with the flow with probability 0.5 (longest area-weighted principal axis along the inlet direction, with Gaussian incidence and sideslip of about 6∘6^\circ; the sign of its third moment of area picks fore and aft when skewness ≥0.1\ge0.1, or at random otherwise, the roll about it is uniform in open and confined boxes, and in ground-effect boxes the vertical sign is arbitrary, so a wide-span aircraft is posed spanwise and about half of those bodies are inverted); otherwise, and in every other configuration, uniformly random
Mirroringwith probability 0.5, with the triangle wingtip restored
Body wallall no-slip, two bands or three bands, each with probability 1/31/3. Bands are contiguous, alternately slip and no-slip, and cut by planes normal to a random direction
Second bodywith probability 0.03: a copy of the case’s own body, 0.25 to 1 times its size and posed independently, 0.1 to 1 reference lengths away
Whole caserotated at random in 3D

Table 5. What is drawn for each case. “Log-uniform” is uniform in the logarithm.

Breadth in shapes and flows. Measured by the Vendi score (Friedman & Dieng, [11]) (nn identical shapes score 1; nn distinct shapes score nn), even the least varied AeroZoo family scores at least 1.9 times the more varied automotive dataset across kernel bandwidths, and Zero-to-CAD reaches 97% distinct shapes (Figure 4, Appendix § 16). Across solutions (Figure 10), below Re=5×104Re = 5 \times10^{4}, 90% of bodies are laminar over ≥98%\geq98\% of their area; above 2×1052 \times10^{5} the median laminar share is 0.7%. Away from walls, inflow eddy viscosity sets an outer-wake effective Reynolds number of median 1,100 (10210^{2} to 10410^{4}), while molecular viscosity ν\nu governs wall shear, dropping median skin friction 18-fold across the five Reynolds decades.

Figure 10. The flows span regimes: one dot per released sample with a body. (a) Share of the body’s no-slip area where the transition model’s intermittency γˉ\bar{\gamma} is below one half. (b) Area-mean skin-friction coefficient Cf=∣τw∣/qrefC_f = |\tau_w|/q_{\mathrm{ref}} on the body’s no-slip faces, with the mean friction of a laminar and a turbulent flat plate of length LrefL_{\mathrm{ref}}.

Meshing and solving. The snappyHexMesh mesher of OpenFOAM (Weller et al., [32]; Greenshields, [13]) builds a mesh of a few million cells, refined on the body and along its wake. Wall layers are sized before the flow is known, from flat-plate friction at the case’s Reynolds number. Many of these flows never become steady, so the target is the time mean of an unsteady solution. OpenFOAM 14 solves the incompressible unsteady RANS equations with the Langtry–Menter transition SST model (Menter, [21]; Menter et al., [22]; Langtry & Menter, [18]), which lets a boundary layer start laminar and become turbulent, and wall functions, algebraic laws for the wall shear, model the flow nearest the walls. Each inlet prescribes a turbulence intensity and a length scale drawn for the case. A case runs for 15 convective times Tc=Lref/UrefT_{\mathrm{c}} = L_{\mathrm{ref}}/U_{\mathrm{ref}} of warm-up and 80 of averaging (Appendix § 9). Of 4,360 planned cases, 3,815 (87.5%) completed, in 1.48 TB. Of the others, 208 failed a mesh or solver check, and 337 were still solving when generation stopped, 230 of them in the top Reynolds decade.

The stability label. A finite-window mean is an estimate, so we compare the means over the two halves of each sample’s window. A sample is labeled mean_stable if the halves agree within 0.02UrefU_{\mathrm{ref}} in volume-weighted velocity, 0.05qrefq_{\mathrm{ref}} in pressure and 2% in the inlet-aligned force CFC_{\mathrm{F}} (Equation (2) and Appendix § 9.§ 4), and mean_unstable otherwise. Of the 3,815 released samples, 2,816 (74%) are mean_stable. The share depends mostly on the enclosure configuration (Figure 8): it is 88 to 94% in five configurations, 30% in crossflow boxes, 34% in symmetry hemispheres and 67% in ducts. Both sets are released. The canonical benchmark trains, validates and tests only on the mean_stable samples. The label is computed from the solution, so a model cannot tell from its inputs which problems are scored.

Figure 8. Crossflow boxes and symmetry hemispheres are mostly mean_unstable; five configurations are about 90% stable. Share of released samples labeled mean_stable, by enclosure configuration, with the number of samples at the right. The label records whether the finite-window mean had settled; samples with either label passed the solver’s checks.

The benchmark

A result on AeroZoo is a task, scored by a metric, on a split, and it is compared with a reference that needs no training.

Two tasks. Both tasks give a model the posed problem, under the input rule of § 2, and ask for the time-mean solution. The interior task predicts the seven mean fields at the interior cell centroids, a median of 5.0 M points per sample. Velocity and pressure are scored by the headline metrics below; the five turbulence fields (Figure 3) are optional auxiliary targets (Appendix § 12). The boundary task predicts the solution where the loads act: the mean fields at the centroid of every boundary face, a median of 0.43 M faces, and the wall shear stress on the no-slip faces. The model is not given

the interior points, and fields that a Dirichlet condition fixes on a boundary are not scored.

Metrics. Each metric is normalized by the sample’s scoring scales (§ 2). With cell volumes ViV_i as weights and a hat on each predicted value, the interior task is scored by

εU=1Uref(∑iVi∥u^i−ui∥2∑iVi)1/2,εp=1qref(∑iVi(p^i−pi)2∑iVi)1/2(1)\varepsilon_U = \frac{1}{U_{\mathrm{ref}}}\left(\frac{\sum_i V_i\lVert\hat{\boldsymbol{u}}_i-\boldsymbol{u}_i\rVert^2}{\sum_i V_i}\right)^{1/2}, \qquad \varepsilon_p = \frac{1}{q_{\mathrm{ref}}}\left(\frac{\sum_i V_i(\hat{p}_i-p_i)^2}{\sum_i V_i}\right)^{1/2} \tag*{(1)}

over the fluid and again over the near field, the points within one LrefL_{\mathrm{ref}} of a body face centroid (εUN\varepsilon_U^{\mathrm{N}}, εpN\varepsilon_p^{\mathrm{N}}). Both matter because the enclosures differ in size: the median fluid volume spans a factor of 38, from 5.8Lref35.8L_{\mathrm{ref}}^3 in confined boxes to 217Lref3217L_{\mathrm{ref}}^3 in symmetry hemispheres, and the far field of a large enclosure, where predicting the inflow state is nearly right, dilutes εU\varepsilon_U. The near-field errors weigh the flow around the body the same way regardless of enclosure size. Our tables lead with the medians over the test samples of εU\varepsilon_U, εUN\varepsilon_U^{\mathrm{N}} and εp\varepsilon_p, and Appendix § 12 adds relative L2L^2 errors.

The boundary task is scored on the body, which the scorer picks out by its annotation (the model is not given it), with faces B\mathcal{B}, no-slip faces W⊆B\mathcal{W} \subseteq\mathcal{B}, areas AjA_j, normals nj\boldsymbol{n}_j pointing out of the fluid and wall shear τj\boldsymbol{\tau}_j, the traction of the wall on the fluid. The force coefficient and its errors are

C=1qrefLref2(∑j∈BpjAjnj−∑j∈WAjτj),(2)\mathbf{C} = \frac{1}{q_{\mathrm{ref}}L_{\mathrm{ref}}^2}\left(\sum_{j\in\mathcal{B}}p_jA_j\boldsymbol{n}_j-\sum_{j\in\mathcal{W}}A_j\boldsymbol{\tau}_j\right), \tag*{(2)}
εCF=∣C^F−CF∣max⁡(∣CF∣,0.05),εC=∥C^−C∥max⁡(∥C∥,0.05),\varepsilon_{C_{\mathrm{F}}}=\frac{|\hat{C}_{\mathrm{F}}-C_{\mathrm{F}}|}{\max(|C_{\mathrm{F}}|,0.05)}, \qquad \varepsilon_C=\frac{\lVert\hat{\mathbf{C}}-\mathbf{C}\rVert}{\max(\lVert\mathbf{C}\rVert,0.05)},

where CF=C⋅eFC_{\mathrm{F}}=\mathbf{C}\cdot\mathbf{e}_{\mathrm{F}} projects the force onto the direction eF\mathbf{e}_{\mathrm{F}} of the fastest inlet, which reduces to the drag in straight-through flow, and εC\varepsilon_C scores the full 3D load vector. Appendix § 12 defines the errors of surface pressure, wall shear and a duct’s total-pressure loss.

Splits. AeroZoo freezes 22 geometry-disjoint splits of the 4,360 planned cases by hashing each primary body (Table 2 lists the seven headline splits; all 22 in Appendix § 13):

SplitIdentifierTrainVal.Test
Randomfull2,011290515
Random, 1/6 trainscarce321290515
Random, 1/36 trainsuper_scarce53290515
Non-box enclosuresfamily_non_box1,850274692
Dual-inlet boxesprofile_dual_inlet2,044313459
Re≥106Re \ge10^{6}random1,5772381,001
Procedural carsbank_cars2,173321310

Table 2. The seven headline splits test a model in distribution at three training-set sizes and on four held-out regions (below the rule), each named by its test set. Sizes count canonical (mean_stable) samples; the test size of bank_cars counts samples with a body. In split identifiers, family denotes an enclosure group, bank a geometry family and profile a box layout.

  • Three random splits: full (about 70/10/20%), scarce (1/6 train) and super_scarce (1/36 train).

  • Nineteen held-out splits: each holds out one test region (a geometry family, an enclosure or the three non-boxes, a Reynolds range or three-band bodies); body-property splits score only samples with a body.

Training is for fitting and validation for selection only. Because held-out test regions overlap full’s training and validation parts, models pretrained on AeroZoo may use only the scored split’s training part, and reusing settings selected on full must be stated (Appendix § 13).

Reporting. A result gives each metric’s mean and median over the canonical test samples on which it is defined. The free-stream reference predicts the inlet state everywhere (the area-weighted mean of the prescribed inlet velocities and turbulence quantities, zero gauge pressure and zero wall shear); it needs no training and uses only the inputs, so a model whose error is near it shows no skill on that sample. Because the reference’s median ϵU\epsilon_U on full runs from 0.034 in opposed spheres to 1.513 in dual-inlet boxes (Table 15), an interior-task result also reports the per-sample ratio ϵU/ϵUfs\epsilon_U/\epsilon_U^{\mathrm{fs}}, the share of samples where it is below 1 and the median per enclosure, which control for a split’s mix of enclosures (Appendix § 12).

Opposed sphere (63)Open box (95)Ground-effect box (107)Confined box (59)Symmetry hemisphere (29)Internal duct (41)Crossflow box (34)Dual-inlet box (87)
Free-stream reference0.0340.0430.0740.1590.1940.5100.9691.513
Transolver
SI units1.0001.0021.0061.0231.0051.0061.1201.994
per-case scales1.2360.0830.0910.1621.5780.4430.9721.118
GeoTransolver (no boundary tokens)
SI units1.0000.9971.0011.0181.0060.9451.1302.003
per-case scales1.0760.4290.3900.4271.2800.5311.2001.607
GeoTransolver (with boundary tokens)
SI units0.0780.0910.1130.2020.2040.5420.9471.516
per-case scales0.0310.0570.0580.1170.1140.3100.3961.124
ISLA, mean of four seeds
interior targets0.0230.0280.0430.0900.0520.1380.1240.143
+ boundary targets0.0220.0280.0410.0870.0510.1230.1230.136

Table 15.

What current models do

First results on full vary boundary-condition inputs and unit scaling, SI units or per-case scales, and add ISLA (Sharpe, [27]), a transformer for boundary-driven PDEs (Table 3). Without boundary conditions, models in per-case scales fit their training samples without generalizing, ending with validation errors 4 to 6 times their training errors, and models in SI units do not fit even their training samples: nothing gives them the inflow, whose speed spans a factor of 200 in a random direction (Appendix § 14). § 6 gives ISLA’s errors on the held-out splits.

ModelGiven the boundary conditionsSI units: εU\varepsilon_USI units: εUN\varepsilon_U^NSI units: εp\varepsilon_pSI units: ratioSI units: lower than ref. ↑Per-case scales: εU\varepsilon_UPer-case scales: εUN\varepsilon_U^NPer-case scales: εp\varepsilon_pPer-case scales: ratioPer-case scales: lower than ref. ↑
Free-stream referenceyesunit-invariant (as right)–0.1100.1600.0591–
Zero predictornounit-invariant (as right)–1.0051.0070.059––
Transolverno1.0071.0090.0599.191%0.3450.2760.0561.1541%
GeoTransolver (no boundary tokens)no1.0041.0050.0628.881%0.7690.8040.0813.9013%
GeoTransolver (with boundary tokens)yes0.1730.2020.0591.1220%0.0840.1240.0470.8482%
ISLAyesunit-invariant (as right)0.0530.0910.0230.5098%
ISLA + boundary targetsyesunit-invariant (as right)0.0520.0890.0210.4798%

Table 3. Given the boundary conditions as tokens, in per-case scales, GeoTransolver has a lower velocity error than the free-stream reference on 82% of test samples, and ISLA on 98%. Trained in SI units without them, a model scores as the zero predictor (zero velocity and zero gauge pressure). Interior task on full, 515 canonical test samples, one seed per Transolver and GeoTransolver row and the mean of four per ISLA row: medians of εU\varepsilon_U, εUN\varepsilon_U^N (over samples with a body) and εp\varepsilon_p, the median per-sample ratio of εU\varepsilon_U to the reference’s, and the share of samples where that ratio is below 1. ISLA scales its inputs itself, so its rows do not depend on their units. ISLA + boundary targets was also trained on the boundary pressure, velocity and wall shear, every other row on interior targets only. Bold marks the best learned value of each metric. The models have 9.0, 27.6 and 67.5 M parameters.

The runs. Transolver (Wu et al., 2024) and GeoTransolver (Adams et al., [1]) were trained on the canonical training samples of full in PhysicsNeMo (PhysicsNeMo Contributors, [24]) (200,000 sampled interior points per step, one seed per row) and scored on all 515 canonical test samples (Appendix § 14). Three model setups vary boundary inputs: Transolver and GeoTransolver without boundary tokens receive only query coordinates and signed distance to no_slip walls; GeoTransolver with boundary tokens also receives up to 50,000 sampled faces per boundary with condition type and prescribed values. Each setup is trained in two unit scalings: SI units (viscosity as the sole global input) and per-case scales (coordinates and fields nondimensionalized by boundary-derived length and speed, passing log Reynolds number; dividing fields by inlet speed reveals that speed without revealing direction or wall types). Three precision/schedule settings were run per cell (Table 14); Table 3 prints float32 with cosine decay throughout, and Figure 5 shows predictions on three test samples. ISLA (Sharpe, [27]) is given the same boundary conditions, as all four boundary meshes with condition types and prescribed values, and computes the per-case scales inside the model; its two rows (67.5 M parameters, four seeds each) differ only in their training targets (Appendix § 14).

Figure 5. Predicted center-plane velocity fields and streamlines on three canonical full test samples (labels below tiles give whole-domain εU\varepsilon_U and near-field εUN\varepsilon_U^N; on CFD truth they give the free-stream reference’s error; ISLA: one training seed; GeoTransolver: per-case scales). ISLA predicts all three flows. Given boundary tokens, GeoTransolver predicts the 90° turn in (a) and the car wake and road boundary layer in (b); without them it predicts wrong flow directions. In (c), its near-field error is 0.10 where uniform flow scores 0.15, and far-field drift over this sample’s 93% outer volume puts whole-domain εU\varepsilon_U at 0.056 compared with 0.047 (ISLA: 0.025).

Unit scalingPrec.Sched.GPU-hεU↓\varepsilon_U \downarrow95% CIεUN↓\varepsilon_U^N \downarrowratio ↓\downarrow<FS ↑\uparrowεp↓\varepsilon_p \downarrowtrain rUr_Uval. rUr_Uval. rpr_pbest epoch
Transolver (9.0 million parameters)
SI unitsfloat32cosine781.0071.005–1.0081.0099.191%0.0590.9990.9991.00250
SI unitsfloat32step741.0071.005–1.0091.0099.191%0.0590.9970.9971.01250
SI unitsbfloat16step311.0071.005–1.0081.0099.201%0.0800.9970.9961.06211
per-case scalesfloat32cosine780.3450.214–0.4820.2761.1541%0.0560.1130.5943.3646
per-case scalesfloat32step730.3400.222–0.4780.2941.3138%0.0520.1340.5682.0341
per-case scalesbfloat16step310.4070.272–0.5840.3701.2933%0.0650.1330.5872.2446
GeoTransolver (no boundary tokens) (27.6 million parameters)
SI unitsfloat32cosine1821.0041.002–1.0061.0058.881%0.0620.9810.9831.01250
SI unitsfloat32step1881.0041.003–1.0061.0069.161%0.0590.9930.9941.01250
SI unitsbfloat16step591.0041.003–1.0061.0078.921%0.0810.9870.9901.06250
per-case scalesfloat32cosine1790.7690.647–0.8930.8043.9013%0.0810.1060.6205.1836
per-case scalesfloat32step1730.7750.665–0.8920.7823.9713%0.0830.1540.6212.7631
per-case scalesbfloat16step570.9040.822–1.0130.9354.9912%0.1080.1480.6173.3731
GeoTransolver (with boundary tokens) (27.6 million parameters)
SI unitsfloat32cosine1900.1730.152–0.2040.2021.1220%0.0590.3730.3951.00250
SI unitsfloat32step1920.9880.984–0.9900.9888.332%0.0870.9250.9321.09226
SI unitsbfloat16step690.9840.980–0.9870.9858.451%0.1420.9270.9401.53211
per-case scalesfloat32cosine1830.0840.077–0.1010.1240.8482%0.0470.0700.1750.61126
per-case scalesfloat32step1760.0960.082–0.1130.1270.8480%0.0470.0860.1740.62101
per-case scalesbfloat16step650.1010.087–0.1220.1360.8676%0.0500.0980.1820.65201
ISLA (67.5 million parameters), mean of four seeds
interior targetsbfloat16cosine1020.0530.048–0.0610.0910.5098%0.0230.0540.1140.32–
+ boundary targetsbfloat16cosine1490.0520.047–0.0580.0890.4798%0.0210.0510.1070.29–

Table 14.

  1. Boundary tokens separate the models. In per-case scales, GeoTransolver’s median ϵU\epsilon_U falls from 0.769 without boundary tokens to 0.084 with them, and its near-field ϵUN\epsilon_U^{N} from 0.804 to 0.124, where the reference scores 0.160. With boundary tokens, its error is lower than the reference’s on 82% of samples, at a median ratio of 0.84. It gains most in crossflow boxes (0.396, where the reference scores 0.969) and is worse than the reference in open boxes (0.057 and 0.043; Figure 12), whose far field is 89% of the fluid volume. In a controlled bfloat16 ablation on full (Table 18), six seeds with full boundary tokens reach 0.076 (86% below the reference), whereas zeroing condition types and prescribed values on the same tokens raises median ϵU\epsilon_U to 0.238 (ratio 1.16), keeping condition without values gives 0.088, and replacing tokens with one global mean inlet velocity gives 0.083 (0.378 compared with 0.214 in crossflow boxes).

Figure 12. The rows of Table 3 in per-case scales by enclosure configuration (test counts in parentheses; 95% bootstrap intervals; ISLA: mean of four seeds). Left: median εU\varepsilon_U. Right: median per-sample ratio εU/εUfs\varepsilon_U/\varepsilon_U^{\mathrm{fs}} for GeoTransolver with boundary tokens (filled circles), below the free-stream reference’s (< 1, shaded) in seven of eight configurations, and for ISLA (squares), below it in all eight.

VariantParamsSeedsϵU↓\epsilon_U \downarrow95% CIϵp↓\epsilon_p \downarrowratio ↓\downarrow⟨\langleFS⟩↑\rangle\uparrowOpen boxCrossflowDual inlet
Full boundary tokens (22 channels)27.6 M60.0760.068–0.0850.0370.7286%0.0370.2140.363
Condition types only (values zeroed)27.6 M10.0880.079–0.1010.0400.8566%0.0450.2210.471
Face centroids only (types & values zeroed)27.6 M10.2380.189–0.3110.0601.1642%0.0640.8361.084
No boundary tokens + global mean inlet uu9.0 M10.0830.074–0.1040.0420.8075%0.0380.3780.459

Table 18. Controlled boundary-token ablation of GeoTransolver on full (per-case scales, bfloat16, warm-up plus cosine decay at 10−310^{-3}, epoch 250, 515 canonical test samples). The middle two rows keep the full model and random draws with selected token channels zeroed; the last row removes boundary tokens and ball-query branches and passes the area-weighted mean inlet velocity beside ReRe as a global input.

  1. ISLA’s two rows have the lowest errors. ISLA’s median ϵU\epsilon_U is 0.053, its near-field ϵUN\epsilon_U^{N} 0.091 and its ϵp\epsilon_p 0.023; trained also on boundary targets, it scores 0.052. It has a lower velocity error than the reference on 98% of samples, at a median ratio of 0.50, and both rows have a lower median error than every Transolver and GeoTransolver row in every enclosure configuration (Figure 12).

  1. Without boundary tokens, the query mesh gives away the wake in boxes. The mesher refines a wedge from a box’s body to its outlet, so the density of query points marks the flow direction; spheres and hemispheres have no such wedge. In per-case scales, Transolver scores 0.083 in open boxes and 1.236 in opposed spheres, and GeoTransolver without boundary tokens 0.39 to 0.43 in the boxes and above 1 in the spheres, perhaps because its ball-query radii of up to 5 LbL_b (Appendix § 12) span a whole box.

  1. Transolver and GeoTransolver learn little of the pressure, and only in per-case scales. Their best median ϵp\epsilon_p is 0.047 (GeoTransolver with boundary tokens), where zero gauge pressure scores 0.059 and ISLA 0.023. About

half of the samples sit in enclosures where zero gauge pressure is nearly right (open, ground-effect and sphere), and dual-inlet and crossflow boxes build large upstream heads: GeoTransolver with boundary tokens beats zero pressure on 85% of samples (mean εp\varepsilon_p 1.292 compared with 1.809), and ISLA on 99%. No row in SI units beats zero pressure.

The error stack-up

A surrogate’s error with respect to a real flow builds up from four links, like the tolerances of an assembly (Figure 6). First, the equations differ from reality: this is the modeling error. Second, the targets differ from the exact solution of those equations, through discretization and a finite averaging window. Third, the surrogate differs from the targets on problems like its training data. Finally, it has an extra error on problems unlike its training data. AeroZoo states the equations and measures the other three links, the last on its held-out splits.

Figure 6. The four-link error stack-up (% of UrefU_{\mathrm{ref}}; x-scale compressed above 18%). Solver sensitivities (2; whiskers: case range) are slivers near zero beside surrogate error on full (3; 95% bootstrap intervals; dashed: uniform flow, 11.0%). On test samples shared with full (4, counts in parentheses), ISLA trained on each held-out split (bars, two seeds) jumps far past ISLA trained on full (diamonds) for new enclosures and layouts.

The targets change little when they are averaged, rerun or refined. Across the stable samples, the means over the two halves of each averaging window differ by a median of 0.13% of UrefU_{\mathrm{ref}} in velocity, and a rerun on another cluster changes the velocity by a median of 0.0002%. In a grid study of seven released samples and two control cases (Appendix § 10), a mesh 1.5 times finer in each direction changes the velocity by a median of 1.2% (1.4% over the released samples alone), and a wall-resolved first cell changes it by 0.7%.

Surrogate error is much larger than these numerical sensitivities. On the random split, the best model of § 5, ISLA, has a median εU\varepsilon_U of 5.3% of UrefU_{\mathrm{ref}}, where the free-stream reference scores 11.0%: about 4 times the median velocity change under mesh refinement (GeoTransolver’s 8.4%: about 7 times). Only in the opposed spheres and open boxes (2.3% and 2.8%), whose far field fills most of the volume, is it within 2.5 times that. Integrated surface forces are more sensitive to near-wall resolution: their median εCF\varepsilon_{C_F} is 3.7% under mesh refinement and 6.9% with a wall-resolved first cell.

On problems unlike its training data, the error grows most where the boundary conditions are new (Table 16 and Table 17). On the test samples that a held-out split shares with full, holding that kind of problem out of training multiplies ISLA’s median ratio to the reference by 1.1 and 1.0 for blob and CAD-part bodies, 1.2 for Reynolds numbers of 10610^6 and above, 2.4 for the non-box enclosures, where the ratio rises above 1, and 5.5 and 9.2 for the crossflow and dual-inlet layouts. GeoTransolver shows the same split across three-seed held-out runs, compared on the same shared test samples with six seeds on full (median εU\varepsilon_U 7.6%; Table 17): holding out blob bodies, CAD-part bodies or Re≥106Re \ge10^6 multiplies its paired ratio to the reference by 1.1, 1.0 and 1.2, whereas holding out non-box enclosures, crossflow layouts or dual-inlet layouts multiplies it by 2.1, 6.6 and 3.8, pushing the ratio above 1 on both non-box enclosures and crossflow layouts.

SplitHeld out of trainingTrainSeedsSamplesεU\varepsilon_Uεp\varepsilon_p↓ratio↓<FS↑εU\varepsilon_Uεp\varepsilon_pSamplesratio, on full↓ratio, held out↓factor↓
fullnothing (random split)2,01145150.0530.0230.5098%0.1100.059—
bank_blobsblob bodies1,66228720.0590.0240.6199%0.0990.0601470.5380.5791.1
bank_zero_to_cadCAD-part bodies2,25022240.0790.0410.5999%0.1380.083300.6060.6191.0
reynoldsRe≥106Re \ge10^61,57721,0010.0670.0300.7582%0.0760.0461900.5940.7331.2
family_non_boxnon-box enclosures1,85026920.1030.1340.3723%0.0750.0391330.5131.2502.4
profile_crossflowcrossflow layout2,29821730.6142.3410.7297%0.8862.624340.1320.7215.5
profile_dual_inletdual-inlet layout2,04424591.3976.7800.8897%1.5637.150870.0960.8809.2

Table 16. ISLA on full and on six held-out splits. Left: the size of each split’s training part, and ISLA on the split’s canonical test samples (the two geometry-family splits by the body rule) beside the free-stream reference on the same samples. Right: a paired comparison on the test samples of full that are also in the split’s test part, which holds problems of that kind: the median ratio to the reference for ISLA trained on full, which saw such problems in training, and for ISLA trained on the split, which did not, and their quotient. Medians over test samples; the ratio is the median per-sample ratio of εU\varepsilon_U to the reference’s, and <FS the share of samples where it is below 1.

SplitHeld out of trainingTrainSeedsSamplesϵU↓\epsilon_U \downarrowϵp↓\epsilon_p \downarrowratio ↓\downarrow⟨\langleFS⟩↑\rangle\uparrowϵU\epsilon_Uϵp\epsilon_pSamplesratio, on full ↓\downarrowratio, held out ↓\downarrowfactor↓\downarrow
fullnothing (random split)2,01165150.0760.0370.7286%0.1100.059–
bank_blobsblob bodies1,66238720.0860.0420.8477%0.0990.0601470.7250.8061.1
bank_zero_to_cadCAD-part bodies2,25032240.1060.0560.7596%0.1380.083300.7810.7711.0
reynoldsRe ≥106\ge10^{6}1,57731,0010.0780.0390.9558%0.0760.0461900.8150.9381.2
family_non_boxnon-box enclosures1,85036920.2510.4301.9523%0.0750.0391330.7971.6772.1
profile_crossflowcrossflow layout2,29831731.5443.6121.6011%0.8862.624340.2351.5456.6
profile_dual_inletdual-inlet layout2,04434591.4126.7540.9199%1.5637.150870.2410.9083.8

Table 17. GeoTransolver (with boundary tokens, per-case scales, bfloat16) on full (six seeds) and on six held-out splits (three seeds each), in the layout of Table 16. Each row’s statistic is the mean over its seeds.

This stack-up sets AeroZoo’s priorities. A large CFD campaign is usually judged by its modeling choices: the turbulence model, the inflow turbulence and URANS or a scale-resolving method such as LES or DDES. These choices change the targets, and they will limit a surrogate’s accuracy once its error comes down toward the differences they make. Today that point is far off: on a new enclosure or boundary-condition layout, both surrogates’ error comes mostly from failing to generalize, the gap that the held-out splits of AeroZoo measure.

Conclusion

On a single-family benchmark such as DrivAerML, the scaling floor sits only 21% below Transolver’s error, within a factor of 1.8 of the targets’ own averaging noise (Appendix § 15); when AeroZoo poses 3,815 problems varying shape, enclosure and boundary conditions together, surrogates remain far from solver accuracy. Given boundary tokens, GeoTransolver beats uniform flow on 82% of test samples, and without them its median error is 9 times larger. ISLA, the best model, beats uniform flow on 98%, yet its error is about 4 times the mesh-refinement change in distribution and grows 2.4- to 9.2-fold relative to uniform flow on held-out enclosures and layouts. Incompressible, time-mean flow at industrial Reynolds numbers is the least that an aerodynamic foundation model must handle; compressible flow, LES and unsteady flow come next. The same representation poses other steady or time-mean boundary-value problems, from conjugate heat transfer to solid mechanics, without dataset-specific conventions.

Guide to the appendices.

AppendixHoldsSupports
Athe CFD terms used, for readers in machine learningthe whole paper
Bhow a case is posed, meshed and solved; the stability label; what the recipe producedSection 3
Cthe measurements behind the error stack-upSection 6
Dthe role of every key; the conventions; a condensed key treeSection 2
Eevery metric, the reporting rules and an excerpt of the reference implementationSection 4
Fall 22 splits and how they are drawnSection 4
Gwhat each model is given; the two unit scalings; every row, held-out splits, boundary-token ablation and the free-stream referenceSections 5 and 6
Hscaling and the irreducible floor on DrivAerML: claims, bounds, fits and protocolSections 1 and 7
Isources for Table 1; the shape-diversity score and its settingsSections 1 and 3
Jthe datasheet

Table 1 (PDF p. 11).

Terms

The paper is written for readers in machine learning. This appendix defines, in one or two lines each, the terms from fluid dynamics and CFD that the main text uses, in the sense in which it uses them.

Flow and equations.

Navier–Stokes equations The conservation of mass and momentum in a viscous fluid: the partial differential equations that every flow here obeys.

Incompressible flow Flow of constant density: liquids, and gases well below the speed of sound. Its equations need one fluid property, the kinematic viscosity ν\nu (m2/s\mathrm{m}^2/\mathrm{s}), the dynamic viscosity divided by the density.

Laminar and turbulent flow Laminar flow is smooth and orderly. Turbulent flow is full of chaotic eddies over a wide range of sizes, which mix momentum far faster than viscosity alone.

Reynolds number Re=UL/νRe = UL/\nu for a chosen speed UU and length LL: the ratio of inertial to viscous effects. Geometrically similar problems at the same ReRe have the same dimensionless solution (dynamic similarity).

RANS Reynolds-averaged Navier–Stokes equations: equations for the mean flow, in which a turbulence model supplies the effect of the turbulent fluctuations.

URANS Unsteady RANS: the same equations integrated in time, which resolves large, slow unsteadiness such as vortex shedding. An AeroZoo target is the time mean of a URANS solution over a finite window.

Hybrid RANS–LES Methods that use RANS near walls and re-solve the large eddies away from them.

DES and DDES Detached-eddy simulation and its delayed form, the most common hybrid RANS–LES methods; the delayed form keeps attached boundary layers in RANS.

LES and wall-modeled LES Large-eddy simulation resolves the large eddies everywhere and models the small ones; a wall-modeled LES also models the thin layer next to the wall.

DNS Direct numerical simulation: every eddy is resolved and no turbulence is modeled.

Turbulence model Here the kk–ω\omega SST model. It transports the turbulent kinetic energy kk (m2/s2\mathrm{m}^2/\mathrm{s}^2) and the specific dissipation rate ω\omega (1/s1/\mathrm{s}), and from them computes the eddy viscosity νt\nu_t (m2/s\mathrm{m}^2/\mathrm{s}), the extra viscosity that represents turbulent mixing.

Inflow turbulence The turbulence that the inlet prescribes, set by an intensity II, the size of the velocity fluctuations relative to the mean speed, and a length scale ℓ\ell, the size of the largest eddies.

Transition model Here the Langtry–Menter model: two further equations that let a boundary layer start laminar and become turbulent. The intermittency γ\gamma runs from 0 (laminar) to 1 (turbulent); ReθtRe_{\theta t} is a transported correlation variable that sets where transition begins.

Boundary layer The thin layer next to a wall in which the velocity rises from zero to that of the outer flow, laminar or turbulent. Its momentum thickness measures the momentum it has lost. Where it leaves the wall, the flow separates, and behind the body it forms a wake of slowed, often unsteady flow.

Free stream The flow far from any body; here, the state the inlet prescribes.

Pressures The dynamic pressure is q=ρU2/2q = \rho U^2/2. Gauge pressure is measured from a reference, here zero at the outlet. Kinematic pressure, which OpenFOAM solves for, is pressure divided by density. With an eddy-viscosity model, the momentum equation carries only the deviatoric part of the turbulent stress, so the solved pressure includes its isotropic part, 23ρk\frac{2}{3}\rho k; the stored pressure is the solver’s.

Wall shear stress τ\tau (Pa): the tangential shear force per unit area between fluid and wall, stored with OpenFOAM’s sign as the traction of the wall on the fluid. The skin-friction coefficient is ∥τ∥/q\lVert\tau\rVert/q.

Force coefficient A force divided by qq and an area. AeroZoo uses Lref2L_{\mathrm{ref}}^2 as the area, so its coefficients are not the drag coefficients of the literature, which use a frontal or planform area.

Total-pressure loss coefficient KK: the drop in mass-flux-weighted total pressure, p+ρ∥u∥2/2p+\rho\lVert\mathbf{u}\rVert^2/2, from inlet to outlet, divided by qq; the usual measure of a duct (Appendix E).

Boundary conditions.

Dirichlet condition The value of a field is prescribed on the boundary, such as the velocity on an inlet.

Zero gradient The field’s normal derivative is zero, so the boundary takes the value of the cell next to it (a homogeneous Neumann condition).

Inlet and outlet Where flow enters, with prescribed velocity and turbulence, and where it leaves, at prescribed pressure.

No-slip and slip walls A no-slip wall holds the fluid at rest. A slip wall allows no flow through it and exerts no shear, so it also models a plane of symmetry.

Mesh and numerics.

Finite-volume method The domain is divided into cells; the solver balances mass and momentum over each cell and stores one value per cell, at its centroid.

Hex-dominant mesh snappyHexMesh refines a background grid of hexahedra near the surfaces, snaps it onto them and grows prism layers on walls. Cells cut by a surface become general polyhedra.

y+y^{+} and the near-wall layers y+y^{+} is the distance from a wall to the first cell center in viscous units, yuτ/νy u_{\tau}/\nu, with friction velocity uτ=(∥τ∥/ρ)1/2u_{\tau} = \left(\lVert\boldsymbol{\tau} \rVert/\rho\right)^{1/2}. By y+y^{+}, a turbulent boundary layer has three parts: the viscous sublayer below about 5, the buffer layer from about 5 to 30 and the logarithmic layer from about 30 to a few hundred. The stored wall_y_plus is the wall functions’ own value, computed from the turbulent kinetic energy of the first cell.

Wall functions Algebraic laws that supply the wall shear and the near-wall turbulence when the first cell lies in the logarithmic layer, so that the sublayer need not be resolved.

Convective time Tc=Lref/UrefT_c = L_{\mathrm{ref}}/U_{\mathrm{ref}}, the time the free stream takes to pass the body.

Courant number U Δt/ΔxU\,\Delta t/\Delta x: how many cells the flow crosses in one time step.

Modeling and discretization error Modeling error is the distance of the exact solution of the stated equations from the real flow. Discretization error is the distance of a numerical solution from that exact solution.

Grid-convergence study The same case solved on successively finer meshes, to estimate the error of the discretization. When three meshes converge monotonically, Richardson extrapolation estimates the value on an infinitely fine mesh, and the observed order is the rate at which the error shrinks with cell size.

Enclosures.

Boxes An open box has an inlet face opposite its outlet and slip side faces. A ground-effect box makes one side face a no-slip ground; a confined box makes all four no-slip; a crossflow box puts the outlet on a face beside the inlet; a dual-inlet box adds a second inlet beside the first (Table 4).

Sphere and hemisphere An opposed sphere has inlet and outlet caps on opposite sides. A symmetry hemisphere is half a sphere closed by a symmetry (slip) plane.

Internal duct A passage of one of 10 shapes with an inlet and an outlet end and no-slip walls, with a body in half of them.

Other.

Case and sample A case is a planned flow problem. A sample is a case that was solved and released.

Well-posed For a mathematical problem, after Hadamard: a solution exists, is unique and depends continuously on the data. For a learning task (§ 2): the inputs determine the target.

Vendi score The exponential of the entropy of the eigenvalues of a normalized similarity matrix ([11]): the effective number of distinct items in a collection.

The generation recipe

This appendix gives the parameters behind § 3: how a case is posed, meshed, solved and labeled, and what the recipe produced. Every number is a constant of the frozen recipe that produced every released sample (mesh policy v14, solver policy v10, artifact schema 5).

Posing a case

From a 64-bit seed, the generator derives named, independent random streams for the geometry, the pose, the enclosure, the body-wall layout, the boundary values and viscosity, the inflow turbulence and the mesh. The posed problem, including every stream key, is written to a manifest before meshing. Table 4 lists the enclosures, Figure 9 shows the duct shapes and Table 5 lists what is drawn for each case.

Figure 9. One body-free internal-duct sample of each of the 10 duct shapes, cut along the passage. Each panel is cropped to its own passage and drawn to its own scale; its title gives the shape and the Reynolds number, built on the inlet’s hydraulic diameter. All 10 samples are mean_stable.

The inlet prescribes a uniform velocity (Table 6). From LL, ℓ\ell and the inlet speed, the generator sets the inlet’s turbulent kinetic energy, specific dissipation rate and transition-onset Reynolds number (by the Langtry–Menter correlation), with intermittency γ=1\gamma= 1. The resulting eddy viscosity at the inlet is νt=0.67 ℓ Uref\nu_t = 0.67\,\ell\,U_{\mathrm{ref}}, so νt/ν=0.67 Γ (ℓ/Lref) Re\nu_t/\nu= 0.67\,\Gamma\,(\ell/L_{\mathrm{ref}})\,Re. The solver caps this ratio at 10510^{5} (Figure 11).

BoundaryVelocityPressureTurbulence fields
inletprescribed (Dirichlet)zero gradientprescribed
outletzero gradient; prescribed where flow re-enterszero (Dirichlet)as velocity
no_slipzerozero gradientwall functions (kk, ω\omega, νt\nu_t); zero gradient (γ\gamma, ReθtRe_{\theta t})
slipno penetration, free tangential slipzero gradientzero gradient

Table 6. What each boundary type imposes.

Figure 11. The eddy viscosity of each released sample against its Reynolds number: the median of νt\nu_t over the sample’s volume, (a) over the molecular viscosity ν\nu and (b) over UrefLrefU_{\rm ref}L_{\rm ref}, with the median of each Reynolds decade. The dashed lines in (a) mark νt=ν\nu_t=\nu and the solver’s cap of 10510^5, which is the sloping edge at the right of (b). The inlet’s eddy viscosity is about 0.67ℓUref0.67\ell U_{\rm ref} whatever ν\nu is, so (b) is level and (a) rises in proportion to the Reynolds number.

Meshing

Every surface must be closed, consistently oriented, manifold and free of self-intersection. snappyHexMesh builds each mesh from a uniform, near-isotropic background grid sized to a budget of two to three million cells (about 5.0 million cells at the median after refinement). It refines the mesh by two levels at the body’s surface and by one level in a wedge that follows the wake to the outlet. The wedge starts 0.25 Lref0.25\,L_{\mathrm{ref}} upstream of the body and widens by half the body’s transverse extent. Wall layers cover the no-slip walls and the whole body, slip bands included, and are sized before the flow is known:

  • the first cell’s center is placed at y+=30y^{+} = 30 for a friction velocity that is 2 times the larger of the Blasius and Prandtl–-Kármán estimates.

Schlichting flat-plate estimates at the case’s Reynolds number. Because the friction velocity is doubled, the target on a flat plate is y+=15y^+ = 15;

  • the first layer is at most 0.005 LrefL_{\mathrm{ref}} thick and at least 1/800 of the surface cell;

  • each further layer is 1.5 times thicker, until a layer reaches half a surface cell, which gives 3 to 16 layers.

Above Re=105Re = 10^{5}, the median over the samples with a body of each body’s median y+y^{+} is 18 (quartiles 15 to 25). In 77% of those samples it lies between 5 and 30, in the buffer layer (Appendix § 8).

A mesh is admitted only if one connected fluid region holds at least 99.9% of the cells, every boundary region that the manifest poses is present, and the mesh is within fixed quality limits. The mesher works to limits of 80∘80^\circ on non-orthogonality and concavity. Admission requires concavity below 90∘90^\circ, skewness below 20 on boundaries and 10 inside, and a cell determinant above 10−610^{-6}.

Solving and averaging

Table 7 gives the numerical policy, which is the same for every case.

ComponentFixed choice
Time integrationsecond-order backward, adaptive step
Courant limit10; initial step 0.002 TcT_c, at most 0.005 TcT_c
Pressure–velocity couplingPIMPLE: one outer, two pressure, one non-orthogonal corrector
Momentum convectionbounded limitedLinearV 1 (limited second order)
Turbulence convectionbounded upwind (first order)
Gradients, interpolationlinear; Laplacian limited corrected 0.33
ClosurekOmegaSSTLM, wall functions on no-slip walls
Schedulewarm-up 0–15 TcT_c, mean over 15–95 TcT_c

Table 7. The fixed numerical policy (OpenFOAM 14).

The stability label

The stability label compares the means (⋅)‾1\overline{(\cdot)}_1 and (⋅)‾2\overline{(\cdot)}_2 over the two halves of the averaging window (Table 7). A sample is mean_stable if

∥u‾2−u‾1∥VUref≤0.02,∥p‾2−p‾1∥Vqref≤0.05,∣C‾F,2−C‾F,1∣max⁡(∣C‾F∣,0.05)≤0.02,\frac{\lVert\overline{\mathbf{u}}_2-\overline{\mathbf{u}}_1\rVert_V}{U_{\mathrm{ref}}} \le0.02,\qquad \frac{\lVert\overline{p}_2-\overline{p}_1\rVert_V}{q_{\mathrm{ref}}} \le0.05,\qquad \frac{\left|\overline{C}_{F,2}-\overline{C}_{F,1}\right|}{\max\left(\left|\overline{C}_F\right|,0.05\right)} \le0.02,

with ∥⋅∥V\lVert\cdot\rVert_V the volume-weighted root mean square, and every field is finite; otherwise it is mean_unstable. In a body-free duct, the force is that on the duct’s no-slip walls. If a duct’s first window is mean_unstable, the solver continues the same flow and averages a second window of 80 TcT_c. That window starts at 95 TcT_c or after two turnover times (the duct’s volume over its inlet’s volume flow), whichever is later. Only ducts get this second window. Of the unstable samples, 83% fail the velocity test, 58% the force test and 8% the pressure test.

What the recipe produced

Table 8 and Figure 7 to Figure 9 break down the released samples by geometry family and enclosure configuration, show the distributions of the drawn scales and of the stability label, and display one solved duct of each shape; Figure 4 shows example bodies from each geometry family. Figure 10 shows the flow regimes of § 3, and Figure 11 the eddy viscosity that the inflow turbulence gives each sample.

Geometry familyOpen boxGround-effect boxConfined boxCrossflow boxDual-inlet boxOpposed sphereSymmetry hemisphereInternal ductTotal
Blobs2292031332061841431531161,367
Blender bluff7870556751493831439
Procedural cars7957476258344336416
Zero-to-CAD5864325339392325333
Airframe Foundry5656555146404122367
Streamlined6556525667474546434
Blender streamlined7072608371284827459
Total6355784345785163803913033,815

Table 8. Released samples by geometry family and enclosure configuration. The planned counts in each row follow the configuration weights; the shortfalls are failed and timed-out cases. By count the shortfall is largest in the confined box, which has the most cells (183 of 617 planned cases, 29.7%, 167 of them timed out), and by share in the internal duct (135 of 438, 30.8%, 121 of them failed). The internal-duct column includes the 161 body-free ducts, each counted under the family of the body drawn for it.

Figure 7. The three drawn scales and the derived viscosity over the released samples (logarithmic bins). Within each Reynolds decade the draws are log-uniform; the dip in the top decade comes from the timed-out cases. Dashed lines mark the viscosities of water and air at room temperature; 23% of samples lie between them.

Why the viscosity varies. Each case draws its own viscosity, for two reasons. First, a real fluid’s viscosity is not one number: by Sutherland’s law at sea-level pressure, the kinematic viscosity of air rises by 6% from 15 to 25 °C and by 24% from 0 to 35 °C, and that of water is an order of magnitude lower. Second, an incompressible flow depends on its length, speed and viscosity only through the Reynolds number UL/νUL/\nu, the similarity of § 2. Two samples with the same geometry in units of LL, the same boundary conditions in units of UU and the same Reynolds number have the same flow in those units, whatever their SI values. Drawing the three scales independently spreads the samples of each Reynolds number over many combinations of SI values (Table 5 and Figure 7), so a model is rewarded for learning the similarity, a basic acceptance test of a flow solver, and cannot reach a low error by memorizing the viscosity of one fluid.

The inflow’s eddy viscosity. The inlet’s eddy viscosity does not depend on ν\nu, and in the typical sample it persists through the volume. Over the samples, the median ratio of the volume median of νt\nu_t to the inlet’s value is 0.96.

  • In units of UrefLrefU_{\mathrm{ref}}L_{\mathrm{ref}}, the median over the release of the volume median is 0.0008 (5th to 95th percentile 0.00006 to 0.011), and the inlet’s value a median of 0.0016.

  • Over ν\nu, the volume median therefore rises in proportion to the Reynolds number. Its median is 2 in the lowest Reynolds decade and 28,000 in the highest. It exceeds 100 in 56% of samples, and in 28% of the top decade’s samples it is within a tenth of the solver’s cap.

  • At the walls, friction still depends on ν\nu: the body’s mean skin friction falls 18-fold from the lowest to the highest Reynolds decade. Its median is 2.3 to 2.5 times the laminar flat-plate law in the two lowest decades and 1.1 to 1.4 times the turbulent law in the three highest (Figure 10b).

Solution verification

This appendix gives the measurements behind the second link of the error stack-up (§ 6 and Figure 6): how close the released solutions are to the exact solutions of their equations. Its main part is a grid study of reruns, finer meshes and wall-resolved first cells. Under mesh refinement the force changes by a median of 7.0% (3.7% in the benchmark’s metric, whose denominator is at least 0.05) and the velocity by 1.2% of UrefU_{\rm ref}.

Design. A grid study re-solved nine cases with the frozen recipe: one released mean_stable sample from each of seven strata of the release (Streamlined, Blender streamlined and Airframe Foundry bodies at transitional Reynolds numbers, a bluff body, a car in ground effect, a duct with a body and a body in an opposed sphere), and as controls a flat plate at Re=106Re=10^6 with 1% inflow turbulence and a sphere at Re=105Re=10^5 with 0.5%. The released cases were drawn by a fixed hash, before any result was seen, from the samples whose production solve took at most 400 core-hours and whose first wall layer was set by the y+y^+ target, not by the 0.005Lref0.005L_{\rm ref} cap. Each case was solved four more times, changing only the mesh:

  • R the production mesh, solved again on the study’s cluster;

  • C, G meshes 1.5 times coarser and 1.5 times finer in each direction, with the production wall rule;

  • W the production mesh with its first cell at y+≈1y^+\approx1.

The posing, the solver policy and the averaging window are the production ones. The finer of two solutions is the truth, the coarser one the prediction, and the errors are the benchmark’s own (Equations (1) and (2)), on the truth’s cells. The study used 30.1 k CPU core-hours.

Findings. Table 9 gives the results by case.

Table 9. Grid study by case: the Reynolds number; cells of the production (R), finer (G) and wall-resolved (W) meshes; the change from the production mesh to the finer one in force and velocity; where the coarser, production and finer meshes converge monotonically, the observed order of CFC_F and the production mesh’s force error relative to the Richardson extrapolation; the change from the production mesh to the wall-resolved one in force; and the laminar share of the body’s boundary layer on those two meshes. Changes, errors and shares in percent; “–”: not defined or not run. A released body with no enclosure named is in an open box.

CaseReRecells R/G/W (M)εCF\varepsilon_{C_F}εU\varepsilon_UorderextrapolatedεCF\varepsilon_{C_F}productionwall-resolved
streamlined body4.1×1054.1 \times10^53.2/10.8/3.40.70.20.92.30.500
car in ground effect7.2×1057.2 \times10^52.8/8.7/3.30.51.6––2.700
Airframe Foundry body1.9×1051.9 \times10^55.9/–/6.0––––3.507
Blender bluff body1.4×1061.4 \times10^64.4/14.8/4.55.31.62.29.20.600
body in an opposed sphere2.6×1052.6 \times10^53.8/9.6/3.82.00.7––8.600
duct with a body2.6×1052.6 \times10^51.3/3.0/1.86.84.01.022.912.000
Blender streamlined body2.6×1052.6 \times10^53.0/10.0/3.18.01.11.914.736.13011
plate (control)1.0×1061.0 \times10^63.0/9.6/3.20.90.32.71.46.900
sphere (control)1.0×1051.0 \times10^53.7/12.4/3.919.11.3––20.57267

Table 9.

  • Reruns. On another cluster, with another rank count and decomposition, the force moves by at most 0.04% in the steady cases.

  • Mesh. Refining the mesh moves the force by a median of 3.7% in the benchmark’s metric over eight cases (7.0% of the force itself; three of the nine cases have ∣CF∣<0.05|C_F|<0.05, where the metric divides by 0.05), almost all of it in the pressure part (the friction part moves by at most 0.2%), and the velocity by a median of 1.2% of UrefU_{\rm ref} (0.2 to 4.0%). These medians include the two controls; over the six released cases alone they are 3.7% and 1.4%. Where C, R and G converge monotonically (five cases), the production force is 1.4–23% from the extrapolated value, with a median of 9.2%. The sphere’s 19% comes with a change of state: its production label is mean_unstable and its finer mesh is steady.

  • Wall cell. A first cell at y+≈1y^+\approx1 moves the force by a median of 6.9% in the metric and 8.6% of the force itself (3.5% and 4.6% over the released cases alone), the velocity by a median of 0.7% of UrefU_{\rm ref}, and shifts transition: the

flat plate’s force rises 1.8 times and its friction part 2.25 times, and the Blender streamlined body loses most of its laminar boundary layer. The Blender streamlined body’s force moves by 36%, with or without the metric’s floor; the flat plate’s force moves by 44% of itself (6.9% in the metric). A wall-resolved mesh costs 3.2 times the solver time of the production mesh at the median.

Additional solver checks. Four further checks vary inflow eddy viscosity, convection order, Courant limit and job restarts.

  • Inflow eddy viscosity. On three released mean_stable samples at Re≥106Re \ge10^6 (Streamlined, Blender bluff and Blobs), raising inlet ω\omega at fixed kk on the identical mesh so that inlet νt/ν=1\nu_t/\nu= 1 changes near-body velocity by 0.05 to 1.0% of UrefU_{\mathrm{ref}} (εU\varepsilon_U) and force CFC_F by 1.2 to 2.0% on the two lower-intensity cases, and by 6.0% and 27% on the high-intensity Blobs case; lowering inlet kk at fixed length scale on the Streamlined case leaves 79% of the body laminar and changes CFC_F by 19%.

  • Scheme. On three meshes, four cases with a body were solved to a steady state, once with first-order upwind convection of momentum and once with the recipe’s limited second-order scheme. The root-mean-square difference in velocity between the two schemes on the finest mesh (up to 4.6 million cells), over probe points in the wake, is 1.8 to 8.9% of UrefU_{\mathrm{ref}}.

  • Time step. One case was solved twice on one mesh, with Courant limits of 5 and 10. The root-mean-square difference between the two mean velocity fields is 0.46% of UrefU_{\mathrm{ref}}; the force coefficient differs by 0.0011.

  • Restarts. One case was solved twice on one mesh, once without interruption and once stopped and restarted two times. The root-mean-square difference between the two mean velocity fields is 0.009% of UrefU_{\mathrm{ref}}.

The sample schema

Every key of a sample has one role (Figure 3b), and only the input keys may enter a model (the input rule of § 2): Table 10 gives each role, followed by the conventions and the key tree of one released sample.

RoleKeys
Inputboundaries/*/points and cells; boundaries/*/cell_data/prescribed/*; global_data/physics/kinematic_viscosity and density
Queryinterior/points; the centroids of boundaries/*/cells
Targetinterior/point_data/solution/*; boundaries/*/cell_data/solution/*; no_slip/cell_data/derived/wall_shear_stress
Weightinterior/point_data/_target_quadrature_measure (cell volumes); face areas, computed from the triangles
Factcell_data/annotation/body_id; no_slip/cell_data/derived/wall_y_plus; global_data/schema_version, identity/*, solution_definition/* and diagnostics/*; global_data/physics/closure_model_id and body_acceleration (zero)
Scaleglobal_data/reference/*

Table 10. The role of each key of a sample, in the order of Figure 3b. * stands for every key under a group.

Conventions.

  • Rows. Interior arrays have one row per cell; boundary cell_data arrays have one row per triangle. Every sample has the same keys, and a boundary with no faces keeps its keys with zero rows.

  • Units. SI throughout: lengths in m, velocities in m/s, pressure in Pa (gauge, zero at the outlet), kk in m2^{2}/s2^{2}, ω\omega in 1/s, νt\nu_t in m2^{2}/s; γ\gamma and ReθtRe_{\theta t} are dimensionless. Field tensors are float32.

  • Signs. Triangle normals point out of the fluid. Wall shear stress is the traction of the wall on the fluid (OpenFOAM’s sign), so the friction force on a body is −∑jτjAj-\sum_j \tau_j A_j.

  • Seams. Points repeat along former patch seams, because patches are merged without joining coincident vertices.

  • Symmetry planes. In the 391 symmetry hemispheres, the mesher leaves the symmetry plane as background-grid steps within 2.5% of LrefL_{\mathrm{ref}} of the fitted plane.

The key tree. The listing below is the key tree of one released sample, read from the artifact itself; array sizes are that sample’s. The sample is case-0000000000000003016-edcd559b0f11.

DomainMesh
|-- interior (Mesh)
|   |-- points                                      [4550479, 3] float32
|   |-- cells                                       [0, 1] int64
|   `-- point_data
|       |-- solution
|       |   |-- velocity                             [4550479, 3] float32
|       |   |-- gauge_pressure                       [4550479] float32
|       |   |-- turbulent_kinetic_energy             [4550479] float32
|       |   |-- specific_dissipation_rate            [4550479] float32
|       |   |-- turbulent_kinematic_viscosity        [4550479] float32
|       |   |-- intermittency                        [4550479] float32
|       |   `-- momentum_thickness_reynolds_number   [4550479] float32
|       `-- _target_quadrature_measure               [4550479] float32
|-- boundaries
|   |-- inlet (Mesh)
|   |   |-- points                                   [12800, 3] float32
|   |   |-- cells                                    [25122, 3] int64
|   |   `-- cell_data
|   |       |-- solution/*                           [25122, ...] float32 (seven fields, as interior)
|   |       `-- prescribed
|   |           `-- dirichlet
|   |               |-- velocity                     [25122, 3] float32
|   |               |-- turbulent_kinetic_energy    [25122] float32
|   |               |-- specific_dissipation_rate   [25122] float32
|   |               |-- intermittency                [25122] float32
|   |               `-- momentum_thickness_reynolds_number [25122] float32
|   |-- outlet (Mesh)
|   |   |-- points                                   [17289, 3] float32
|   |   |-- cells                                    [34080, 3] int64
|   |   `-- cell_data
|   |       |-- solution/*                           [34080, ...] float32 (seven fields, as interior)
|   |       `-- prescribed
|   |           |-- dirichlet
|   |           |   `-- gauge_pressure               [34080] float32
|   |           `-- reverse_flow/*                   [34080, ...] float32 (five inlet fields)
|   |-- no_slip (Mesh)
|   |   |-- points                                   [55553, 3] float32
|   |   |-- cells                                    [110356, 3] int64
|   |   `-- cell_data
|   |       |-- solution/*                           [110356, ...] float32 (seven fields, as interior)
|   |       |-- prescribed
|   |       |   `-- dirichlet
|   |       |       `-- velocity                     [110356, 3] float32
|   |       |-- annotation
|   |       |   `-- body_id                          [110356] int64
|   |       `-- derived
|   |           |-- wall_shear_stress                [110356, 3] float32
|   |           `-- wall_y_plus                      [110356] float32
|   `-- slip (Mesh)
|       |-- points                                   [68480, 3] float32
|       |-- cells                                    [135042, 3] int64
|       `-- cell_data
|           |-- solution/*                           [135042, ...] float32 (seven fields, as interior)
|           `-- annotation
|               `-- body_id                          [135042] int64
`-- global_data
    |-- schema_version                               () int64
    |-- identity/*                                  (provenance & run diagnostics)
    |-- physics
    |   |-- density                                   () float32
    |   |-- kinematic_viscosity                       () float32
    |   |-- body_acceleration                         [3] float32
    |   `-- closure_model_id                          () int64
    |-- reference
    |   |-- velocity                                  [3] float32
    |   |-- secondary_inlet_velocities                [0, 3] float32
    |   |-- force_projection_direction                [3] float32
    |   |-- speed                                     () float32
    |   |-- length                                    () float32
    |   `-- dynamic_pressure                          () float32
    |-- solution_definition/*                       (provenance & run diagnostics)
    `-- diagnostics/*                               (provenance & run diagnostics)

Three more kinds of file come with the samples. index.json has one record per sample (identity, hashes, stability label and quality facts), so subsets can be chosen without opening an artifact. The release manifest gives every planned case its status and every split its effective sizes. Each sample folder holds its posed problem (case-manifest.json), its execution history and its validation receipt.

Metrics in full

Every metric is a volume- or area-weighted error in the sample’s own reference units, so every sample counts on the same scale (Table 11); this appendix also states how a result is reported and excerpts the reference implementation.

MetricTaskError ofOverWeightIn units ofDefined on
εU\varepsilon_U, εp\varepsilon_pinteriorvelocity, pressureevery interior pointcell volumeUrefU_{\mathrm{ref}}, qrefq_{\mathrm{ref}}every sample
εk\varepsilon_k, εω\varepsilon_\omega, ενt\varepsilon_{\nu_t}interior (auxiliary)kk, ω\omega, νt\nu_tevery interior pointcell volumeUref2U_{\mathrm{ref}}^2, Uref/LrefU_{\mathrm{ref}}/L_{\mathrm{ref}}, UrefLrefU_{\mathrm{ref}}L_{\mathrm{ref}}every sample
εγ\varepsilon_\gamma, εReθt\varepsilon_{Re_{\theta t}}interior (auxiliary)γ\gamma, ReθtRe_{\theta t}every interior pointcell volumethe true field’s root mean squareevery sample
εUN\varepsilon_U^N, εpN\varepsilon_p^Ninteriorvelocity, pressurepoints within LrefL_{\mathrm{ref}} of a body face centroidcell volumeUrefU_{\mathrm{ref}}, qrefq_{\mathrm{ref}}samples with a body
rUr_U, rpr_pinteriorvelocity, pressureevery interior pointnonethe true field’s normevery sample
εCF\varepsilon_{C_F}, εC\varepsilon_Cboundaryforce along eF\mathbf{e}_F; force vectorthe body’s facesface areamax⁡(∣CF∣,0.05)\max(\lvert C_F\rvert, 0.05); max⁡(∥C∥,0.05)\max(\lVert C\rVert, 0.05)samples with a body
εCp\varepsilon_{C_p}boundarysurface pressurethe body’s facesface areaqrefq_{\mathrm{ref}}samples with a body
ετ\varepsilon_\tauboundarywall shear stressthe body’s no-slip facesface areaqrefq_{\mathrm{ref}}samples with a body
εK\varepsilon_Kboundarytotal-pressure lossinlet and outlet facesmass fluxmax⁡(K,0.05)\max(K, 0.05)ducts

Table 11. Every metric: the quantity whose error it measures, the points or faces it covers, its weight, its unit and the test samples on which it is defined.

Every metric is computed per test sample in that sample’s reference units and then summarized over the test set. Inlet speeds span a factor of about 200 across the release and dynamic pressures a factor of about 40,000, so errors in SI units averaged over a test set would measure only the fastest samples. In units of UrefU_{\mathrm{ref}} and qrefq_{\mathrm{ref}}, every sample counts on the same scale, which is also the scale of the stability label and of § 6. Errors are weighted by cell volume or face area, so they approximate integrals over the fluid or the body’s surface rather than sums over a mesh that is finest where the mesher chose.

Interior task. εU\varepsilon_U and εp\varepsilon_p are given by Equation (1). In a large enclosure most of the fluid is free stream, which dilutes the errors that matter near the body, so εUN\varepsilon_U^N and εpN\varepsilon_p^N restrict the sums of Equation (1) to the near field,

N={i:min⁡j∈B∥xi−cj∥≤Lref},\mathcal{N} = \left\{ i : \min_{j \in\mathcal{B}} \lVert\mathbf{x}_i - \mathbf{c}_j \rVert\le L_{\mathrm{ref}} \right\},

with cj\mathbf{c}_j the centroids of the body’s faces B\mathcal{B} (defined below). The relative L2L^2 errors common in machine learning count every point equally: rU=∥u^−u∥2/∥u∥2r_U = \lVert\hat{\mathbf{u}}-\mathbf{u}\rVert_2/\lVert\mathbf{u}\rVert_2, and rpr_p likewise for the pressure.

Auxiliary targets. The five turbulence fields of the interior task each have an error. With ∥f∥V=(∑iVifi2/∑iVi)1/2\lVert f\rVert_V = \left(\sum_i V_i f_i^2/\sum_i V_i\right)^{1/2} the volume-weighted root mean square over the interior points,

εk=∥k^−k∥VUref2,εω=∥ω^−ω∥VUref/Lref,ενt=∥ν^t−νt∥VUrefLref,\varepsilon_k = \frac{\lVert\hat{k}-k\rVert_V}{U_{\mathrm{ref}}^2}, \qquad\varepsilon_\omega= \frac{\lVert\hat{\omega}-\omega\rVert_V}{U_{\mathrm{ref}}/L_{\mathrm{ref}}}, \qquad\varepsilon_{\nu_t} = \frac{\lVert\hat{\nu}_t-\nu_t\rVert_V}{U_{\mathrm{ref}}L_{\mathrm{ref}}},
εγ=∥γ^−γ∥V∥γ∥V,εReθt=∥Reθt^−Reθt∥V∥Reθt∥V.\varepsilon_\gamma= \frac{\lVert\hat{\gamma}-\gamma\rVert_V}{\lVert\gamma\rVert_V}, \qquad\varepsilon_{Re_{\theta t}} = \frac{\lVert\widehat{Re_{\theta t}}-Re_{\theta t}\rVert_V}{\lVert Re_{\theta t}\rVert_V}.

These errors are not on the scale of εU\varepsilon_U. A prediction of zero scores 1 on γ\gamma and ReθtRe_{\theta t} only, and the eddy viscosity of a typical sample is about 0.001 in its unit (Figure 11), so each auxiliary error is compared with the free-stream reference’s on the same sample and not with 1.

Boundary task. B\mathcal{B} is the set of body faces of no_slip and slip (annotation/body_id ≥1\ge1, both bodies when a case has two) and W\mathcal{W} its no-slip subset. The force errors are Equation (2); the surface errors are

εCp=1qref(∑j∈BAj(p^j−pj)2∑j∈BAj)1/2,ετ=1qref(∑j∈WAj∥τ^j−τj∥2∑j∈WAj)1/2.\varepsilon_{C_p} = \frac{1}{q_{\mathrm{ref}}}\left(\frac{\sum_{j\in\mathcal{B}} A_j(\hat{p}_j-p_j)^2}{\sum_{j\in\mathcal{B}} A_j}\right)^{1/2}, \qquad\varepsilon_{\tau} = \frac{1}{q_{\mathrm{ref}}}\left(\frac{\sum_{j\in\mathcal{W}} A_j\lVert\hat{\boldsymbol{\tau}}_j-\boldsymbol{\tau}_j\rVert^2}{\sum_{j\in\mathcal{W}} A_j}\right)^{1/2}.

A duct is scored by its total-pressure loss coefficient KK, which is positive in every released duct. Its static pressure drop is not: it is negative in some ducts, where the flow slows enough to recover more pressure than it loses. The coefficient is

K=⟨p0⟩inlet−⟨p0⟩outletqref,⟨p0⟩=∑j(pj+ρ∥uj∥2/2)m˙j∑jm˙j,m˙j=ρAjuj⋅nj,K = \frac{\langle p_0\rangle_{\mathrm{inlet}}-\langle p_0\rangle_{\mathrm{outlet}}}{q_{\mathrm{ref}}}, \qquad\langle p_0\rangle= \frac{\sum_j\left(p_j+\rho\lVert\boldsymbol{u}_j\rVert^2/2\right)\dot{m}_j}{\sum_j\dot{m}_j}, \qquad\dot{m}_j = \rho A_j\boldsymbol{u}_j\cdot\boldsymbol{n}_j,

with εK=∣K^−K∣/max⁡(K,0.05)\varepsilon_K = |\hat{K}-K|/\max(K,0.05). On the inlet the velocity is the prescribed one and the pressure is predicted, and on the outlet the reverse holds. The predicted outlet mass flux is the denominator of ⟨p^0⟩outlet\langle\hat{p}_0\rangle_{\mathrm{outlet}}, so a prediction of zero velocity on the outlet gives no finite K^\hat{K}, and a non-finite εK\varepsilon_K counts as 1.

The boundary task’s metrics use only the pressure and the wall shear on the body and, in a duct, the inlet’s pressure and the outlet’s velocity. The 0.05 in the denominators of the force errors matches the stability test (Appendix § 9.§ 4), and ∣CF∣<0.05|C_F| < 0.05 in 21% of samples with a body.

Reporting. A result names the task, the split, the release and the hash of its catalog (v1.2: c8e9508e8a9d8291...), the effective sizes, any filtering and any input outside the input rule of § 2. It reports:

  • each metric’s mean and median over the canonical (mean_stable) test samples on which it is defined: field errors on every sample, near-field and body metrics on samples with a body, and εK\varepsilon_K on ducts;

  • for εCF\varepsilon_{C_F} and εC\varepsilon_C, the shares within 0.02 (the stability test’s force tolerance) and 0.05;

  • for the interior task, the comparison with the free-stream reference, sample by sample: the median of εU/εUfs\varepsilon_U/\varepsilon_U^{\mathrm{fs}}, the share of samples with εU<εUfs\varepsilon_U < \varepsilon_U^{\mathrm{fs}}, and the median εU\varepsilon_U within each of the eight enclosure configurations;

  • the five auxiliary errors if the model predicts the turbulence fields; a model may predict velocity and pressure alone, and its result says so;

  • its number of seeds, and how any random input, such as a sample of boundary faces, was averaged;

  • whether its settings were chosen on the validation part of its own split or reused from full (Appendix § 13);

  • optionally, the same scores over all released test samples.

Three details matter when scores are compared.

  1. A boundary score must leave out fields that a Dirichlet condition fixes on that boundary (the velocity and turbulence quantities on inlet, the velocity on no_slip, the pressure on outlet), because there the stored mean equals the input. Nor may it score the velocity on the symmetry hemisphere’s plane: the stored velocity there is the adjacent cell’s value, and the plane itself is stepped (Appendix § 11).

  1. The relative L2L^2 errors rUr_U and rpr_p weight every interior point equally, as most machine-learning papers do, so they weight the finely meshed boundary layers more than εU\varepsilon_U and εp\varepsilon_p do. Also, rpr_p divides by a gauge pressure whose zero is at the outlet.

  1. Rank correlations of CFC_F are not recommended. Across different bodies, ∣CF∣|C_F| spans a factor of about 100, so a ranking measures the spread of the bodies more than the model.

Reference implementation. The excerpt below computes per-case scales from the posed problem alone (derive_globals) and the free-stream reference (free_stream). Its length is the boundary length LbL_b, the root-mean-square distance between two points of the boundary surface, which does not change when a case is rotated. `free_stream caps the inflow’s eddy viscosity at 105ν10^5 \nu, as the solver does, and the duct-loss error counts as 1 when the net predicted outlet mass flux is below 1% of the inlet’s, so that a near-zero outlet velocity cannot blow up a split’s mean. The remaining metric functions follow Equations (1) and (2); they are part of the scoring code and the dataset’s documentation, where they are tested on problems with analytic answers.

def free_stream(sample):
    """The zero-skill prediction, one value per field for every query point.

    The area-weighted mean of what the inlet prescribes, the eddy viscosity k / omega that
    goes with it (capped at 10^5 nu, as in the solver), and zero gauge pressure. Its wall
    shear stress is zero.
    """
    inlet = sample.boundaries["inlet"]
    area = inlet.cell_areas.double()
    mean = {
        name: torch.einsum("f,f...->...", area, value.double()) / area.sum()
        for name, value in inlet.cell_data["prescribed", "dirichlet"].items()
    }
    nu = float(sample.global_data["physics"]["kinematic_viscosity"])
    mean["gauge_pressure"] = torch.zeros((), dtype=torch.float64)
    mean["turbulent_kinematic_viscosity"] = (
        mean["turbulent_kinetic_energy"] / mean["specific_dissipation_rate"]
    ).clamp(max=1e5 * nu)
    return mean


def derive_globals(sample):
    """Global scales from the posed problem alone: allowed inputs, unlike global_data/reference."""
    inlet = sample.boundaries["inlet"]
    area = inlet.cell_areas.double()
    u = inlet.cell_data["prescribed", "dirichlet", "velocity"].double()
    speed = float((area * u.norm(dim=-1)).sum() / area.sum())  # area-weighted mean inlet speed
    # Length: the RMS distance between two points uniform on all boundary faces, sqrt(2 Var x),
    # from each triangle's exact moments, so a rotation of the case does not change it
    surfaces = [sample.boundaries[n] for n in ("inlet", "outlet", "no_slip", "slip")]
    o = torch.cat([b.points for b in surfaces]).double().mean(0)  # limits cancellation
    total, first, second = 0.0, 0.0, 0.0
    for b in surfaces:
        p, q, r = (b.points.double()[b.cells[:, k]] - o for k in range(3))
        w = b.cell_areas.double()
        total = total + w.sum()
        first = first + (w[:, None] * (p + q + r)).sum(0) / 3
        second = second + (w * (p * p + q * q + r * r + p * q + q * r + r * p).sum(-1)).sum() / 6
    length = float(2 * (second / total - (first / total).pow(2).sum())) ** 0.5
    nu = float(sample.global_data["physics", "kinematic_viscosity"])
    return {
        "inlet_velocity": (area[:, None] * u).sum(0) / area.sum(),  # area-weighted mean
        "inlet_speed": speed,
        "length": length,
        "reynolds_number": speed * length / nu,
    }

All splits

Table 12 lists every split with the question it asks and its sizes, in four groups: the random splits, the held-out enclosures, the held-out geometry families and the splits by Reynolds range or body-wall layout. Table 19 uses the same order.

Split (split_id)QuestionTrain canon.Train releasedTrain plannedValidation canon.Validation releasedValidation plannedTest canon.Test releasedTest planned
Random
fullrandom split of every case, about 70/10/20%2,0112,7133,104290386440515716816
scarceas full, with 1/6 of its training part321440506290386440515716816
super_scarceas full, with 1/36 of its training part537484290386440515716816
Held-out enclosure
Open box (profile_open_opposed)hold out the open box1,9432,7753,249293405466580635645
Ground-effect box (profile_ground_effect)hold out the ground-effect box2,0112,8373,281294400455511578624
Confined box (profile_confined_opposed)hold out the confined box2,1142,9633,281301418462401434617
Crossflow box (profile_crossflow)hold out the crossflow box2,2982,8203,251345417473173578636
Dual-inlet box (profile_dual_inlet)hold out the dual-inlet box2,0442,8753,270313424469459516621
Opposed sphere (family_opposed_sphere)hold out the opposed sphere2,1583,0173,494302418480356380386
Symmetry hemisphere (family_opposed_hemisphere)hold out the symmetry hemisphere2,3302,9823,463352442504134391393
Internal duct (family_duct)hold out the internal duct2,2663,0553,416348457506202303438
Every enclosure but the boxes (family_non_box)train on boxes; test on every other enclosure1,8502,3902,7432743514006921,0741,217
Held-out geometry family
Blobs (bank_blobs)hold out the Blobs family1,6622,1562,4342372923268721,3671,600
Blender bluff (bank_blender_bluff)hold out the Blender bluff family2,1492,9353,363331441497326439500
Procedural cars (bank_cars)hold out the Procedural cars family2,1732,9653,390321434490310416480
Zero-to-CAD (bank_zero_to_cad)hold out the Zero-to-CAD family2,2503,0403,464332442496224333400
Airframe Foundry (bank_airframes)hold out the Airframe Foundry family2,1983,0183,471321430489288367400
Streamlined (bank_streamlined)hold out the Streamlined family2,1322,9403,383332441497337434480
Blender streamlined (bank_blender_streamlined)hold out the Blender streamlined family2,1482,9383,385310418475346459500
Reynolds range and body-wall layout
Re≥106Re \ge10^{6} (reynolds)train below Re=106Re = 10^{6}; test above1,5772,1192,2822383113331,0011,3851,745
105≤Re<10610^{5} \le Re < 10^{6} (reynolds_interior)hold out 105≤Re<10610^{5} \le Re < 10^{6}1,9352,6143,048292380440589821872
Three body bands (layout)train on one or two body bands; test on three1,6472,2332,5592393113478921,2711,454

Table 12. All 22 splits: the canonical (mean_stable), released and planned sizes of each part. A held-out split’s test set is a whole region of the population, so the test sets differ in size: the canonical ones by a factor of 7.5 (134 to 1,001), the released ones by 4.6 and the planned ones by 4.5. They differ in difficulty by more; compare models only on the same split. For the eight splits that hold out a property of the body, the canonical test size counts samples with a body, and the released and planned sizes count all.

Test set (split)SamplesεU\varepsilon_U meanεU\varepsilon_U medianεUN\varepsilon_U^N medianεp\varepsilon_p meanεp\varepsilon_p medianεCF≤0.02\varepsilon_{CF} \le0.02
Random
Random cases (full, scarce, super_scarce)5150.4400.1100.1601.8090.0590.2%
Held-out enclosure
Open box (profile_open_opposed)5800.0460.0410.1060.0260.0220.2%
Ground-effect box (profile_ground_effect)5110.0910.0800.1260.0510.0430.2%
Confined box (profile_confined_opposed)4010.1860.1660.1750.1430.1180.0%
Crossflow box (profile_crossflow)1730.9470.8860.8833.4902.6240.6%
Dual-inlet box (profile_dual_inlet)4591.6591.5631.5709.1347.1500.0%
Opposed sphere (family_opposed_sphere)3560.0390.0340.1240.0220.0180.0%
Symmetry hemisphere (family_opposed_hemisphere)1340.1790.1810.1400.0950.0730.0%
Internal duct (family_duct)2020.6270.5570.1881.9370.2830.0%
Every enclosure but the boxes (family_non_box)6920.2380.0750.1360.5950.0390.0%
Held-out geometry family
Blobs (bank_blobs)8720.4090.0990.1641.6550.0600.0%
Blender bluff (bank_blender_bluff)3260.3670.1130.1831.2680.0630.0%
Procedural cars (bank_cars)3100.4600.1250.2022.0080.0730.0%
Zero-to-CAD (bank_zero_to_cad)2240.4660.1380.2462.0040.0830.0%
Airframe Foundry (bank_airframes)2880.3910.0700.1121.7930.0330.0%
Streamlined (bank_streamlined)3370.4680.0750.1072.3380.0430.3%
Blender streamlined (bank_blender_streamlined)3460.4900.0960.1112.4460.0440.6%
Reynolds range and body-wall layout
Re≥106Re \ge10^6 (reynolds)1,0010.3790.0760.1281.6400.0460.3%
105≤Re<10610^5 \le Re < 10^6 (reynolds_interior)5890.4630.0990.1502.1370.0630.0%
Three body bands (layout)8920.4350.0930.1502.0490.0510.2%

Table 19. The free-stream reference on the canonical test samples of every split, in the order of Table 12: the interior errors, and the share of samples with a body whose force error is within 0.02. scarce and super_scarce share the test set of full. A held-out enclosure’s test set is every canonical sample of that enclosure; family_non_box tests on the three enclosures that are not boxes. The reference predicts no force, so its median εCF\varepsilon_{CF} is 1.00 on every split but bank_blender_streamlined (0.68); its median duct-loss error εK\varepsilon_K is 1.00 on every split with ducts.

Splits are drawn by hashing. Each case maps to a number in [0, 1) through the SHA-256 of the release’s design seed, the name of a split stream and the digest of the case’s source geometry. Each split cuts that number at its fractions, so proportions hold in expectation rather than exactly. There are three streams. The first draws the in-distribution split and second the two scarce subsets. The third draws the validation part of every held-out split: an eighth of its training side, never drawn from its held-out region. Because the held-out splits share this stream, a case drawn for validation in one of them is validation in every other held-out split whose test region does not contain it.

The hash uses the primary body, which no two cases share, so every partition is disjoint in geometry. Hashing also keeps a case’s part fixed when cases are added. The second body that a case adds with probability 0.03 is a scaled copy of its own primary body, so it shares no geometry with any other case, in any part.

Splits that hold out a property of the body. The seven geometry-family splits and layout assign a body-free duct too, by the body or the body-wall layout that was drawn for it, although no body is posed. Their lists keep those ducts, and their scores leave them out, so these eight splits score only test samples that contain a body. The canonical test sizes of Table 12 count samples with a body. The mean_stable body-free ducts that a geometry-family split leaves out of its score number 9 to 45 (12 for bank_cars, which scores 310 samples). layout leaves out 38, and 66 of its planned test cases are ducts without a body.

Headline splits and model selection. The seven headline splits are full, scarce, super_scarce, family_non_box, profile_dual_inlet, reynolds and bank_cars (Table 2); profile_dual_inlet is the one that holds out a layout of boundary conditions. The geometry-family test sets together cover every validation sample of one split is a test sample of another. Of full’s 290 canonical validation samples, 165 are test samples of family_non_box, reynolds or bank_cars. Settings chosen on full’s validation part may be reused on the other splits if the result says so; otherwise they are chosen on the validation part of the split that is scored. Failed and timed-out cases keep their places, so effective sizes are known exactly, and a later release that finishes the timed-out cases moves no case.

Details of the runs

The Transolver and GeoTransolver rows behind Table 3 are single-seed runs of a recipe built on PhysicsNeMo; their training fits, auxiliary errors and per-enclosure scores follow below, alongside ISLA’s four-seed rows and the free-stream reference on every split.

What each model is given. Table 13 lists the inputs of the model setups of Table 3. The inflow’s direction is random from case to case. The prescribed boundary values give it, and in boxes the density of the interior query points also marks it, since the mesher refines a wedge from the body to the outlet. Without boundary tokens, a model is given nothing of the inlets, the outlets or the slip walls.

Model setupInputsGiven the boundary conditionsParameters
Transolver ((Wu et al., 2024))the query points, each with the signed distance to the no-slip walls and its gradientno9.0 M
GeoTransolver ([1]), no boundary tokensthe same point features; its geometry input is the interior query pointsno27.6 M
GeoTransolver, boundary tokensevery sampled boundary face as a geometry token with its centroid, a one-hot condition type and the prescribed values (22 channels); the same point featuresyes27.6 M
ISLA ([27])all four boundary meshes with face condition types and prescribed values, plus interior query coordinates (divides by per-case scales inside the model)yes67.5 M

Table 13. What each model setup of Table 3 is given. Transolver and GeoTransolver also take one global input: the viscosity in SI units and the Reynolds number in per-case scales; ISLA takes that Reynolds number.

With boundary tokens, GeoTransolver uses a small extension of the public model: its ball query takes each token’s centroid, and the token keeps its other channels. This option is not in public PhysicsNeMo ([24]). A token has 22 channels:

  • the face centroid (3) and a one-hot condition type (4);

  • the prescribed velocity, and the velocity prescribed where flow re-enters (3 each);

  • the prescribed pressure, kk, ω\omega, intermittency and ReθtRe_{\theta_t} (5), and the last four where flow re-enters (4).

A value that a face does not prescribe is 0. The ball query has six radii, 0.01, 0.05, 0.25, 1, 2.5 and 5, with at most 8, 16, 32, 32, 64 and 128 neighbors. The radii are in meters in SI units and in multiples of the per-case length in per-case scales.

The two unit scalings. The three Transolver and GeoTransolver setups are trained in both unit scalings.

  • SI units. Coordinates stay in meters and are not centered. The only global input is the logarithm of the kinematic viscosity, standardized by constants fitted on the training samples. Targets and prescribed boundary values are scaled by one constant per field for the whole dataset.

  • Per-case scales. Before anything else, the pipeline computes three scales from each posed problem: a length from the boundary geometry, a speed from the inlet’s prescribed velocity and a Reynolds number from those two and the viscosity. It divides coordinates and signed distances by the length, velocities by the speed, pressure by the dynamic pressure of that speed (at the density of 1.225 kg/m3^{3} that every case shares), kk by the speed squared, ω\omega by the speed

over the length and νt\nu t by their product. Targets and prescribed boundary values are scaled alike. The standardized logarithm of the Reynolds number replaces the viscosity as the global input, and the length and the speed themselves are not passed. Constants given in meters, such as GeoTransolver’s ball-query radii, become multiples of the per-case length. Predictions are returned to SI units before scoring.

The per-case scales are computed from the stored faces of the boundary meshes, before any subsampling. Face ii has area aia_i and centroid xi\mathbf{x}_i, and on an inlet face ui\mathbf{u}_i is the prescribed velocity. Then

L=(2Var⁡A(x))1/2,U=(∑i∈inletai∥ui∥2∑i∈inletai)1/2,Re⁡=ULν,L = \left(2\operatorname{Var}_{A}(\mathbf{x})\right)^{1/2}, \qquad U = \left(\frac{\sum_{i\in\mathrm{inlet}}a_i\lVert\mathbf{u}_i\rVert^2}{\sum_{i\in\mathrm{inlet}}a_i}\right)^{1/2}, \qquad\operatorname{Re} = \frac{UL}{\nu},

where Var⁡A(x)\operatorname{Var}_{A}(\mathbf{x}) is the area-weighted variance of position over all faces of the four boundary meshes together, each triangle’s own second moment included.

  • The length is the root-mean-square distance between two points drawn uniformly by area on the boundary. It is a size of the whole domain, so it is not the reference length, which measures the body, and it does not change when a case is rotated.

  • The speed is the area-weighted root-mean-square prescribed speed over every inlet face, both inlets of a dual-inlet box included.

  • The Reynolds number enters the model as (log⁡10Re−m)/s(\log_{10} Re - m)/s, where mm and ss are the mean and the population standard deviation of log⁡10Re\log_{10} Re over the 2,011 canonical training samples of full: two constants, the same for every case.

These scales use only the posed problem and no key of global_data/reference, so the input rule of § 2 allows them. They are the length and the speed that ISLA computes inside its model (Sharpe, [27]); for Transolver and GeoTransolver, the pipeline computes the same values outside the model. derive_globals (Appendix § 12) computes the same length, its boundary length LbL_b. Its speed is the area-weighted mean of ∥ui∥\lVert\mathbf{u}_i\rVert instead, which equals UU when every inlet face prescribes the same speed and is smaller otherwise.

Training and scoring. Every row was trained with a recipe built on PhysicsNeMo, on the 2,011 canonical training samples of full. Its 290 canonical validation samples were monitored every five epochs.

  • Sampling. Each training step draws 200,000 interior query points per case and at most 50,000 faces, uniformly at random, from each of the four boundary meshes.

  • Loss. For each case and each of the seven fields, the relative L2L^2 error of the field (the root mean square of the error over that of the target), summed over fields with velocity weighted 3. Points are not weighted by cell volume, so the loss differs from the metrics, which weight by volume and are in the scoring scales.

  • Optimizer. Muon (Jordan et al., [16]) on the two-dimensional weight matrices and AdamW on the other parameters (weight decay 10−410^{-4}), with a learning rate of 10−310^{-3}.

  • Schedule. 250 epochs, with either a step schedule (the learning rate divided by 10 after epochs 100 and 200) or five epochs of linear warm-up and a cosine decay to 10−610^{-6}.

  • Batch and precision. One case per GPU on one node of four GPUs, so four cases per step, on NVIDIA GB300 GPUs; training in bfloat16 or float32, by row.

  • Scoring. The final checkpoint is scored on the 515 canonical test samples, with float32 inference at every interior cell. The errors are reduced in float64 with cell-volume weights, as in the reference implementation of Appendix § 12. Each case’s value is the mean over two draws of its boundary-face sample. With boundary tokens, scoring takes about 13 s per sample and at most 83 GiB of GPU memory.

Both architectures have width 256, 12 layers, eight heads and 256 slices, and GeoTransolver adds a ball query at six radii. The rows differ in precision and schedule, and each is one seed. Table 3 prints one setting for each of those three setups and both unit scalings: the float32 row with the cosine schedule. The schedule matters in one cell: with boundary tokens in SI units, only this row trains (ϵU\epsilon_U 0.173). Table 14 lists all 18 Transolver and GeoTransolver rows (2,078 GPU-hours of training in all) and ISLA’s two rows; Table 15 gives the printed rows by enclosure configuration.

Table 14. Every row behind Table 3: three model setups in two unit scalings on full, each trained with three settings, one seed each, and ISLA’s two rows, the means of four seeds, whose first column gives the training targets. Table 3 prints the float32 row with the cosine schedule of each of those three setups. GPU-hours are per run, and ISLA keeps only its final checkpoint. Errors are medians over the 515 canonical test samples, and the near-field error over those with a body. The ratio is the median over samples of εU\varepsilon_U over the free-stream reference’s εU\varepsilon_U on the same sample, and <FS counts the samples where that ratio is below 1. The interval is a 95% bootstrap interval of the median over the test samples (reference: 0.094–0.134). The last four columns are the relative L2L^2 errors at the last epoch (predicting zero scores 1), on the training and validation samples, and the epoch of lowest validation loss.

Table 15. The median εU\varepsilon_U by enclosure configuration on the canonical test samples of full, for the free-stream reference and the rows of Table 3 (ISLA: means of four seeds); Figure 12 shows the rows in per-case scales. Configurations are ordered by the reference’s median, each with its number of test samples.

ISLA’s rows. ISLA [27] is given all four boundary meshes, each face with its condition type and every value it prescribes, and the Reynolds number built on the per-case scales, standardized as above. It takes its other inputs in SI units and divides them by the per-case scales inside the model, so its prediction does not depend on the units of its inputs. Both rows have 67.5 M parameters and were trained on the canonical training samples of full with the default learning rate and schedule of [27]: bfloat16, 250 epochs with five epochs of warm-up and a cosine decay, Muon and AdamW, one case per GPU on four GB300 GPUs and 200,000 interior points and 200,000 boundary faces per case and step. The loss weights the fields as above. ISLA + boundary targets also fits the pressure, velocity and wall shear at points on the boundary faces of the training samples (chosen on the validation parts of full and the six held-out splits); its interior errors are scored as every other row’s. Each row has four training seeds (42 to 45), scored at the final checkpoint as above, with one draw of the boundary-face sample per case, and a row’s statistic is the mean of its seeds’ statistics. A run took 102 GPU-hours of training, and 149 with boundary targets. On each of six held-out splits, ISLA was trained on the split’s training part with two seeds, reusing the same default learning rate and schedule. Table 16 gives these results and compares, on the test samples that each split shares with full, ISLA trained on that split with ISLA trained on full.

Multi-seed GeoTransolver, held-out splits and boundary-token ablation

A companion campaign (3,095 GB300 GPU-hours across all GeoTransolver runs) evaluated GeoTransolver with boundary tokens in per-case scales across multiple seeds, the same six held-out splits and a controlled boundary-token ablation, all in bfloat16 and scored at epoch 250. On full, a six-arm sweep of step and cosine decay at 1/3, 1 and 3 times the 10−310^{-3} reference learning rate on full’s validation part selected five epochs of warm-up plus cosine decay at 10−310^{-3}; six seeds (42 to 47) reach a median of εU\varepsilon_U of 0.076 (Table 17; a float32 check of step decay on seed 42 gave validation median εU\varepsilon_U 0.087 compared with bfloat16’s 0.089). On each held-out split, three seeds (42 to 44) ran at the schedule selected between step and cosine decay at 10−310^{-3} on that split’s own validation part (step decay on family_non_box and profile_dual_inlet, cosine decay on the other four; Table 17). On full at seed 42 with the selected cosine schedule and identical random draws, Table 18 isolates what boundary tokens carry: zeroing condition types and prescribed values leaves face centroids alone and raises the median ratio above 1 (1.16); restoring the four condition-type channels without prescribed values recovers single-inlet direction (0.088) yet trails full tokens in dual-inlet boxes (0.471 compared with 0.363); and removing boundary tokens and passing the area-weighted mean inlet velocity as a global input reaches 0.083 overall yet misses outlet placement in crossflow boxes (0.378 compared with 0.214).

The free-stream reference. The free-stream reference’s error depends mostly on the enclosure (the second block of Table 19). It is small where the flow passes straight through a large box or sphere, and large where the flow turns or where two inlets meet. A split’s mean is therefore dominated by its crossflow and dual-inlet samples, so the main tables report medians, and this table gives both. The reference was scored on all 3,815 released samples with the reference implementation (Appendix § 12). The true force coefficients that the scorer computes from the stored fields agree with the dataset’s case table to within 5×10−65 \times10^{-6} of max⁡(∣CF∣,0.05)\max(\lvert C_F\rvert, 0.05). On full, the reference’s median ϵU\epsilon_U is 0.110 on the canonical test samples and 0.184 on all released test samples.

How well the rows fit their training samples. Each run logged the relative L2L^2 error of each field at every epoch. For one sample, this is the root of the summed squared error over the summed squared target on its 200,000 sampled points, unweighted and with the velocity as one vector, so predicting zero scores 1. The training value is the mean over the epoch’s steps, taken while the weights change. The validation value is one pass over full’s validation samples, every five epochs. Table 14 gives both at the last epoch.

  • SI units, no boundary tokens. The training velocity error ends at 0.98 to 1.00, so the two model setups do not fit their own training samples.

  • SI units, boundary tokens. The cosine row ends at 0.37 in training and 0.39 in validation, and the two step rows at 0.92 to 0.93. No row in SI units fits the pressure: every training pressure error is above 1.

  • Per-case scales, no boundary tokens. The velocity error ends at 0.11 to 0.15 in training and 0.57 to 0.62 in validation. The validation loss is lowest at epochs 31 to 46 of 250, and by the last epoch the validation pressure error is 2.03 to 5.18. As for every row, the final checkpoint is the one scored. Scored instead at the epoch of lowest validation loss, the rows of Table 3 in per-case scales have a median εU\varepsilon_U of 0.301 (Transolver), 0.880 (GeoTransolver without boundary tokens) and 0.089 (with boundary tokens), where the last epoch gives 0.345, 0.769 and 0.084. The order of the rows does not change.

  • Per-case scales, boundary tokens. The velocity error ends at 0.07 to 0.10 in training and 0.17 to 0.18 in validation. The pressure error ends at 0.20 to 0.31 and 0.61 to 0.65.

Under the loss weights, velocity 3 and every other field 1, the five turbulence fields make up 64% of the training loss (ω\omega alone 32%) and 68% of the validation loss, leaving 17% on pressure. ISLA’s loss weights the fields the same way and learns the pressure (Table 3), so the weights alone do not explain Transolver’s and GeoTransolver’s pressure error.

The auxiliary errors. Every row predicts all seven fields, and Table 20 gives the medians of the five auxiliary errors of Appendix § 12. These errors are not on the scale of εU\varepsilon_U, so we compare them with a row that learned nothing. In SI units, Transolver predicts a near-constant value of each field and scores 0.0057, 35.6, 0.0013, 0.0037 and 0.551 on kk, ω\omega, νt\nu_t, γ\gamma and ReθtRe_{\theta t}. GeoTransolver with boundary tokens in per-case scales scores 0.0043, 19.6, 0.00070, 0.0064 and 0.101. Its error is therefore about half that row’s on ω\omega and νt\nu_t, a fifth on ReθtRe_{\theta t} and three quarters on kk. On the intermittency, which is 1 in most of the fluid, it is about 1.7 times as large. ISLA’s errors are lower still on four of the five (0.0030, 5.812, 0.00036 and 0.056 on kk, ω\omega, νt\nu_t and ReθtRe_{\theta t}), and on the intermittency (0.0039) about the same as those of the row that learned nothing.

Unit scalingPrecisionScheduleεk\varepsilon_kεω\varepsilon_\omegaενt\varepsilon_{\nu_t}εγ\varepsilon_\gammaεReθt\varepsilon_{Re_{\theta t}}
Transolver
SI unitsfloat32cosine0.005735.60.00130.00370.551
SI unitsfloat32step0.005738.20.00130.00370.551
SI unitsbfloat16step0.005739.70.00130.00340.549
per-case scalesfloat32cosine0.005920.90.00140.00790.587
per-case scalesfloat32step0.005824.50.00150.00920.639
per-case scalesbfloat16step0.005925.50.00150.0110.628
GeoTransolver (no boundary tokens)
SI unitsfloat32cosine0.005635.60.00130.00370.550
SI unitsfloat32step0.005741.30.00130.00370.552
SI unitsbfloat16step0.005640.30.00130.00350.549
per-case scalesfloat32cosine0.007828.50.00140.0110.686
per-case scalesfloat32step0.006838.70.00150.0140.650
per-case scalesbfloat16step0.007831.70.00150.0170.655
GeoTransolver (with boundary tokens)
SI unitsfloat32cosine0.005735.60.00120.00750.421
SI unitsfloat32step0.006041.30.00130.00380.548
SI unitsbfloat16step0.006540.90.00130.00340.550
per-case scalesfloat32cosine0.004319.60.000700.00640.101
per-case scalesfloat32step0.004719.90.000700.00630.104
per-case scalesbfloat16step0.005023.10.000730.00760.112
ISLA, mean of four seeds
interior targetsbfloat16cosine0.00305.8120.000360.00390.056
+ boundary targetsbfloat16cosine0.00305.8720.000360.00420.057

Table 20. With boundary tokens in per-case scales, four of the five auxiliary errors fall below those of every row in SI units; without boundary tokens, per-case scales raise εγ\varepsilon_\gamma. Medians over the 515 canonical test samples of full of the errors of the five turbulence fields (Appendix § 12), for the rows of Table 14. The unit of εω\varepsilon_\omega, Uref/LrefU_{\rm ref}/L_{\rm ref}, is far below the dissipation rate at a wall, so εω\varepsilon_\omega is large for every row.

Scaling and the irreducible floor on DrivAerML

On DrivAerML ([4]), Transolver ((Wu et al., 2024)) saturates in model size and compute; only adding training cases still lowers test error (Table 21). Combining a scaling-law grid over model size NN, training-set size DD and compute multiple κ\kappa (BB cases per step) with a single-case capacity test and an analytic target-noise floor brackets DrivAerML’s intrinsic irreducible error from above and below.

StatementEvidenceWhere
At 400 cases the error changes by 2.6% from 20 to 354 million parametersat equal budget (κ=1\kappa= 1, 16 cases per step): 0.0416, 0.0412, 0.0407 and 0.0418 for 20, 35, 105 and 354 million parametersFigure 13b
Four times the training compute lowers it by 3.8 to 4.1%from κ=1\kappa= 1 to κ=4\kappa= 4 at 16 cases per step: 0.0416 to 0.0399 and 0.0412 to 0.0397Figure 13c
Each doubling of cases lowers it by about 12%11% from 100 to 200 cases and 12% from 200 to 400 (mean of the 20- and 35-million-parameter models)Figure 13a
With unlimited cases the scaling floor is 21% below the best errorLirr=0.0309L_{\mathrm{irr}} = 0.0309 (0.0247–0.0365); best error 0.0393Table 22; Figure 13a
Target averaging noise sets a model-independent lower bound of 0.0079 to 0.025n=0.017n = 0.017 at the central time scale, 30% of Lirr2L_{\mathrm{irr}}^2Appendix § 15 (Results)
Appendix only: single-case overfitting reaches 0.28 times LirrL_{\mathrm{irr}} (8% of Lirr2L_{\mathrm{irr}}^2)L1=0.0086L_1 = 0.0086; 0.0118 in strict float32 (0.38 times)Figure 13d

Table 21. The statements of Section 1 about DrivAerML and the evidence for each. Errors are relative L2L^2 errors of surface pressure.

Results. At D=400D = 400, the models from 7.5 to 35 million parameters end at the same error, and at equal budget (κ=1\kappa= 1, B=16B = 16) the 105- and 354-million-parameter models give 0.0407 and 0.0418, compared with 0.0416 and 0.0412 at 20 and 35 million: a spread of 2.6%, within the 3.5% spread between seeds. Four times the budget lowers the error of the 20- and 35-million-parameter models by 3.8 to 4.1% at 400 cases and by 5.5 to 8.1% at 200. More cases still lower it, by 11% from 100 to 200 and 12% from 200 to 400. The floor LirrL_{\rm irr} of the fit L(D)=Lirr+b(D/100)−βL(D) = L_{\rm irr} + b(D/100)^{-\beta}, by least squares on log⁡L\log L over the 12 converged cells of the 20- and 35-million-parameter models, is 0.0309 (95% bootstrap interval 0.0247–0.0365) with β=0.61\beta= 0.61, 21% below the best error of 0.0393 (Table 22).

FitFitted toLirrL_{\mathrm{irr}} (95%)Note
L(D)L(D) (used)the 12 converged cells of the 20- and 35-million-parameter models0.0309 (0.0247–0.0365)β=0.61\beta= 0.61; residual 2.1%
L(D)L(D)the same without D=12D = 120.0345β=0.76\beta= 0.76
Joint lawall 15 converged cells0.0318 (<10−4< 10^{-4} to 0.0356)α\alpha at its bound (3.0): the size term is not identified
Joint lawevery cell, converged or not0.0338
Law in NN, DD and case drawsthe end points of all 57 runs at B=16B = 160.0327floor at D=400D = 400 for unlimited compute and model size: 0.0380

Table 22. Estimates of the floor LirrL_{\mathrm{irr}}. The text uses the first, fitted to the converged cells of two models whose validation errors agree within the spread between seeds. The joint law is L(N,D)=Lirr+a(N/106)−α+b(D/100)−βL(N,D)=L_{\mathrm{irr}}+a(N/10^6)^{-\alpha}+b(D/100)^{-\beta}.

Together with target-noise and single-case capacity bounds, LirrL_{\mathrm{irr}} brackets DrivAerML’s dataset-intrinsic floor ϵ⋆\epsilon_\star within a factor of 1.8:

  1. Model-independent lower bound (n=0.017n = 0.017, range 0.0079–0.025). Each stored target averages a hybrid RANS–LES run over a finite window TT (1.7–4.3 s), and DrivAerML stores each face’s pressure variance σ2\sigma^2. Because zero-mean finite-window averaging noise is uncorrelated with any prediction made from geometry alone, its squared norm adds to every model’s expected squared error. With the drag coefficient’s integral time scale τint=14\tau_{\mathrm{int}} = 14 ms, read from the published convergence plots, an exact predictor of each case’s infinite-window flow swell from still scores n=⟨rσ(2τint/T)1/2⟩=0.017n = \langle r_\sigma(2\tau_{\mathrm{int}}/T)^{1/2}\rangle= 0.017, where rσ=∥σ∥2/∥p∥2r_\sigma= \lVert\sigma\rVert_2/\lVert p\rVert_2 averages 0.156 (for τint\tau_{\mathrm{int}} from 3 to 30 ms, nn is 0.0079–0.025, or 30% of Lirr2L_{\mathrm{irr}}^2 at the central value). Independent mesh realizations and bistable wake switching across morphs can only raise ϵ⋆\epsilon_\star further, so ϵ⋆≥n\epsilon_\star\ge n.

  1. Single-case spatial capacity check (L1=0.0086=0.28 LirrL_1 = 0.0086 = 0.28\,L_{\mathrm{irr}}). Trained on one case alone with the same (centroid, normal) inputs, 200,000-face subsampling and optimizer, Transolver reaches L1=0.0086L_1 = 0.0086, or 0.0118 in strict float32

(Figure 13d). At least 92% of Lirr2L_{\mathrm{irr}}^2 (85% in strict float32) therefore cannot come from within-case spatial expressivity, face subsampling or numerical precision. Single-case memorization tests within-case field approximation (x↦pS(x)x \mapsto p_S(x)) rather than cross-case operator approximation (S↦pSS \mapsto p_S) at fixed capacity NN, so a residual cross-case inductive bias can still hold LirrL_{\mathrm{irr}} above ε⋆\varepsilon_\star.

Figure 13. At 200 and 400 training cases, the test error of Transolver on DrivAerML changes by a few percent with more parameters (b) and more training compute (c), and each doubling of cases still lowers it by about 12% (a); a single case is fitted to 0.28 times the floor LirrL_{\mathrm{irr}} (d). In every panel an open marker is a grid cell not converged in compute, and the red line and band are LirrL_{\mathrm{irr}} and its 95% interval. (a, b) Test error of every grid cell against the number of training cases and the number of parameters. The dashed line in (a) is the fit Lirr+b(D/100)−βL_{\mathrm{irr}} + b (D/100)^{-\beta} to the converged cells of the 20- and 35-million-parameter models. (c) Test error against training FLOPs for every finished run at D=400D = 400 (circles) and D=200D = 200 (triangles), colored by model size as in (a). Larger markers are runs with more cases per step (1 or 16, and 4 in one run); the dashed lines are the fit’s value at each DD. (d) Error on every face of a single training case at the end of training, against the faces processed (steps times faces per step), for the 3.4- and 35-million-parameter models (mean over three cases, bars from the lowest to the highest); triangles are runs on 16 and 64 GPUs, crosses strict float32 training. This is the error on the case the model trained on, so it can fall below LirrL_{\mathrm{irr}}, which bounds the error on cases the model has not seen; the dashed gray line is the best error on those cases.

  1. Empirical upper bound and cross-architecture check (ε⋆≤Lirr=0.0309\varepsilon_\star\le L_{\mathrm{irr}} = 0.0309). Because any remaining cross-case approximation residual is non-negative, LirrL_{\mathrm{irr}} upper-bounds ε⋆\varepsilon_\star (subject to the single-power-law extrapolation beyond D=400D = 400; Table 22), pinching ε⋆\varepsilon_\star into [0.017,0.0309][0.017, 0.0309] at the central estimates, right below the 0.0393 error already reached at 400 cases. Consistent with a dataset-level floor rather than a Transolver-specific ceiling, Sharpe [27] finds that ISLA lowers DrivAerML surface-pressure error relative to Transolver and GeoTransolver on the smallest training split (super_scarce) yet converges with both architectures to nearly identical errors at 400 training cases.

Protocol. The data are the 483 complete public runs of DrivAerML in the standard PhysicsNeMo train/validation split (one of the 484 public runs lacks full surface data). The test set is that split’s 48 validation runs, and a selection set of 35 training runs, on which the validation error is measured, selects each run’s checkpoint, each cell’s budget and whether a cell is converged in compute. The training sets are the first DD cases of a fixed random order of the other 400, so they are nested. The model is the unmodified public PhysicsNeMo Transolver (PhysicsNeMo Contributors, [24]) (commit e3dae21a), given each face’s centroid and normal and trained on the mean squared error of standardized pp and τ\tau, with 200,000 faces of one case per GPU and step, AdamW and a cosine schedule. The metric is the relative L2L^2 error of surface pressure over every face, averaged over cases. A cell’s value is the test error of its run with the lowest validation error, and a cell is converged in compute if its last 4-fold increase in budget lowered the validation error by less than 1%; 15 of 50 cells are. A run’s training compute CFLOPC_{\mathrm{FLOP}} counts its case draws times the FLOPs of one draw, and the study used 17,913 GB300 GPU-hours. Every cell’s error, every run’s budget and the settings of each run will be released in drivaerml-saturation.json.

Other datasets: sources and the shape-diversity score

The values in Tables 1 and Table 23 are quoted from each dataset’s paper or card: AirfRANS from its paper ([9]); UniFoil, CFDBench and FlowBench from theirs ([17, 20, 29]); DrivAerML, WindsorML, AhmedML, DrivAerNet++, HifiT AeroML, BlendedNet and DrivAerStar from their papers ((Ashton et al., 2024a; b; Elrefael et al., 2024; Ashton et al., 2026; Sung et al., 2025; Qiu et al., 2025)); and Huggins Face cards: SHIFT-SUV from its card and the publisher’s page ([19]); ShapeNet-Car from its paper ([30]); SuperWing and Emmi-Wing from their papers ([34, 23]); and WindTunnel-20k from its card and its public simulation templates ([15]). Each cell was checked against these sources. DrivAerML’s card lists 484 of its 500 runs as public. SuperWing draws eight operating conditions per wing and keeps the converged ones, and Emmi-Wing draws each wing with its own speed and incidence. Table 23 lists three two-dimensional datasets in the columns of Table 1.

DatasetFamiliesEnclosuresOperating pointsSolverSamplesCells per sample
AirfRANS ([9])11Re 2Re\ 2–6×1066 \times10^6, incidenceRANS1,0000.25–0.3 M
UniFoil ([17])11wide ReRe and MachRANS, eNe^N transition>500,000—
CFDBench ([20])44variedlaminar or RANS739—

Table 23. Three two-dimensional CFD datasets for machine learning, in the columns of Table 1.

Shape diversity. For each reference dataset, the shape-diversity comparison (Figure 4) uses the training surfaces of its design sweep. DrivAerML and SHIFT-SUV give 400 surfaces each, as many as each AeroZoo geometry family. HiLiftAeroML gives its 126 distinct geometries, and for that comparison every AeroZoo geometry family is subsampled to 126. Each surface is centered and scaled to unit size, so the score measures shape rather than scale. It is then described by 83 rotation- and scale-invariant numbers: 11 global geometric scalars and two histograms, of the distances and of the normal angles between pairs of surface points. The similarity of two surfaces is a Gaussian kernel of the distance between their descriptors, with the bandwidth set to the median distance to the 20th nearest neighbor.

How far the comparison depends on its settings. A check with the published descriptor tables and functions varied the bandwidth, the descriptors and the sample size.

  • Calibration. Standardization and the bandwidth are fitted once, on the five non-Blender geometry families and the two automotive datasets pooled. SHIFT-SUV’s surfaces are open, so three of its scalars are missing and are filled with pooled medians.

  • The ceiling. A score cannot exceed the number of shapes, and Zero-to-CAD is at that ceiling (97% of its shapes count as distinct). Its ratio to the automotive datasets therefore grows with the sample size, from 7 at 50 shapes to 36 at 400, and with the bandwidth, from 23 to 64.

  • The least varied family. With the bandwidth set by the 5th to the 100th nearest neighbor, the least varied family stays at 1.9 times the more varied automotive dataset.

  • The order. Each of those five families scores above both automotive datasets in 30 of 35 settings (five bandwidths by seven subsets of the three descriptor blocks). In the others, the distance histogram alone, the Streamlined family scores 0.8 to 1.0 times DrivAerML.

  • Blender families. Scored at the primary setting under the same calibration, the two Blender families lie between the lowest and the highest.

Datasheet

We answer the questions of Gebru et al. [12] in brief.

Motivation. AeroZoo was created to measure whether neural surrogates of incompressible RANS flow generalize across shapes, enclosures, boundary conditions and flow regimes, which datasets that each vary one design family in one flow domain cannot measure, and to show what a well-posed CFD sample must contain. It is a benchmark that can also serve as a training corpus. It was created by the authors at NVIDIA, which funded the work.

Composition. Each instance is a sample: one solved flow problem stored as a PhysicsNeMo DomainMesh (PhysicsNeMo Contributors, [24]). Appendix § 11 lists its contents. Release v1.2 holds 3,815 samples of a designed population of 4,360 cases; the release manifest gives every planned case a status, so that the 208 failed and 337 timed-out cases are listed rather than missing. The release holds one more sample, a mascot geometry, which is in no split and is not among the 3,815 counted in this paper. No two cases share a primary body; the second body that a case adds with probability 0.03 is a scaled copy of its own primary body. The 22 frozen splits, disjoint in geometry, are lists of case identities. Of the samples, 2,816 have a stable time mean and form the canonical benchmark. Numerical verification is in § 6 and Appendix § 10. Six of the seven geometry families were generated for this dataset. The Zero-to-CAD family is a farthest-point sample of 500 parts, within three strata of bluffness, from the 52,408 watertight single-body parts of the public Zero-to-CAD 100K corpus that pass simple shape gates (Autodesk AI Lab, [7]); that corpus is released under the Apache License 2.0, so every geometry in the release is permissively licensed. The release contains no personal or confidential data.

Collection. Every sample was generated by simulation, from a seed and a frozen recipe (Appendix § 9), with OpenFOAM 14 and snappyHexMesh, between 2026-09-13 and 2026-10-02. The released samples took 8.1 M CPU core-hours of solver time on preemptible nodes, not counting meshing or the failed and timed-out cases. Every case’s problem was posed before any mesh existed, including the cases that later failed or timed out, and failed cases were never replaced.

Preprocessing. The exporter merges the solver’s patches by boundary-condition type, triangulates them and converts kinematic pressure to pascals. Interior points are OpenFOAM’s own cell centroids, checked against centroids recomputed from the face geometry. A sample becomes visible only after it has been written, reloaded and compared tensor by tensor. The native solver cases are retained, so samples can be exported again without solving again.

Uses. Intended uses are training and evaluating surrogates of steady or time-mean incompressible flow, pretraining and studying generalization across geometry, enclosure, boundary conditions and Reynolds number. Samples store time-mean solutions of incompressible, isothermal RANS equations (§ 6) rather than time series or physical wind-tunnel measurements.

Distribution. The release will be hosted at https://huggingface.co/datasets/nvidia/AeroZoo as one archive per sample (1.48 TB in total), with the split files, the release manifest and a catalog (index.json) that answers subset questions without opening a sample. Its license is stated on that page; the Zero-to-CAD parts keep the Apache License 2.0 and its notice. The scoring code will be added to https://github.com/NVIDIA/physicsnemo.

Maintenance. The authors maintain the release. A release that only adds samples, such as one that finishes the timed-out cases, is a point release and moves no case between splits; a change to the artifacts, the recipe, the schema or the planned population takes a new minor version. A changelog records every version and its defects.

References

  1. [1]Adams, C., Ranade, R., Nidhan, S., Nabian, M. A., Akhare, D., Cherukuri, R., and Choudhury, S. GeoTran-solver: Learning physics on irregular domains using multi-scale geometry aware physics attention transformer. arXiv:2512.20399, 2025.arxiv.org/abs/2512.20399
  2. [2]Ashton, N., Angel, J. B., Ghate, A. S., Kenway, G. K. W., Wong, M. L., Kiris, C., Walle, A., Maddix, D. C., and Page, G. WindsorML: High-fidelity computational fluid dynamics dataset for automotive aerodynamics. In Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, volume 37, 2024a. doi: 10.52202/079017-1194.DOI
  3. [3]Ashton, N., Maddix, D. C., Gundry, S., and Shabestari, P. M. AhmedML: High-fidelity computational fluid dynamics dataset for incompressible, low-speed bluff body aerodynamics. arXiv:2407.20801, 2024b.arxiv.org/abs/2407.20801
  4. [4]Ashton, N., Mockett, C., Fuchs, M., Fließbach, L., Hetmann, H., Knacke, T., Schonwald, N., Skaperdas, V., Fotiadis, G., Walle, A., Huppertz, B., and Maddix, D. DrivAerML: High-fidelity computational fluid dynamics dataset for road-car external aerodynamics. arXiv:2408.11969, 2024c.arxiv.org/abs/2408.11969
  5. [5]Ashton, N., Clark, A., Goc, K., Heidt, L., Ivey, C., Agrawal, R., Bose, S. T., Adams, C., Sharpe, P., Leibovici, D., Akkurt, S., Nidhan, S., Ranade, R., and Kossaifi, J. HiLiftAeroML: A high-fidelity computational fluid dynamics dataset for high-lift aircraft aerodynamics. arXiv:2605.19565, 2026.arxiv.org/abs/2605.19565
  6. [6]Ataei, M., Askari, F., Rahimi Malekshah, K., and Jayaraman, P. K. Zero-to-CAD: Agentic synthesis of interpretable CAD programs at million-scale without real data. arXiv:2604.24479, 2026.
  7. [7]Autodesk AI Lab. Zero-to-CAD 100K: A curated subset of 100,000 geometrically diverse CAD construction sequences. Hugging Face dataset ADSKAILab/Zero-to-CAD-100k, 2026. URL https://huggingface.co/datasets/ADSKAILab/Zero-to-CAD-100k. Apache License 2.0.
  8. [8]Bakarji, J., Callaham, J., Brunton, S. L., and Kutz, J. N. Dimensionally consistent learning with Buckingham Pi. Nature Computational Science, 2(12):834–844, 2022. doi: 10.1038/s43588-022-00355-5.DOI
  9. [9]Bonnet, F., Mazari, A. J., Cinnella, P., and Gallinari, P. AirfRANS: High fidelity computational fluid dynamics dataset for approximating Reynolds-averaged Navier-Stokes solutions. In Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2022.
  10. [11]Friedman, D. and Dieng, A. B. The Vendi score: A diversity evaluation metric for machine learning. Transactions on Machine Learning Research, July 2023. URL https://openreview.net/forum?id=g970HbQyk1.
  11. [12]Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., and Crawford, K. Datasheets for datasets. Communications of the ACM, 2021.arxiv.org/abs/1803.09010
  12. [13]Greenshields, C. J. OpenFOAM v14 User Guide. The OpenFOAM Foundation, London, UK, version 14 edition, July 2026. URL https://doc.cfd.direct/openfoam/user-guide-v14. Section 5.5: Mesh generation with the snappyHexMesh utility.
  13. [14]Hadamard, J. Sur les problèmes aux dérivées partielles et leur signification physique. Princeton University Bulletin, 13:49–52, 1902.
  14. [15]Inductiva. WindTunnel-20k. Hugging Face dataset, https://huggingface.co/datasets/inductiva/windtunnel-20k, 2024. The dataset card asks users to cite Valério et al. (2024).
  15. [16]Jordan, K., Jin, Y., Boza, V., You, J., Cesista, F., Newhouse, L., and Bernstein, J. Muon: An optimizer for hidden layers in neural networks. https://kellerjordan.github.io/posts/muon/, 2024.
  16. [17]Kanchi, R., Melanson, B., Somasekharan, N., Pan, S., and He, S. UniFoil: A universal dataset of airfoils in transitional and turbulent regimes for subsonic and transonic flows. In Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, volume 38, 2025. doi: 10.52202/085713-2467.
  17. [18]Langtry, R. B. and Menter, F. R. Correlation-based transition modeling for unstructured parallelized computational fluid dynamics codes. AIAA Journal, 47(12):2894–2906, 2009. doi: 10.2514/1.42362.
  18. [19]Luminary Cloud. SHIFT-SUV: High-fidelity computational fluid dynamics dataset for SUV external aerodynamics. https://huggingface.co/datasets/luminary-shift/SUV, 2025.
  19. [20]Luo, Y., Chen, Y., and Zhang, Z. CFDBench: A large-scale benchmark for machine learning methods in fluid dynamics. arXiv:2310.05963, 2023.
  20. [21]Menter, F. R. Two-equation eddy-viscosity turbulence models for engineering applications. AIAA Journal, 32(8): 1598–1605, 1994. doi: 10.2514/3.12149.DOI
  21. [22]Menter, F. R., Kuntz, M., and Langtry, R. Ten years of industrial experience with the SST turbulence model. In Turbulence, Heat and Mass Transfer 4. Begell House, 2003.
  22. [23]Paischer, F., Cotteleer, L., Dreze, Y., Kurle, R., Rubini, D., Bleeker, M., Kronlachner, T., and Brandstetter, J. Going with the speed of sound: Pushing neural surrogates into highly-turbulent transonic regimes. arXiv:2511.21474, 2025. NeurIPS 2025 ML4PS Workshop.arxiv.org/abs/2511.21474
  23. [24]PhysicsNeMo Contributors. NVIDIA PhysicsNeMo: An open-source framework for physics-based deep learning in science and engineering. https://github.com/NVIDIA/physicsnemo, 2023.
  24. [25]Qiu, J., Kuang, L., Wang, G., Xu, Y., Cui, L., Fu, S., Zhu, Y., and Zhang, R. DrivAerStar: An industrial-grade CFD dataset for vehicle aerodynamic optimization. In Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, volume 38, 2025. doi: 10.52202/085713-3293.DOI
  25. [26]Sharpe, P. GLOBE: Accurate surrogates for boundary-driven PDEs via domain-inspired architectures and equivariance. In Advances in Neural Information Processing Systems (NeurIPS), 2026a. URL https://openreview.net/forum?id=YvUCvzeJte.arxiv.org/abs/2511.15856
  26. [27]Sharpe, P. ISLA: A coordinate-free, measure-weighted transformer for boundary-driven PDEs. arXiv preprint, 2026b.arxiv.org/abs/2611.17141
  27. [28]Sung, N., Spreizer, S., Elrefaie, M., Samuel, K., Jones, M. C., and Ahmed, F. BlendedNet: A blended wing body aircraft dataset and surrogate model for aerodynamic predictions. In ASME International Design Engineering Technical Conferences (IDETC/CIE), 2025. doi: 10.1115/DETC2025-168977.DOI
  28. [29]Tali, R., Rabeh, A., Yang, C.-H., Shadkhah, M., Karki, S., Upadhyaya, A., Dhakshinamorthy, S., Saadati, M., Sarkar, S., Krishnamurthy, A., Hegde, C., Balu, A., and Ganapathysubramanian, B. FlowBench: A large scale benchmark for flow simulation over complex geometries. Journal of Data-centric Machine Learning Research, 2, 2025.arxiv.org/abs/2409.18032
  29. [30]Umetani, N. and Bickel, B. Learning three-dimensional flow for interactive aerodynamic design. ACM Transactions on Graphics, 37(4):1–10, 2018. doi: 10.1145/3197517.3201325.DOI
  30. [31]Villar, S., Yao, W., Hogg, D. W., Blum-Smith, B., and Dumitrascu, B. Dimensionless machine learning: Imposing exact units equivariance. Journal of Machine Learning Research, 24(109):1–32, 2023.arxiv.org/abs/2204.00887
  31. [32]Weller, H. G., Tabor, G., Jasak, H., and Fureby, C. A ten-serial approach to computational continuum mechanics using object-oriented techniques. Computers in Physics, 12(6):620–631, 1998. doi: 10.1063/1.168744.DOI
  32. [34]Yang, Y., Tang, W., Liu, M., Thuerey, N., Zhang, Y., and Chen, H. SuperWing: a comprehensive transonic wing dataset for data-driven aerodynamic design. Scientific Data, 13:1113, 2026. doi: 10.1038/s41597-026-07769-0.DOI

Paper details

vlnc:W_5hjmnk6s
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents