betaFeedback

WorksComputer Science

IC-ThermBench: An Open, Progressive Benchmark for Generalizable 2.5D/3D-IC Thermal Learning

Abstract

Standardized benchmarks are fundamental to reliable progress in AI for EDA, including learning-based thermal modeling. However, existing thermal prediction studies often rely on different datasets, simulators, data splits, preprocessing pipelines, and metrics, while most datasets and implementations remain unavailable, making fair and reproducible comparison difficult. We introduce IC-ThermBench, an open and progressive benchmark that combines established 3D-IC steady-state, transient, and industrial package tasks with a new 50,000-sample 2.5D chiplet extension designed to evaluate progressively broader represented physical variation and cross-package OOD transfer. Five Generalization Scopes cover 3D-IC fixed-design prediction, Within-Family Generalization under layout, material, and boundary-condition variation, and Cross-Package OOD transfer to unseen package systems. We evaluate eight representative baselines under common data, splits, labels, and metrics. Performance degrades gradually from S2 to S4 as represented physical support broadens, but Cross-Package OOD produces a much sharper degradation: the best RMSE and MAE increase from 1.216 and 0.938~K at S4 to 15.99 and 15.00~K at S5, respectively. With only 10 labeled samples per OOD case, target-domain adaptation reduces the best MAE to 2.60~K. IC-ThermBench further provides a unified generation, training, inference, and evaluation pipeline, enabling reproducible and fair comparison of existing and new thermal predictor.

Keywords thermal benchmark, public dataset, chiplets, 2.5D/3D integration, neural operators, out-of-distribution generalization

Introduction

Thermal analysis is critical to 2.5D/3D-IC design, where chiplet placement, power density, material properties, and cooling conditions jointly determine temperature distributions and hotspots. Repeated high-fidelity simulation during placement, routing, and design-space exploration can be expensive, motivating learning-based thermal surrogates. Learning-based thermal predictors have recently attracted increasing attention, achieving high predictive accuracy while enabling fast inference for repeated thermal analysis [9, 16, 32, 33].

Prediction accuracy alone, however, does not make models directly comparable. Benchmarks such as ImageNet, SWE-bench, and PDEBench, together with CircuitNet in EDA, demonstrate the importance of shared data, task definitions, splits, metrics, and evaluation procedures [1, 5, 10, 25]. This is particularly important for thermal learning, where differences in datasets, simulators, preprocessing, and test distributions can substantially affect reported errors. Results obtained under different evaluation settings therefore cannot be interpreted as model-to-model improvements by default.

Existing thermal-learning studies have expanded beyond power-only variation to more challenging geometry, material, and cooling conditions [18, 34, 37, 38]. However, their datasets, representations, splits, and evaluation protocols remain highly heterogeneous, and complete data and code are often unavailable. Table 1 summarizes these differences; the Closest-Scope labels indicate conceptual similarity rather than protocol equivalence. The field therefore still lacks an open and unified framework for fair and reproducible comparison across thermal predictors.

WorkPublicationModel familyLabels / scaleFactorsGeneralization / evaluation settingClosest ScopeData publicCode public
ThermGAN [11]ICCAD’20conditional GANcommercial CPU traces; NRP,tP,tworkload-conditioned maps on fixed CPU designsS1✗✗
ThermEDGe [3]ASP-DAC’21encoder–decoder / ConvLSTMprivate numerical; 5kP,tP,twithin-design steady/transient thermal and IR tasksS1✗✗
GCN+PNA [2]ASP-DAC’22graph convolutionHotSpot; six unseen setsGPGPinductive evaluation across unseen chiplet layouts/sizesS2/S5✗✗
DeepOHeat [16]DAC’23DeepONet operatorPDE residuals; Celsius checkGPMBGPMBparametric/non-parametric configurations; no supervised labels in original methodS4–✓
MCM-DCNN [6]TSEP’23SDF-encoded DCNNnumerical; NRGPGPtrains on 2–4 chips and tests a 5-chip configurationS2/S5✗✗
ARO [28]ICCAD’24autoregressive operatorMTA [12]; 3×5kP,tP,twithin-design power; cross-case transfer/multi-fidelityS1✓✗
FaSTherm [39]ICCAD’24residual CNNfull-chip transient; NRP,tP,tnonlinear transient prediction on task-specific designsS1✗✗
T-Fusion [36]ASP-DAC’25Bayesian tensor fusionEV6 MTA; HF/LF subsetsP,tP,tfixed-design transient multi-fidelity fusionS1✗✗
SAU-FNO [7]DAC’25attention U-FNOMTA; 3×5kPPfixed-design power; transfer between source casesS1✗✗
FSA-Heat [38]DATE’25frequency–spatial netHotSpot; 6kGPMBGPMBrepresented mixtures plus unseen conductivity/source countS3/S5✗✗
Therunet-SP [13]ISQED’25scaled U-Net2.5D numerical; NRGPGPgeometry scaling across 2.5D configurationsS2✗✗
Therm-PCT [37]ICCAD’25point-cloud TransformerCOMSOL point clouds; 8.5kGPMGPMunseen shapes and point-cloud sizes, including larger unstructured domainsS3/S5✗✗
Adaptive Graph [34]ICCAD’25GNN–FEM hybridfine-grid numerical + silicon; NRGMGMvariable structure/interface; unseen process/material without retrainingS3/S5✗✗
PNO-Therm [8]DAC’26PDE foundation modelHS source suite; 3×5kPPfine-tuning on fixed-design steady tasksS1✗✗
COOL [18]DAC’263D point Transformercommercial FEM; 74×10GPMBGPMBdesign-disjoint 58/16 split over heterogeneous 3D/3.5D systemsS4/S5✗✗

Table 1. Expanded prior-work survey of learned thermal predictors. These entries are not the roster of evaluated IC-ThermBench baselines. Labels/scale identifies the reference data source, not the predictor. ✓/✗ mark whether data and code are public; “–” marks DeepOHeat data as not applicable because its original training is label-free.

To fill this gap, we introduce IC-ThermBench, an open and progressive benchmark for 2.5D/3D-IC thermal learning. It combines established 3D-IC steady-state, transient, and industrial package tasks with a new 50,000-sample 2.5D chiplet extension that systematically broadens the represented physical variation. Five Generalization Scopes span increasingly challenging deployment settings: S1 preserves established 3D-IC fixed-design tasks; S2–S4 progressively introduce layout, material, and boundary-condition variation within represented system families; and S5 evaluates case-disjoint transfer to previously unseen package systems. This organization explicitly separates Within-Family Generalization from Cross-Package OOD transfer.

The main contributions are threefold:

  • We establish an open thermal-learning benchmark that unifies established public tasks with a new 50,000-sample progressive extension under a consistent data and evaluation framework.

  • We benchmark eight classic and state-of-the-art thermal predictors under a unified protocol. Results show moderate degradation with broader represented physical variation, a sharp drop under Cross-Package OOD, and substantial recovery with limited target-domain adaptation.

  • We provide an end-to-end benchmark toolkit covering data generation, format conversion, immutable splits, training,

inference, and evaluation, allowing existing and new models to be integrated, reproduced, and fairly compared through a common interface. Models [7, 9, 14, 16, 17, 20, 23, 28, 31, 35]. These approaches have achieved high prediction accuracy across a variety of fixed-design or represented-distribution settings.

Related Work

Benchmarks in ML, Scientific ML, and EDA

Modern benchmarks provide not only datasets but also shared task definitions, data splits, metrics, and evaluation protocols that enable reproducible and fair model comparison. ImageNet, GLUE, SWE-bench, and PDEBench established this paradigm across vision, language, software agents, and scientific ML [5, 10, 25, 27]. Learning-based EDA has likewise benefited from public benchmarks such as CircuitNet, AMSNet, OpenABC-D, EDALearn, and ChiPBench, which provide reusable foundations for model development and evaluation [1, 4, 19, 26, 30].

Such standardization is particularly important for thermal learning, where differences in simulation settings, physical conditions, data splits, input representations, and evaluation metrics can substantially affect reported errors and make independently reported results difficult to compare directly.

Learning-Based Thermal Simulation

Learning-based thermal simulation has explored convolutional and image-to-image models [3, 6, 11, 15, 21, 24, 39], as well as neural operators, physics-informed learning, and pretrained PDE models [7, 9, 14, 16, 17, 20, 23, 28, 31, 35]. These approaches have achieved high prediction accuracy across a variety of fixed-design or represented-distribution settings.

Recent studies further extend thermal prediction toward cross-configuration and cross-system generalization. Therunet-SP studies geometry scaling, ThermGCN evaluates unseen chiplet layouts, FSA-Heat jointly varies geometry, power, material, and heat-exchange conditions, Therm-PCT targets unseen unstructured geometries, and Adaptive Graph Learning considers process, material, and interface variation [2, 13, 34, 37, 38]. COOL further represents geometry, power, material, and cooling conditions in a unified formulation and evaluates generalization with a design-disjoint split [18]. Alpha EV6-based tasks have also been adopted by multiple studies, including ARO, T-Fusion, SAU-FNO, and Therm-FM [7, 9, 28, 36].

Despite this progress, evaluation settings in thermal learning remain highly fragmented. Different studies often use different datasets, simulators, input representations, data splits, and metrics, while complete data and implementations are frequently unavailable. As a result, existing results are difficult to reproduce and compare fairly, and evaluating new methods often requires rebuilding study-specific data and evaluation pipelines.

Problem Formulation

For a packaged chiplet system, the temperature field is jointly determined by the system structure and its physical operating conditions. Let M\mathcal{M} denote the structural configuration, including the package outline, layer stack, and chiplet organization, and let z\mathbf{z} collect the physical variables exposed by a task, such as power, material properties, boundary conditions, and, when applicable, time. The underlying thermal process follows the heat equation,

ρCp∂T∂t−∇⋅(k∇T)=Q,(1)\rho C_p \frac{\partial T}{\partial t} - \nabla\cdot(k\nabla T) = Q, \tag*{(1)}

and can be abstracted as a thermal solution operator

G:(M,z)↦T.(2)\mathcal{G} : (\mathcal{M},\mathbf{z}) \mapsto T. \tag*{(2)}

For steady-state analysis, the temporal term vanishes; transient tasks instead predict the temperature evolution over a specified time horizon. S1 retains the source definitions of its steady-state and transient labels, whereas S2–S5 use HotSpot-generated steady-state labels.

Each benchmark sample is represented as (Xj,Yj)(\mathbf{X}_j,\mathbf{Y}_j), where Xj\mathbf{X}_j contains the physical variables exposed by the corresponding task and Yj\mathbf{Y}_j is the reference temperature field. Models may differ in architecture and optimization, while the benchmark fixes the data, splits, prediction targets, and evaluation metrics within each track.

Benchmark Design and Protocol

Benchmark Scope and Progressive Design

IC-ThermBench organizes thermal prediction into five deployment-oriented Generalization Scopes, rather than a universal difficulty ranking. S1 evaluates within-design prediction; S2–S4 progressively broaden the represented physical support over the same observed system families through layout, material, and boundary-condition variation; and S5 evaluates case-disjoint transfer to previously unseen package systems.

The distinction between S2–S4 and S5 is central to the benchmark. S2–S4 are independently sampled and therefore represent progressively broader training distributions rather than paired one-factor interventions. S5 instead changes the underlying package families, which may jointly shift structural properties and the empirical distribution of model inputs. We therefore call S2–S4 Within-Family Generalization: test samples come from package/system families represented during training, while their physical conditions broaden. S5 is Cross-Package OOD: all test package systems are unseen during training. Figure 1 summarizes this organization.

Overview of IC-ThermBench

Figure 1. Overview of IC-ThermBench. S1 preserves established within-design source tasks. S2–S4 evaluate Within-Family Generalization under layout, material, and boundary-condition variation over package/system families represented during training. S5 evaluates Cross-Package OOD on package systems unseen during training.

Five Generalization Scopes

Figure 1 summarizes the systems, inputs, sample counts, and primary variation of the five Scopes.

S1: established source suite. S1 consolidates the established Therm-FM source suite [9], including Alpha EV6 steady-state/transient tasks and industrial package tasks. It preserves the source task definitions and fidelity settings while using the split fixed by the current benchmark release. It serves as the benchmark’s within-design reference.

S2–S4: Within-Family Generalization. S2–S4 share the same ten ATPplace2.5D system families [29] while progressively broadening the represented physical variation. S2 varies chiplet placement and orientation; S3 additionally varies filler thermal conductivity; and S4 further varies ambient temperature and convective cooling. The three datasets are independently sampled and therefore characterize progressively broader represented distributions rather than sample-wise paired ablations.

S5: Cross-Package OOD. S5 contains five held-out package systems, Cases 11–15, that do not participate in S2–S4 training or validation. They primarily stress chiplet count, power density, size heterogeneity, power concentration, and package utilization. For example, Case 11 increases the chiplet count from a training maximum of 61 to 80, while Case 14 concentrates 90.9% of total power in one chiplet compared with a training maximum of 69.2%. The remaining held-out cases primarily stress power density, size heterogeneity, and utilization. The five held-out systems and their stress characteristics were fixed before baseline evaluation and are shared by every model and metric.

Data Generation and Input Representation

For S2–S5, feasible chiplet layouts are rasterized onto a 64×6464 \times64 grid and simulated with the open-source HotSpot thermal simulator using its grid-based detailed-3D flow. All generated tasks are steady-state, with temperature fields stored in kelvin as prediction targets. S1 instead preserves the source task definitions and fidelity settings while using the split fixed by the benchmark release.

The model input expands cumulatively with the Generalization Scope. Let P(x)P(\mathbf{x}) denote the rasterized nominal chiplet-power field, x(x)\mathbf{x}(\mathbf{x}) and y(x)\mathbf{y}(\mathbf{x}) the physical coordinates, k(x)k(\mathbf{x}) the local thermal-conductivity field, and TambT_{\mathrm{amb}}, hh, and RconvR_{\mathrm{conv}} the package-level boundary quantities. The resulting inputs are

XS2=[P,x,y],XS3=[P,x,y,k],XS4/S5=[P,x,y,k,Tamb,h,Rconv].(3)\begin{aligned} \mathbf{X}_{\mathrm{S2}} &= [P,\mathbf{x},\mathbf{y}], \\ \mathbf{X}_{\mathrm{S3}} &= [P,\mathbf{x},\mathbf{y},k], \\ \mathbf{X}_{\mathrm{S4/S5}} &= [P,\mathbf{x},\mathbf{y},k,T_{\mathrm{amb}},h,R_{\mathrm{conv}}]. \tag*{(3)} \end{aligned}

The power channel PP broadcasts each chiplet’s nominal power over the grid cells occupied by that chiplet and is therefore not a pixel-wise power-density field. The xx and yy channels encode physical coordinates in millimeters. Layouts use random, dispersed, cluster, and boundary modes in a 6:2:1:1 ratio. For S3 and above, filler thermal conductivity is sampled log-uniformly from [0.2,5.0][0.2, 5.0] W/(m·K), while chiplet silicon remains fixed at 100 W/(m·K). For S4 and S5, TambT_{\mathrm{amb}} is sampled uniformly from [25,55][25,55] °C and hh log-uniformly from [500,20000][500,20000] W/(m2^2K); RconvR_{\mathrm{conv}} is derived from hh and heatsink geometry rather than independently sampled. Complete tensor semantics and HotSpot configurations are provided with the benchmark release.

Evaluation Protocol and Metrics

For S2–S4, each case contributes 1,080/120/300 training/validation/test samples, yielding 10,800/1,200/3,000 samples per Scope. The split is case-balanced, and all normalization statistics are computed from the training subset only. Because Cases 1–10 remain represented across the split, these Scopes evaluate Within-Family Generalization under progressively broader represented physical variation.

The primary S5 protocol evaluates frozen S4 checkpoints directly on held-out Cases 11–15. These systems are excluded from training, validation, normalization fitting, and checkpoint selection, and the preprocessing pipeline remains unchanged at test time. We additionally report target-domain adaptation as an auxiliary sample-efficiency track. For each S5 case, the first 500 released samples form a fixed adaptation pool and the remaining 500 form a fixed holdout. The benchmark supplies fixed nested index sets for K∈{10,50,100,250,500}K \in\{10, 50, 100, 250, 500\}, identical for every model, amounting to 5K5K target labels in total. The K=0K = 0 adaptation baseline evaluates the frozen S4 checkpoint on this 2,500-sample holdout and is therefore distinct from the official S5 zero-shot result computed over all 5,000 samples. Normalization statistics remain frozen throughout adaptation.

We report RMSE and MAE for global field accuracy, R2R^2 for explained variation, MaxAE for the largest local error, and ETmax⁡E_{T_{\max}} and Top-50 MAE for hotspot prediction. Except for R2R^2, which is pooled over all test grid points, every metric is computed per sample and then averaged over test samples (Appendix C.4); MaxAE is thus the mean per-sample worst-pixel error. All models are compared using the same data splits, prediction targets, and evaluation metrics.

Experimental Evaluation

Experimental Setup and Baselines

We evaluate eight configurations spanning three model families: U-Net as a convolutional predictor; FNO, U-FNO, SAU-FNO, and DeepOHeat as neural-operator or operator-style models; and Therm-FM T/B/L as pretrained PDE foundation models. S1 follows the source task definitions and fidelity settings with the released benchmark split, whereas S2–S5 use the same IC-ThermBench datasets, splits, labels, input semantics, normalization, and metrics.

Fairness is enforced at the data and evaluation interfaces rather than by forcing identical optimization across heterogeneous architectures. FNO, U-FNO, SAU-FNO, U-Net, and DeepOHeat use Adam with learning rate 10−310^{-3}, batch size 20, and 100 training epochs. Therm-FM uses learning rate 1.5×10−41.5 \times10^{-4}, batch size 40, and 100 epochs. All normalization statistics are fitted using training data only and remain fixed during validation, testing, and S5 zero-shot evaluation.

All S2–S5 experiments use NVIDIA RTX A6000 48GB GPUs. When complete public training code is unavailable, we construct a paper-based reference implementation from the published architecture and available configurations and report the resulting values as reproductions rather than author-reported results. Full optimizer schedules, software versions, and implementation details are provided with the benchmark release.

ModelKey configurationParams
U-Net [22]channels 58/116/232/348; three downsampling stages5.06M
FNO [14]FNO3d; modes (12, 12, 1); width 7211.98M
U-FNO [31]Net3d; modes (10, 10, 1); width 365.10M
SAU-FNO [7]attention-augmented U-FNO; modes (10, 10, 1); width 365.11M
DeepOHeat [16]128-D coordinate trunk; 256-wide 7-layer branch7.92M
Therm-FM T/B/L [9]pretrained scOT/Poseidon checkpoints21/158/629M

Table 2. Architecture-defining configurations used in the controlled S2–S5 experiments. Parameter counts correspond to the S4/S5 seven-channel configuration where applicable.

Fixed-Design Reference and Within-Family Generalization (S1–S4)

S1 serves as a within-design performance anchor under the source Alpha EV6 and industrial-package task definitions and fidelity settings. Figure 2 presents this fixed-design anchor alongside the S2–S4 Within-Family Generalization progression. Across S2–S4, MAE and RMSE show the same gradual degradation as represented physical variation broadens. Table 3 summarizes five representative baselines at the finest reported resolution. Across convolutional/operator-style predictors, prediction errors are generally low when geometry, materials, and cooling conditions remain fixed, while the pretrained Therm-FM-L further reduces MAE across all three task groups. This establishes a within-design reference before progressively broadening the physical support in S2–S4.

S2–S4 evaluate increasingly broad physical variability while retaining the represented Cases 1–10 system families. Because the three datasets are independently generated rather than sample-wise paired, their comparison reflects increasing distributional difficulty rather than a causal ablation of individual variables. Table 4 reports global-field RMSE and MAE together with worst-pixel MaxAE and hotspot-region errors. For context, the same metrics are also shown for the S5 Cross-Package OOD evaluation.

MAE and RMSE from the S1 fixed-design anchor through S2–S4 Within-Family Generalization

Figure 2. MAE and RMSE from the S1 fixed-design anchor through S2–S4 Within-Family Generalization. All eight baselines, including Therm-FM T/B/L, are retained across the four settings. S2–S4 progressively broaden represented layout, material, and boundary-condition variation. Both panels use the same logarithmic error axis.

MethodHS steadyHS transientIndustrial
FNO0.063–0.1640.034–0.1630.017–0.018
U-FNO0.046–0.1260.011–0.1440.013
SAU-FNO0.041–0.1620.013–0.1490.020–0.026
DeepOHeat0.745–2.5850.315–1.8200.039–0.044
Therm-FM-L (629M)0.012–0.0490.004–0.0300.008

Table 3. Compact S1 source-suite summary at the finest reported resolution. Values are MAE ranges in kelvin across each task group; results are not pooled across systems or resolutions. Therm-FM values coincide with those reported in the Therm-FM study [9]; the other baselines are trained and evaluated in the current benchmark.

Across the represented system families, the best RMSE increases from 0.354 K at S2 to 0.670 K at S3 and 0.811 K at S4. The best MAE follows the same gradual trend, increasing from 0.248 to 0.493 and 0.585 K, respectively. Thus, the broader S3 and S4 distributions degrade global-field accuracy progressively rather than producing an abrupt failure.

Model ordering also changes as the represented physical support expands. Therm-FM-L is numerically best on all four reported metrics at S2 and S4, whereas U-FNO leads all four at S3, ahead of every Therm-FM variant; U-FNO also stays within roughly 1.26× of the best RMSE on every within-family Scope. Scaling Therm-FM improves accuracy monotonically at S2 and S4 but not at S3, where Therm-FM-B slightly outperforms Therm-FM-L. S4 therefore provides the within-family checkpoint from which we next evaluate transfer to unseen package families.

Cross-Package OOD and Adaptation (S5)

S5 evaluates whether the within-family performance observed in S2–S4 transfers to previously unseen package systems. We directly evaluate frozen S4 checkpoints on Cases 11–15 without target-domain labels or updated normalization statistics. Unlike the gradual degradation from S2 to S4, cross-package transfer produces a sharp performance break. Figure 3(a) shows the zero-shot RMSE, MAE, and MaxAE, while Table 4 reports the complete condensed comparison: the best RMSE increases from 0.811 K at S4 to 8.67 K at S5, approximately a 10.7× increase, while the best MAE rises from 0.585 to 8.00 K, approximately a 13.7× increase.

MethodS2: Layout RMSES2: Layout MAES2: Layout MaxAES2: Layout Top50S3: Material RMSES3: Material MAES3: Material MaxAES3: Material Top50S4: Boundary RMSES4: Boundary MAES4: Boundary MaxAES4: Boundary Top50S5: Unseen Packages RMSES5: Unseen Packages MAES5: Unseen Packages MaxAES5: Unseen Packages Top50
FNO0.8280.6213.9650.4940.9620.7204.4720.5061.2910.9945.4360.69342.17539.35865.91839.713
U-Net0.7380.5415.2730.5000.8430.6305.0200.5021.2710.9767.0170.83818.85417.37432.43218.064
U-FNO0.4440.3262.7570.2980.6700.4933.3670.3730.9390.7245.0110.57328.15427.06039.48926.647
SAU-FNO0.5340.4092.6320.4280.7080.5253.7000.4470.9530.7394.1370.68326.12125.05636.35826.902
DeepOHeat3.7062.93810.2613.6453.9703.22610.5534.8264.7393.90311.7555.92423.97323.14133.43324.078
Therm-FM-T0.5750.4103.1210.3990.9110.6794.2680.5511.0500.7944.8430.6438.6738.00315.5359.045
Therm-FM-B0.4610.3202.7090.3110.7220.5173.7170.3780.8460.6184.2600.46113.05512.33921.28615.746
Therm-FM-L0.3540.2482.1450.2380.7370.5273.7850.3900.8110.5854.0340.43115.33614.63324.08813.768

Table 4. Main IC-ThermBench results under Within-Family Generalization and Cross-Package OOD. S2–S4 progressively broaden represented physical variation over the same Cases 1–10 package families, whereas S5 evaluates held-out Cases 11–15 and is therefore reported as a separate Cross-Package OOD track. MaxAE denotes the mean per-sample worst-pixel error and Top50 denotes Top-50 MAE. All errors are in kelvin and lower is better; best results within each Scope and metric are bolded.

Figure 3. Cross-Package OOD field errors before and after target-case adaptation. (a) Official S5 zero-shot results on all 5,000 held-out samples. (b) S5 10-shot adaptation, with 10 labeled samples per held-out case, evaluated on the fixed 2,500-sample adaptation holdout. Both panels show the same five conventional/operator baselines and Therm-FM-T. RMSE and MAE measure global-field accuracy, while MaxAE is the mean per-sample worst-pixel error. Both axes are zero-based, although their ranges differ; lower is better. Complete eight-model zero-shot results remain in Table 4.

The model ranking also changes substantially. U-FNO and SAU-FNO, the strongest operator baselines under S2–S4, degrade severely on S5, and Therm-FM-L—the best S2 model—becomes the weakest Therm-FM variant here in RMSE, MAE, and MaxAE, whereas Therm-FM-T is the strongest zero-shot model despite trailing B and L within family; FNO degrades most, reaching 42.18 K RMSE. Even the best S5 result remains far above the S4 within-family accuracy. The per-case RMSE profiles are also strongly case dependent: DeepOHeat ranges from 4.79 K on Case 11 to 44.63 K on Case 14, while U-Net ranges from 3.25 K on Case 12 to 40.36 K on Case 13.

We next test whether this failure can be recovered with limited target-domain supervision. Using only K=10K = 10 labeled samples per OOD case, all eight models improve substantially, with MAE reductions of approximately 76–93%. The best MAE decreases to 1.71 K, and reaches 0.59 K at K=500K = 500; additional labels provide progressively smaller gains. Figure 3(b) additionally shows that worst-pixel errors remain several times larger than the global-field errors after 10-shot adaptation: even Therm-FM-T, which attains the lowest RMSE (2.09 K), retains a 6.70 K MaxAE.

Accuracy–Cost Trade-offs

Predictive accuracy also comes with substantially different model sizes and training costs. Table 6 compares S4 RMSE and MAE with parameter count and aggregate GPU time. Therm-FM-L achieves the strongest S4 within-family accuracy under both field metrics, at the cost of 628.4M parameters; U-FNO is the strongest operator baseline and stays within 1.16× of the best RMSE with only about 5.1M parameters. DeepOHeat is the cheapest model to train but has the highest S4 RMSE and MAE. Increasing model size yields only diminishing accuracy gains: scaling Therm-FM from B to L quadruples the parameters and increases training time by about 1.7×, yet reduces S4 RMSE by only about 4%.

MethodRMSEMAEParamsGPU·s
FNO1.2910.99412.0M1,867
U-Net1.2710.9765.06M875
U-FNO0.9390.7245.10M11,658
SAU-FNO0.9530.7395.11M22,300
DeepOHeat4.7393.9037.92M264
Therm-FM-T (21M)1.0500.79420.7M3,297
Therm-FM-B (158M)0.8460.618157.6M6,580
Therm-FM-L (629M)0.8110.585628.4M11,030

Table 6. S4 accuracy–cost comparison. RMSE and MAE are in kelvin; GPU·s is aggregate GPU time (wall time multiplied by GPU count). Lower is better for RMSE, MAE, and GPU·s.

These results further separate model capacity from predictive quality. U-FNO and SAU-FNO stay within 1.16× and 1.18× of the best S4 RMSE, respectively, at roughly 120× fewer parameters than Therm-FM-L, and scaling Therm-FM from 157.6M to 628.4M parameters yields only a marginal accuracy improvement. Together with the large variation in aggregate GPU time, this shows that S4 accuracy, model size, cross-package robustness, and computational efficiency are distinct model properties. No single architecture dominates all dimensions, motivating their separate reporting within the benchmark.

Key Findings and Implications

Finding 1: Broader represented thermal variability remains learnable. Across S2–S4, prediction errors increase gradually as represented variation in layout, material properties, and boundary conditions broadens, without the abrupt degradation observed under cross-package transfer. Implication: Within-Family Generalization should be evaluated across multiple ranges of physical variation rather than summarized by a single score.

Finding 2: Cross-package transfer challenges even the leading models. All evaluated models exhibit sharply higher global-field errors from S4 to S5. Therm-FM retains the best aggregate accuracy, but its zero-shot errors remain far above within-family levels and vary across target packages. Implication: Cross-Package OOD should remain a separate evaluation track, with both aggregate and per-case results.

MethodK=0K = 0K=10K = 10K=50K = 50K=500K = 500
U-FNO27.112.231.060.59
SAU-FNO25.172.161.080.71
FNO39.472.671.170.72
U-Net17.621.801.010.73
DeepOHeat23.155.483.062.13
Therm-FM-T (21M)8.041.711.040.72
Therm-FM-B (158M)12.422.101.240.62
Therm-FM-L (629M)14.662.481.020.67

Table 5. Target-domain adaptation on S5. Values are MAE in kelvin; KK denotes labeled samples per OOD case. K=0K = 0 uses the common adaptation holdout and is therefore slightly different from the full-set zero-shot score in Table 4.

Finding 3: Therm-FM leads most Scopes, but its advantage and scaling gains are not uniform. The Therm-FM family achieves the best global-field accuracy on S1, S2, S4, and S5, with a particularly pronounced advantage on S1, whereas U-FNO is the most accurate model on all four reported metrics at S3. The best-performing Therm-FM variant also changes with the Scope (L at S2 and S4, B at S3, T at S5), and larger models do not consistently improve accuracy. Implication: comparisons should consider Scope-specific absolute errors, relative improvements, and scaling behavior, rather than rankings or parameter counts alone.

Finding 4: Adaptation is effective but distinct from zero-shot generalization. On the common holdout, limited target-domain supervision recovers a substantial fraction of the zero-shot accuracy loss, but adapted performance no longer measures frozen cross-package transfer. Implication: zero-shot generalization and target-domain sample efficiency should be evaluated separately, with the label budget per target case reported explicitly.

Discussion and Limitations

Benchmark scope. IC-ThermBench focuses on generalization in learning-based thermal prediction. S2–S5 cover HotSpot-generated steady-state 2.5D chiplet systems, while S1 provides fixed-design steady-state, transient, and industrial-package reference tasks. Current results do not characterize all industrial package settings. Future extensions may include multi-tier 3D structures, alternative cooling technologies, transient generated tasks, and higher-fidelity data.

Data coverage density. S2–S4 broaden physical support with comparable sample counts. Their increasing errors therefore reflect the combined difficulty of broader distributions rather than the isolated effect of any added variable. Sparser coverage may also contribute to the degradation. Larger or more targeted datasets could help distinguish model limitations from insufficient data coverage.

Pretraining transfer under structural and physical variation. Therm-FM’s generally smaller relative margins on S2–S5 may reflect the shift from fixed-design prediction to broader structural and physical variation. Within each S1 task, geometry, materials, and cooling conditions remain fixed while power inputs and, for transient tasks, time vary. This fixed-domain source-to-solution setting may favor reuse of PDE-pretrained representations. In contrast, S2–S4 introduce layout, material, and boundary-condition variation, while S5 requires transfer to unseen packages. These demands may limit direct pretraining transfer, reducing Therm-FM’s relative advantage and, at S3, eliminating its lead.

This explanation remains a hypothesis: the source-suite and generated tasks also differ in task definitions and fidelity, so the observed change cannot be attributed to structural variation alone. Geometry-aware representations and pretraining over variable structures and boundary conditions merit further study.

Simulator-domain validity. Because S2–S5 use HotSpot labels, the results measure prediction and generalization within that simulation domain rather than silicon-level or signoff-level accuracy. Deployment still requires validation against higher-fidelity simulation or measurements.

Conclusion

We presented IC-ThermBench, an open benchmark for evaluating generalizable 2.5D/3D-IC thermal learning under a common evaluation contract. Five Generalization Scopes connect established 3D-IC fixed-design tasks with progressively broader layout, material, and boundary-condition variation, followed by Cross-Package OOD evaluation. Across eight representative baselines, observed physical variability remains largely learnable, whereas transfer to unseen package systems exposes a much larger generalization gap; limited target-domain supervision can recover substantial accuracy but does not replace zero-shot generalization. By providing shared data, fixed splits, input semantics, metrics, generation tools, and reproducible baselines, IC-ThermBench establishes a common foundation for developing and comparing thermal predictors beyond narrowly defined design distributions.

References

Benchmark Reporting and Fair-Comparison Contract

IC-ThermBench results are directly comparable on the primary benchmark only when they use the same dataset version, immutable splits, input and label definitions, preprocessing, normalization, and reference metrics. Training hardware, parameter count, optimization configuration, and result provenance must also be reported. Frozen zero-shot evaluation and target-domain adaptation are separate tracks, and any alternative simulator, resolution, split, preprocessing, or metric must be reported as a separate track. Table 7 summarizes the minimum reporting record.

ItemRequired record
DataVersion, case list, split hash
LabelsSimulator, version, grid, tolerances, boundary model
InputsChannel semantics, normalization, resolution handling
Zero-shotFrozen checkpoint and unchanged preprocessing
AdaptationKK per case, pool/holdout split, nested indices
MetricsRMSE, MAE, R2R^2, MaxAE, ETmax⁡E_{T_{\max}}, Top-50 MAE
OptimizationLoss, learning rate, epochs, checkpoint rule
ComputeDevice, GPU count, wall time, GPU·s, parameters
ProvenanceAuthor-reported, released-code, or reimplementation

Table 7. Minimum record for a comparable benchmark result.

Physical Formulation and Dataset Specification

Thermal Formulation

Let Ω\Omega denote the package domain, T(x,t)T(x,t) its temperature, ρ\rho the mass density, CpC_p the specific heat, kk the thermal conductivity, and QQ the volumetric heat source. The transient field obeys

ρCp∂T∂t−∇⋅(k∇T)=Qin Ω.(4)\rho C_p \frac{\partial T}{\partial t} - \nabla\cdot(k\nabla T) = Q \quad\text{in } \Omega. \tag*{(4)}

Steady-state analysis removes the temporal term. On the boundary, the reference problem may impose

T=TDon ΓD,(5)T = T_D \quad\text{on } \Gamma_D, \tag*{(5)}
−n⋅k∇T=qNon ΓN,(6)-\mathbf{n}\cdot k\nabla T = q_N \quad\text{on } \Gamma_N, \tag*{(6)}
−n⋅k∇T=h(T−Tamb)on Γh,(7)-\mathbf{n}\cdot k\nabla T = h(T-T_{\mathrm{amb}}) \quad\text{on } \Gamma_h, \tag*{(7)}

for Dirichlet, prescribed-flux, and convective conditions. Across a material interface ΓI\Gamma_I, temperature and normal heat flux remain continuous,

T−=T+,n⋅k−∇T−=n⋅k+∇T+.(8)T^- = T^+,\qquad\mathbf{n}\cdot k^-\nabla T^- = \mathbf{n}\cdot k^+\nabla T^+. \tag*{(8)}

Transient tasks additionally specify T(x,0)=T0(x)T(x,0)=T_0(x). For a fixed structural configuration M\mathcal{M}, these equations define a solution operator from power, material, boundary, and temporal variables to the temperature field. S1 preserves both steady and transient source tasks; generated S2–S5 tasks are steady state.

HotSpot Generation Configuration

All generated S2–S5 labels use the open-source HotSpot grid-based detailed-3D flow at 64 × 64 resolution. The exact executable, configuration files, layer files, units, and conversion scripts are released with the benchmark artifact. Temperatures are exported in kelvin. The six layer stack is fixed across S2–S5; only the benchmark variables listed below change.

Parameter Distributions

For S3 and above, filler conductivity is sampled log-uniformly from [0.2, 5.0] W/(m·K), while silicon remains fixed at 100 W/(m·K). For S4–S5, ambient temperature is sampled uniformly from [25, 55] °C, and the convection coefficient is sampled log-uniformly from [500, 20000] W/(m²·K). Convective resistance is derived from hh and heatsink geometry rather than sampled independently.

Input Tensor Semantics

The cumulative model inputs are

XS2=[P,x,y],(9)X_{\mathrm{S2}} = [P,x,y], \tag*{(9)}
XS3=[P,x,y,k],(10)X_{\mathrm{S3}} = [P,x,y,k], \tag*{(10)}
XS4/S5=[P,x,y,k,Tamb,h,Rconv].(11)X_{\mathrm{S4/S5}} = [P,x,y,k,T_{\mathrm{amb}},h,R_{\mathrm{conv}}]. \tag*{(11)}

The power channel PP is each chiplet’s nominal power in watts broadcast over the cells occupied by that chiplet; it is not pixel-wise power density. Coordinates are physical millimeters. Conductivity is a cell-wise material field, while TambT_{\mathrm{amb}}, hh, and RconvR_{\mathrm{conv}} are sample-global scalars broadcast over the grid. Each input channel is normalized independently using statistics fitted on the training subset only.

Converted tensors use float32, a 64 × 64 grid, and a retained singleton depth Z=1Z=1. The released S2Vs additionally retain chiplet identifiers, occupancy and edge masks, and normalized coordinates for reconstruction, but these auxiliary columns are not given to the evaluated models.

Layout Generation

Randomized layouts use random, dispersed, cluster, and boundary modes in a 6:2:1:1 ratio. Layout generation enforces package boundaries and non-overlap, varies legal position and orientation, and preserves each chiplet’s case-level nominal power and dimensions. Accepted chiplets are rasterized onto the 64 × 64 grid; occupied cells inherit chiplet identity and nominal power, while background cells remain zero. The released case manifest and generator configuration define the exact legal-layout constraints.

Independence of S2–S4

S2–S4 use the same Cases 1–10 but are generated and sampled independently. They are not paired samples to which channels are progressively added. Their comparison therefore measures progressively broader represented distributions, not a sample-wise one-factor ablation.

#Layer (bottom to top)PowerHeat capacityResistivityConductivityThickness
0SubstrateNo1.06×1061.06 \times10^{6}3.33≈0.30\approx0.30200 μm200\ \mu\mathrm{m}
1Epoxy SiO2_2 underfill + C4No2.32×1062.32 \times10^{6}0.625≈1.6\approx1.670 μm70\ \mu\mathrm{m}
2Silicon interposerNo1.75×1061.75 \times10^{6}0.01100110 μm110\ \mu\mathrm{m}
3Underfill with microbumpsNo2.32×1062.32 \times10^{6}0.625≈1.6\approx1.610 μm10\ \mu\mathrm{m}
4Chip silicon / fillerYes1.75×1061.75 \times10^{6}0.010.01 / variable100100 / 0.20.2–5.05.0150 μm150\ \mu\mathrm{m}
5TIMNo4.00×1064.00 \times10^{6}0.254.020 μm20\ \mu\mathrm{m}

Table 8. Six-layer HotSpot stack used for generated S2–S5 tasks.

ChannelS2S3S4S5 OOD
Nominal chiplet power (W)0–3000–3000–3000–280
Physical xx (mm)0–590–590–590–72.7
Physical yy (mm)0–610–610–610–72.7
kk (W/(m·K))–0.2–1000.2–1000.2–100
TambT_{\mathrm{amb}} (K)––298.2–328.1298.2–328.1
hh (W/(m2^{2}K))––500–19,990500–20,000
RconvR_{\mathrm{conv}} (K/W)––0.00087–0.20810.00059–0.1080

Table 9. Empirical model-input ranges. Dashes denote absent channels. For the cell-wise conductivity channel kk, the upper value 100 W/(m·K) comes from fixed silicon cells; only filler conductivity is sampled, over [0.2,5.0][0.2, 5.0] W/(m·K).

#ChannelUnitP=3P = 3P=4P = 4P=7P = 7Semantics
0chiplet_powerWYesYesYesNominal chiplet power broadcast over occupied cells; zero in background
1grid_xmmYesYesYesPhysical xx coordinate
2grid_ymmYesYesYesPhysical yy coordinate
3local_thermal_kW/(m·K)–YesYesCell-wise material conductivity
4ambient_KK––YesSample-global ambient temperature
5h_w_m2kW/(m2^{2}K)––YesSample-global convection coefficient
6r_convec_k_per_wK/W––YesDerived convective resistance

Table 10. Model-input channels for generated S2–S5 tasks.

SubsetPer casePer Scope
Training1,08010,800
Validation1201,200
Test3003,000

Table 11. Case-balanced split for each of S2–S4.

Splits, OOD Protocol, and Metrics

Case-Balanced S2–S4 Splits

Samples are interleaved round-robin by case. Within each case, 1,080 samples are used for training, 120 for validation, and 300 for testing, giving 10,800/1,200/3,000 samples per Scope. Normalization statistics are fitted only on the 10,800-sample training subset and remain fixed for validation and test.

Official S5 Zero-Shot Protocol

Cases 11–15 are excluded from source training, validation, normalization fitting, and checkpoint selection. The official zero-shot track evaluates the frozen S4 checkpoint on all 5,000 S5 samples with unchanged preprocessing and no target labels. Because an unseen package can shift both structure and the empirical support of model-visible coordinates or derived variables, this track is termed Cross-Package OOD, not a controlled structural-only intervention.

Target-Domain Adaptation Protocol

For each held-out case, the first 500 released samples form an adaptation pool and the final 500 form a fixed evaluation holdout. The released nested index lists define K∈{10,50,100,250,500}K \in\{10, 50, 100, 250, 500\} labels per case, so the total target-label budget is 5K5K. Each run starts from the frozen S4 checkpoint, reinitializes the optimizer, retains the source normalization, and fine-tunes for 50 epochs. Non-Therm-FM models use Adam with learning rate 10−410^{-4}, weight decay 10−410^{-4}, and batch size 20; Therm-FM uses 1.5×10−51.5 \times10^{-5}, one tenth of its training rate. The reported tables use the epoch-50 checkpoint.

CasePrincipal stressDifference from Cases 1–10
11Chiplet count80 chiplets versus a training maximum of 61; utilization is reduced to 32% for feasible generation
12Power density0.85 W/mm2^{2} versus a training maximum of 0.745 W/mm2^{2}
13Size heterogeneityOne 42 × 16 mm die plus 24 micro-chiplets of 2–2.6 mm
14Power concentrationOne chiplet contributes 90.9% of total power versus a training maximum of 69.2%
15Package utilization68.1% utilization versus a training maximum of 67.1%

Table 12. Principal stress characteristics of held-out S5 systems. Each case primarily stresses the listed attribute but is not a strict single-factor intervention.

ModelConfigurationP=3P = 3P=4P = 4P=7P = 7
U-FNONet3d; modes (10, 10, 1); width 365,103,9055,103,9415,104,049
SAU-FNOSAUNet3d; modes (10, 10, 1); width 365,107,9015,107,9375,108,045
FNOFNO3d; modes (12, 12, 1); width 7211,974,72111,974,79311,975,009
U-NetChannels (58, 116, 232, 348); three max-pools; nearest-neighbor upsampling; skip connections; no BN/dropout5,060,0375,060,5595,062,125
DeepOHeatFrozen 128-D Gaussian Fourier coordinate trunk; 128-wide 3-layer SiLU trunk; flattened-input 256-wide 7-layer branch; inner product + bias3,721,9854,770,5617,916,289
Therm-FM T/B/LscOT/Poseidon pretrained checkpoints21M / 158M / 629M (paper-reported)

Table 13. Model configurations and input-dependent parameter counts for S2–S4 (P=3/4/7P = 3/4/7).

The adaptation curve’s K=0K = 0 value is the frozen checkpoint evaluated on the common 2,500-sample holdout. It therefore differs slightly from the official zero-shot score, which uses all 5,000 S5 samples.

Metric Definitions

For sample jj, let dj,i=T^j,i−Tj,id_{j,i} = \hat{T}_{j,i} - T_{j,i} at grid location ii. The per-sample field metrics are

MAEj=1N∑i∣dj,i∣,RMSEj=1N∑idj,i2,(12)\mathrm{MAE}_{j} = \frac{1}{N} \sum_i |d_{j,i}|,\qquad\mathrm{RMSE}_{j} = \sqrt{\frac{1}{N} \sum_i d_{j,i}^{2},} \tag*{(12)}
MaxAEj=max⁡i∣dj,i∣,ETmax,j=∣max⁡iT^j,i−max⁡iTj,i∣.(13)\mathrm{MaxAE}_{j} = \max_i |d_{j,i}|,\qquad E_{\mathrm{Tmax},j} = \left|\max_i \hat{T}_{j,i} - \max_i T_{j,i}\right|. \tag*{(13)}

Top-50 MAE is the mean absolute error over the 50 hottest locations selected from the ground-truth field. The predicted and true maxima need not occur at the same location for ETmaxE_{\mathrm{Tmax}}. MAE, RMSE, MaxAE, ETmaxE_{\mathrm{Tmax}}, and Top-50 MAE are computed per sample and then averaged arithmetically over the test samples; the reported MaxAE is therefore the mean per-sample worst-pixel error rather than the single worst pixel of the whole test set. For multi-layer fields (S1), each metric is first averaged over the layers of a sample. All eight baselines share one metric implementation. The benchmark R2R^{2} pools all samples and grid locations,

R2=1−∑j,i(T^j,i−Tj,i)2∑j,i(Tj,i−Tˉ)2.(14)R^{2} = 1 - \frac{\sum_{j,i}(\hat{T}_{j,i} - T_{j,i})^{2}}{\sum_{j,i}(T_{j,i} - \bar{T})^{2}}. \tag*{(14)}

Baseline and Training Details

Baseline Architectures

Because Z=1Z = 1, the third Fourier mode count is one. Increasing the channel count changes only the input layer for convolutional and Fourier baselines, but substantially enlarges DeepOHeat’s flattened branch.

Optimization Configuration

All evaluated methods are label-supervised. For DeepOHeat this differs from the original residual-only training formulation and keeps the benchmark question fixed: given identical simulated labels, which model best predicts the temperature field? FNO, U-FNO, SAU-FNO, U-Net, and DeepOHeat use the final-epoch checkpoint with early stopping disabled; Therm-FM retains the validation-best checkpoint selected by its scOT training pipeline.

Software and Hardware

Experiments use NVIDIA RTX A6000 48GB GPUs and an AMD EPYC 7543 CPU with PyTorch 2.0.1 and CUDA 11.8. All baselines use a single GPU. Wall time covers model training only and excludes one-time HotSpot generation, format conversion, checkpoint download, and manual hyperparameter exploration.

Executable Interface and Model Extension

The anonymized benchmark artifact accompanying this submission exposes one entry point for training. Within-Family Generalization testing, frozen Cross-Package OOD evaluation, and target-case adaptation.

SettingFNO/U-FNO/SAU-FNO/U-Net/DeepOHeatTherm-FM T/B/L
OptimizerAdamAdam
Learning Rate10−310^{-3}1.5×10−41.5 \times10^{-4} (embedding: 1.5×10−31.5 \times10^{-3})
Weight decay10−410^{-4}10−610^{-6}
ScheduleStepLR(step 2, γ=0.9\gamma= 0.9)Cosine; zero warmup
Batch size2040
Epochs100100
ObjectiveNormalized-space MSEscOT configured MSE; max grad norm 5
CheckpointFinal epochValidation-best
HardwareOne RTX A6000 48GBOne RTX A6000 48GB

Table 14. Training configuration. All normalizers are fitted on training data only and applied per channel.

Every method is adapted to the same repository-level tensor contract: each sample pairs a PP-channel input field with a temperature field on the same 64×64×Z64 \times64 \times Z grid, where the current generated release uses Z=1Z = 1 and P∈{3,4,7}P \in\{3, 4, 7\}. A conventional PyTorch model needs only an implementation and a registry entry that declares its recipe and channel-dependent constructor; the shared runner then supplies the immutable split, normalization, six metrics, JSON output, and S5 adaptation loop. Adding a conventional PyTorch baseline requires one implementation file and one short MODEL_ZOO entry containing its metric prefix, optimizer recipe, adaptation rate, and a constructor that receives PP, ZZ, and grid size. Models with custom training stacks use the same tensor and metric contracts through a separate adapter.

This interface separates architecture-specific tensor conversion and optimization from benchmark-controlled data and evaluation. A released result can therefore be regenerated with the same sample identifiers and metric implementation, while a new model can be compared without copying or silently modifying the evaluation code.

S1 Source-Suite Results

S1 comprises eleven fixed-design source tasks, including steady-state and transient Alpha EV6 configurations and two industrial packages. Table 3 summarizes the S1 results: the Therm-FM values coincide with those reported in the Therm-FM study [9], whereas the other baselines are trained and evaluated in the current benchmark. Per-task tables are omitted for conciseness.

Qualitative observations. Figure 4(a) shows that the selected Therm-FM results preserve the global temperature distribution and dominant hotspot locations across the three HotSpot cases and two industrial packages; the visible residuals remain localized mainly near sharper thermal transitions. Panel (b) shows close agreement through the sampled transient steps for HS-SC and HS-OC, including the temperature rise and spatial diffusion from 0 to 8 ms. These observations are qualitative and refer only to the source Therm-FM visualizations; the corresponding quantitative results are reported in the Therm-FM study cited above.

Qualitative S1 visualizations showing steady-state and transient ground-truth, prediction, and error results for HS-SC, HS-QC, HS-OC, IND-8C, and IND-32C

Figure 4. Qualitative S1 visualizations reproduced directly from the best-performing Therm-FM source configurations [9]; they were not regenerated for this paper.

Complete Within-Family Generalization Results (S2–S4)

The main paper retains four metrics per Scope to expose the central trend: RMSE and MAE for global field accuracy, together with worst-pixel MaxAE and Top-50 MAE. Tables 15–17 restore all six reported metrics for every baseline. The datasets are independently generated under a common case-balanced protocol; the progression should therefore be read as increasing represented-distribution difficulty, not as a paired causal ablation on the same samples.

Reading S2. Therm-FM L leads all six metrics, with U-FNO and Therm-FM B close behind on the global field errors; among the operator baselines U-FNO leads SAU-FNO on every metric except MaxAE, and model scale helps Therm-FM monotonically here. DeepOHeat trails by a wide margin. U-Net ranks lower on the worst-pixel and hotspot-region errors (MaxAE and Top-50 MAE) than on global RMSE, which also illustrates why hotspot-region and field-wide errors should be reported together.

Reading S3: Material. U-FNO leads all six metrics once conductivity becomes an explicit input field, ahead of SAU-FNO and every Therm-FM variant. The best RMSE rises by about 89% relative to S2, yet the best R2R^2 remains above 0.998, so represented material variation increases difficulty without causing a generalization break. Model scale is still not a reliable predictor: Therm-FM L does not improve over Therm-FM B here.

Metric-wise behavior across represented support. The six metrics expose a stable distinction between reconstructing the full field and tracking the thermally critical region. SAU-FNO is never the best global predictor, yet its MaxAE is the second best on every within-family Scope; a deployment concerned mainly with bounding the worst-case local error could therefore reach a different model choice from one that requires an accurate temperature field everywhere. Conversely, DeepOHeat’s global and hotspot errors deteriorate together as input dimensionality grows, suggesting that its present flattened branch is a limiting factor under the 64×6464 \times64 representation rather than a metric-specific failure. U-FNO and SAU-FNO remain comparatively balanced across all six criteria.

Implication for progressive evaluation. No architecture should be described as generally superior from one Scope. The leading model changes with the Scope (Therm-FM L at S2 and S4, U-FNO at S3), the best Therm-FM variant switches from L to B at S3, and — as S5 shows next — the best within-family model is not the best cross-package one. This is informative: the configuration that best absorbs represented placement, material, and boundary variation need not be the one that transfers to unseen packages. The progression therefore functions as a capability profile rather than a single scalar leaderboard. The first Scope at which error rises sharply indicates where performance begins to degrade as broader physical variation is introduced.

Reading S4: Boundary. Therm-FM L leads all six metrics, with U-FNO the strongest operator baseline on the global-field errors and SAU-FNO on MaxAE. Relative to S2, the best RMSE increases by roughly 2.3×2.3\times, while the best peak-temperature error stays below 0.5 K. The distinction matters for deployment: a predictor may be sufficiently accurate for thermal-limit screening even when its full-field error has increased. Most importantly, this moderate within-family degradation is qualitatively smaller than the case-disjoint failure reported next.

MethodRMSEMAER2R^2MaxAEETmax⁡E_{T_{\max}}Top-50 MAE
FNO0.96190.72000.99674.47180.48260.5059
U-Net0.84320.63020.99755.02030.47530.5017
U-FNO0.67000.49280.99843.36690.33120.3730
SAU-FNO0.70780.52550.99823.69970.40800.4466
DeepOHeat3.96993.22590.943710.55323.56314.8260
Therm-FM T0.91050.67870.99684.26790.49890.5507
Therm-FM B0.72150.51650.99803.71710.33780.3781
Therm-FM L0.73660.52680.99793.78480.34360.3904

Table 16. Complete S3 Material results under Within-Family Generalization.

Complete Cross-Package OOD and Adaptation Results

This section reports the complete S5 results behind the condensed main-paper discussion. The official zero-shot test takes each baseline’s frozen S4 checkpoint, trained under the full seven-channel material-and-boundary protocol, and evaluates it directly on all 5,000 samples from held-out cases C11–C15, without using those cases for training, validation, normalization, or checkpoint selection. No S5-specific training is performed; the model, its input schema, and its normalization statistics are exactly those of S4. It is therefore a Cross-Package OOD test rather than an isolated single-parameter extrapolation.

The aggregate and per-case views answer complementary questions. The aggregate table measures expected performance over the released stress set and supports a compact leaderboard. The per-case table reveals whether that average reflects consistent transfer or success on one system offsetting failure on another. We report both because the five held-out systems stress different combinations of chiplet count, die outline, size mixture, power density, power concentration, and utilization; they are not repeated samples from one homogeneous OOD population.

The official zero-shot record also remains separate from the K=0K = 0 adaptation baseline below. The former evaluates all 5,000 released S5 samples; the latter evaluates the common 2,500-sample holdout reserved for comparing label budgets. Mixing these denominators would make an apparent adaptation gain partly a test-set change. Keeping both records visible makes the zero-shot-to-few-shot transition auditable.

No single baseline dominates every held-out package. Therm-FM T wins the pooled six-metric comparison and is the best model on C14 and C15, but its advantage comes mainly from comparatively balanced errors (6.3–11.2 K on every case) rather than from winning every case: Therm-FM B is best on C11 and C13 and U-Net on C12, showing that the aggregate OOD gap combines several distinct package-level shifts. DeepOHeat is also strong on the high-chiplet-count C11 case (4.79 K) but degrades on C12, C14, and C15; SAU-FNO and U-Net show the opposite kind of specialization, with their lowest errors on the high-power-density C12 case. Moreover, larger Therm-FM variants transfer progressively worse on five of the six metrics (all but Top-50 MAE): zero-shot RMSE rises from 8.67 K (T) to 13.06 K (B) and 15.34 K (L). These ranking reversals show that strong within-family accuracy under represented physical variation does not imply robust cross-package generalization.

Target-Case Adaptation

For each held-out case, adaptation uses the released fixed nested index sets for K∈{10,50,100,250,500}K \in\{10, 50, 100, 250, 500\} samples from a 500-sample adaptation pool (identical for every model) and evaluates on the separate 500-sample holdout. Counts are per case, so K=10K = 10 uses 50 labels in total. The K=0K = 0 column below evaluates the frozen checkpoint on the same common 2,500-sample holdout; it is not a replacement for the official 5,000-sample zero-shot result in Table 18.

MethodRMSEMAER2R^2MaxAEETmaxE_{\mathrm{Tmax}}Top-50 MAE
FNO42.175539.3575-1.642965.918259.921539.7131
U-Net18.854217.37390.377632.432024.018918.0644
U-FNO28.153827.0604-0.239939.489431.627426.6474
SAU-FNO26.120825.0555-0.123936.358031.793426.9022
DeepOHeat23.973523.14090.075933.433025.621624.0784
Therm-FM T8.67298.00290.910115.534710.45229.0454
Therm-FM B13.055412.33900.692121.286416.742015.7459
Therm-FM L15.336114.63250.683524.087617.117513.7678

Table 18. Complete zero-shot results on the official S5 test set. All error metrics are in kelvin; higher R2R^2 is better and lower is better for the other metrics.

Controlled adaptation comparison. Every run starts from its released S4 checkpoint, retains the source normalizers, reinitializes only the optimizer, and trains for 50 epochs. The target holdout is never used to fit normalization or update weights. The non-Therm-FM models use their registered adaptation rate of 10−410^{-4} and batch size 20; Therm-FM uses 1.5×10−51.5 \times10^{-5}, one tenth of its training rate, because the larger rate used by the operator baselines is unstable for its pretrained stack. These choices preserve architecture-appropriate optimization while holding the data, labels, split membership, metric code, and final-checkpoint rule fixed.

Reading the label budget. KK is defined per held-out system rather than as one pooled count. Thus K=10K = 10 means 50 labels in total and guarantees that even the smallest budget observes every target case. This protocol tests low-cost target supervision, not zero-shot generalization, and the two results must not be conflated. A method that improves the frozen S5 score addresses cross-package transfer, whereas one that reaches a lower adapted score with the same KK addresses target-domain sample efficiency. The complete curve is required because those rankings need not agree.

The complete tables reinforce two points hidden by RMSE alone. First, the best model changes with both label budget and metric: Therm-FM T leads all six metrics at K=0K = 0 and all but Top-50 MAE at K=10K = 10, where U-Net leads; at K=50K = 50 the lead is split between Therm-FM L (RMSE and MaxAE) and U-Net (MAE, ETmaxE_{\mathrm{Tmax}}, and Top-50 MAE), with the two tied on R2R^2; at K=100K = 100 Therm-FM L co-leads RMSE with U-FNO and leads every other metric except Top-50 MAE (U-Net); and at K≥250K \ge250 the operator baselines take over the global-field metrics (SAU-FNO at K=250K = 250, tied with Therm-FM L on R2R^2; U-FNO at K=500K = 500) and SAU-FNO shows the worst-pixel error, while the hotspot-oriented metrics are led by Therm-FM B at K=250K = 250 and Therm-FM L at K=500K = 500. Second, the first 10 labels per case recover most of the global correlation (R2>0.92R^2 > 0.92 for every model), but worst-pixel errors remain several kelvin and improve more slowly.

MethodK=0K = 0K=10K = 10K=50K = 50K=100K = 100K=250K = 250K=500K = 500
U-FNO28.192.651.291.061.100.76
SAU-FNO26.232.561.321.200.860.90
FNO42.273.301.471.241.010.92
U-Net19.102.261.291.210.950.93
DeepOHeat23.986.223.693.282.912.71
Therm-FM T8.712.091.321.100.920.92
Therm-FM B13.132.451.481.180.990.81
Therm-FM L15.362.881.271.060.920.86

Table 20. RMSE (K) after target-case adaptation. Each KK is the number of labeled adaptation samples per held-out case.

Method01050100250500
U-FNO27.112.231.060.860.920.59
SAU-FNO25.172.161.080.980.690.71
FNO39.472.671.170.980.800.72
U-Net17.621.801.010.970.750.73
DeepOHeat23.155.483.062.672.342.13
Therm-FM T8.041.711.040.870.710.72
Therm-FM B12.422.101.240.960.810.62
Therm-FM L14.662.481.020.850.720.67

Table 21. Complete target-case adaptation results for (a) MAE (K) and (b) pooled R2R^2. Each KK is the number of labels per held-out case. (a) MAE (K); lower is better.

Method01050100250500
U-FNO-0.29570.98890.99770.99850.99850.9993
SAU-FNO-0.17940.98970.99740.99800.99900.9990
FNO-1.75810.98750.99760.99830.99880.9990
U-Net0.33360.99380.99800.99830.99890.9990
DeepOHeat0.03610.92560.97840.98420.98830.9899
Therm-FM T0.90560.99460.99790.99850.99890.9989
Therm-FM B0.67380.99230.99710.99820.99870.9992
Therm-FM L0.66980.98890.99800.99860.99900.9990

Table 21. (b) Pooled R2R^2; higher is better.

Method01050100250500
U-FNO39.508.685.945.214.924.47
SAU-FNO36.497.874.864.553.713.66
FNO66.0310.915.594.714.023.82
U-Net32.689.427.406.855.975.54
DeepOHeat33.4912.579.348.828.218.12
Therm-FM T15.606.705.284.844.454.49
Therm-FM B21.347.085.154.664.344.45
Therm-FM L24.167.964.814.394.244.24

Table 22. Complete target-case adaptation results for (a) per-sample MaxAE and (b) peak-temperature error ETmax⁡E_{T\max}, both in kelvin. (a) MaxAE; lower is better.

Method01050100250500
U-FNO31.683.071.331.010.940.82
SAU-FNO31.943.161.721.290.861.16
FNO60.103.031.471.350.870.88
U-Net24.412.481.231.060.930.92
DeepOHeat25.626.784.123.903.483.28
Therm-FM T10.532.391.551.240.920.99
Therm-FM B16.822.901.451.090.770.77
Therm-FM L17.213.211.260.930.830.65

Table 22. (b) ETmax⁡E_{T\max}; lower is better.

MethodK=0K = 0K=10K = 10K=50K = 50K=100K = 100K=250K = 250K=500K = 500
U-FNO26.653.151.491.120.990.88
SAU-FNO26.993.321.891.450.951.20
FNO39.863.301.751.490.981.02
U-Net18.392.241.281.021.000.91
DeepOHeat24.086.764.614.213.753.59
Therm-FM T9.082.371.641.371.101.08
Therm-FM B15.773.051.711.400.910.95
Therm-FM L13.782.961.451.040.980.86

Table 23. Complete Top-50 MAE (K) under target-case adaptation. The metric is computed at the 50 hottest ground-truth locations of each sample.

Figure 5. Target-case adaptation on S5 for all six benchmark metrics. KK is the number of labeled samples per held-out case (K=0K = 0 is the frozen S4 checkpoint on the common holdout); error metrics use a logarithmic axis. The steep improvement at the first few labeled samples is consistent across model families, while the remaining gaps depend on the error criterion.

Optimization record. All adaptation tables use the final checkpoint after the same 50-epoch budget and evaluate every five epochs. The release stores the intermediate JSON records so that convergence and checkpoint-selection studies can be reconstructed without changing the official final-checkpoint comparison. The appendix freezes the complete final-checkpoint numbers for the eight registered baselines; intermediate traces remain machine-readable rather than being summarized by an additional, potentially redundant figure.

Training Cost and Efficiency Details

Table 24 reports model-training cost under the same released splits and hardware protocol. Wall time measures the standard training run, while GPU-s multiplies wall time by the number of GPUs and is included only to expose aggregate accelerator occupancy. Neither quantity includes one-time HotSpot label generation, data conversion, checkpoint download, or manual hyperparameter exploration.

MethodParams.S2 Wall (s)S2 GPU-sS3 Wall (s)S3 GPU-sS4 Wall (s)S4 GPU-s
FNO11.98M184418441857185718671867
U-Net5.06M845845841841875875
U-FNO5.10M116031160311606116061165811658
SAU-FNO5.11M221932219322299222992230022300
DeepOHeat7.92M194194228228264264
Therm-FM T20.75M319531953245324532973297
Therm-FM B157.63M628362836330633065806580
Therm-FM L628.38M107821078210806108061103011030

Table 24. Parameter count and training cost across S2–S4. GPU-s is wall time multiplied by GPU count and should not be read as hardware-normalized throughput. All methods use a single GPU, so wall time and GPU-s coincide.

The table is intended for reproducibility, not for ranking architecture efficiency across different accelerators. All baselines run on a single GPU, so wall time and aggregate GPU-s coincide here.

DeepOHeat has the shortest wall time but also the largest errors across the S2–S4 within-family evaluations, so speed alone is not a sufficient selection criterion. Among the strong Fourier baselines, U-FNO is substantially cheaper than SAU-FNO under the recorded recipe, and it is also more accurate on the global-field errors of every within-family Scope; SAU-FNO’s additional attention cost mainly buys a lower worst-pixel error at S2 and S4. Therm-FM T has a modest wall time; the B and L variants increase aggregate accelerator use by about 2.0× and 3.3× at S4, improve within-family accuracy over T on every within-family Scope (although L does not improve over B at S3), and transfer worse in frozen OOD evaluation. These comparisons motivate reporting error, wall time, GPU count, and parameter scale together.

Cost-accounting boundary. The measured interval begins with the first optimizer update and ends after the final training epoch. It excludes one-time case generation, HotSpot label production, CSV-to-tensor conversion, checkpoint download, and manual hyperparameter exploration. Label generation is excluded because it is a dataset-production cost shared by all fully supervised models; for target adaptation it becomes a deployment-specific cost and should be reported separately. This boundary makes the model-training numbers reproducible without presenting them as end-to-end system latency.

Why wall time and GPU-s are both retained. Wall time approximates machine turnaround on the recorded machine, whereas GPU-s exposes aggregate occupancy. Neither is hardware-normalized throughput: four-GPU execution can reduce elapsed time while increasing total accelerator use, and different kernels exploit the RTX A6000 differently. A new result should therefore state device model, GPU count, precision, software stack, epoch count, batch size, and parameter count alongside both measures. When hardware changes, the released commands and output schema remain comparable even if raw timing does not.

Accuracy–cost selection. The table supports deployment choices rather than one universal efficiency rank. A fast screening loop may prefer U-Net despite lower accuracy; a Within-Family Generalization study may justify the additional cost of U-FNO or SAU-FNO; and a pretrained Therm-FM checkpoint may be attractive when S1 accuracy is central. Cross-Package OOD remains the decisive caveat: none of the cost advantages makes the frozen S5 errors operationally small, so adaptation label and optimization costs must be included whenever few-shot recovery is part of the intended workflow.

Generated-Scope Visualizations

Figure 6–Figure 10 show representative predictions for S2–S5 using the models specified in the corresponding captions, in the same format as the S1 visualizations (Figure 4). For S2–S4, columns correspond to Cases 1, 3, 5, 7, and 9 from each Scope’s own test split. For S5, columns correspond to Cases 11–15 under zero-shot evaluation and after target-case adaptation using K=100K = 100 labeled samples per case. Each column shows the median-RMSE sample within that case for the displayed model and evaluation setting. Ground truth and prediction share the temperature scale above each column, with out-of-range predictions clipped for visualization; the absolute-error panel uses a separate scale below.

Figure 6. S2 visualization with U-FNO. Columns correspond to Cases 1, 3, 5, 7, and 9, with the median-RMSE test sample shown for each case. Rows show ground truth, prediction, and absolute error in kelvin.

Figure 10. S5 visualization with U-FNO after target-case adaptation using K=100K = 100 labeled samples per case. Columns correspond to Cases 11–15, with the median-RMSE sample of each case shown from the common 2,500-sample holdout. Rows show ground truth, prediction, and absolute error in kelvin. The adapted predictions recover the global temperature structure on all five cases, including the scattered micro-chiplet hot spots of Case 13.

Reading S2–S4. Within the represented system families the predicted fields are visually indistinguishable from the HotSpot ground truth at the scale of the figure. The residual error is not spatially uniform: it concentrates along chiplet boundaries, where the temperature gradient is steepest, and at the corners of high-power dies, while the package interior and the background are reproduced to a fraction of a kelvin. Adding the material channel (S3) and the boundary channels (S4) raises the error scale at the worst pixel from roughly 1.7–2.9 K (S2) to 1.9–4.3 K (S3) and 6.1–9.1 K (S4); at S4 this worst pixel lies at a grid corner in every displayed sample. The error pattern keeps the same edge-localized character, and the additional physics is absorbed rather than breaking the predictor. These are the same median samples whose Scope-level averages appear in Table 15–Table 17.

MethodRMSEMAER2R^2MaxAEETmax⁡E_{T_{\max}}Top-50 MAE
FNO0.82840.62070.99773.96520.46670.4943
U-Net0.73750.54120.99835.27310.44920.4996
U-FNO0.44420.32650.99942.75720.29750.2978
SAU-FNO0.53360.40860.99912.63180.37790.4282
DeepOHeat3.70552.93760.959310.26082.83083.6447
Therm-FM T0.57520.41020.99863.12070.36910.3992
Therm-FM B0.46100.31980.99902.70910.28700.3114
Therm-FM L0.35360.24770.99952.14480.21640.2378

Table 15. Complete S2 Within-Family Generalization results under represented layout variation. Errors are in kelvin; higher R2R^2 is better and lower is better for all other metrics.

MethodRMSEMAER2R^2MaxAEETmax⁡E_{T_{\max}}Top-50 MAE
FNO1.29120.99390.99775.43620.63610.6929
U-Net1.27130.97640.99787.01740.81830.8383
U-FNO0.93910.72370.99885.01060.51800.5727
SAU-FNO0.95320.73940.99884.13660.65040.6826
DeepOHeat4.73943.90330.969911.75464.79505.9236
Therm-FM T1.04960.79400.99854.84320.59890.6426
Therm-FM B0.84620.61800.99904.25980.40950.4614
Therm-FM L0.81130.58520.99914.03450.36960.4314

Table 17. Complete S4 Boundary results under Within-Family Generalization.

Reading S5 zero-shot. Figure 9 shows the strongest frozen model, Therm-FM T, and it is still qualitatively wrong on four of the five compound cross-package OOD cases. The failure is structural rather than numerical: on Case 11 the hot center of the 80-chiplet array is missed almost entirely and the field is predicted near the bottom of the temperature range, on Case 12 only part of the hot region is recovered, on Case 13 the scattered micro-chiplets are merged into a single saturated hot plateau, and on Case 15 the stacked dies collapse into one oversized hot block. Case 14 is the exception: the hot spot of the dominant chiplet is predicted with the correct position and footprint, but the heat spreading around it is overestimated, leaving a ring-shaped error. The error maps reach 10–21 K and follow the misplaced structures instead of the chiplet edges. This is the visual counterpart of the order-of-magnitude jump in Table 18: a predictor that is accurate across diverse layouts, materials, and cooling conditions of the represented families does not carry a usable thermal mapping to an unseen package structure, and no baseline in the benchmark is exempt from this.

Figure 9. S5 zero-shot visualization with Therm-FM T, the lowest-RMSE frozen model, on the held-out Cases 11–15 without target labels (the median-RMSE sample of each case). The predictor misses, merges, or inflates hot regions in four of the five unseen packages, matching the structural failure quantified in Table 19.

MethodCase11Case12Case13Case14Case15
U-FNO59.796.2115.6819.1739.91
SAU-FNO55.464.7137.189.8823.38
FNO94.5820.0250.9620.1925.12
U-Net16.173.2540.3617.4417.05
DeepOHeat4.7920.7610.0144.6339.69
Therm-FM T8.429.9411.177.506.33
Therm-FM B4.4815.339.0318.0718.36
Therm-FM L6.1513.0512.7618.8025.92

Table 19. Per-case RMSE (K) on the official S5 zero-shot test. The best value in each held-out case is bold.

Reading S5 after adaptation. Figure 10 applies the same protocol to U-FNO, the strongest operator baseline at K=100K = 100, after 100 labeled samples per OOD case. With 500 target labels in total, the global thermal feature is recovered on all five packages: the chiplet array of Case 11, the hot region of Case 12, the dominant die of Case 14, and the stacked dies of Case 15 are placed and scaled correctly, and the scattered micro-chiplets of Case 13 largely reappear as separate hot spots at the correct positions. The error scale drops from 10–21 K to 3.5–5.8 K at the worst pixel and to below one kelvin over most of the field. The remaining residuals are again edge-localized, approaching the error pattern observed in the S2–S4 within-family evaluations; Case 12, which reaches the highest temperatures, retains the largest residual (1.93 K case-mean RMSE, versus 0.74–0.89 K on the other four cases). Target-case adaptation is therefore a practical remedy for cross-package OOD failure—limited target-domain labels can move an otherwise poor zero-shot prediction substantially toward the S2–S4 accuracy regime—but this recovery requires target labels and is reported separately from, not as a substitute for, zero-shot cross-package generalization.

Benchmark Extension Protocol

IC-ThermBench reduces extension effort through reusable data and model interfaces. New datasets compatible with the current tensor representation and split convention can be supplied as input/output MAT pairs and selected by dataset name, reusing the shared loading, normalization, and evaluation routines. A conventional PyTorch predictor requires a model implementation and a MODEL_ZOO entry to use the shared training and evaluation pipeline, rather than a separate model-specific workflow.

Extensions involving new simulators, measurements, or temporal representations may require task-specific conversion, configuration, or adapters, but can build on these shared interfaces. Each extension should publish its case manifest, channel semantics, label provenance, fixed split identifiers, and reference metrics, and specify whether it broadens a Generalization Scope or defines a separate domain-shift track, while preserving the primary benchmark tracks.

Figure 7. S3 visualization with U-FNO. Columns correspond to Cases 1, 3, 5, 7, and 9, with the median-RMSE test sample shown for each case. Rows show ground truth, prediction, and absolute error in kelvin.

Figure 8. S4 visualization with U-FNO. Columns correspond to Cases 1, 3, 5, 7, and 9, with the median-RMSE test sample shown for each case. Rows show ground truth, prediction, and absolute error in kelvin.

References

  1. [1]Zhuomin Chai, Yuxiang Zhao, Wei Liu, Yibo Lin, Runsheng Wang, and Ru Huang. 2023. CircuitNet: An Open-Source Dataset for Machine Learning in VLSI CAD Applications with Improved Domain-Specific Evaluation Metric and Learning Strategies. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 42, 12 (2023), 3504–5047. doi:10.1109/TCAD.2023.3287970DOI
  2. [2]Liang Chen, Wentian Jin, and Sheldon X.-D. Tan. 2022. Fast Thermal Analysis for Chiplet Design Based on Graph Convolution Networks. In 27th Asia and South Pacific Design Automation Conference. 485–492.DOI
  3. [3]Vidya A. Chhabria, Vipul Ahuja, Ashwath Prabhu, Nikhil Patil, Palkesh Jain, and Sachin S. Sapathnerkar. 2021. Thermal and IR Drop Analysis Using Convolutional Encoder-Decoder Networks. In 26th Asia and South Pacific Design Automation Conference. 690–696. doi:10.1145/3354885.3431583arxiv.org/abs/2009.09009
  4. [4]Animesh Basak Chowdhury, Benjamin Tan, Ramesh Karri, and Siddharth Garg. 2021. OpenABC-D: A Large-Scale Dataset for Machine Learning Guided Integrated Circuit Synthesis. arXiv:2110.11292 [cs.LG]. https://arxiv.org/abs/2110.11292
  5. [5]Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Miami, FL, USA, 248–255. doi:10.1109/CVPR.2009.5206848DOI
  6. [6]Yue Hua, Zhi-Qiao Wang, Xin-Yi Yuan, Yu Bai Li, Wei-Tao Wu, and Nadine Aubry. 2023. Estimation of Steady-State Temperature Field in Multichip Modules Using Deep Convolutional Neural Network. Thermal Science and Engineering Progress 40 (2023), 101755. doi:10.1016/j.tsep.2023.101755
  7. [7]Zhen Huang, Hangyang Wen, Wenkai Yang, Muxi Tang, Depeng Xie, Ting-Jung Lin, Yu Zhang, Wei W. Xing, and Lei He. 2025. Self-Attention to Operator Learning-Based 3D-IC Thermal Simulation. In 62nd ACM/IEEE Design Automation Conference. 263:1–263:7. doi:10.1109/DAC63849.2025.1132988arxiv.org/abs/2510.15968
  8. [8]Zhen Huang, Haiyang Xin, Dongming Jiang, Yangbo Wei, Hong Wang, Wenkai Yang, Yu Zhang, Wei W. Xing, Ting-Jung Lin, and Lei He. 2026. From Fluid Dynamics to Chip Design: PDE Foundation Model Address Data Bottleneck in 3D-ICs Thermal Simulation. In 63rd ACM/IEEE Design Automation Conference. doi:10.1145/3770743.3803993
  9. [9]Zhen Huang, Haiyang Xin, Wenkai Yang, Yangbo Wei, Zhiping Yu, Yu Zhang, Wei W. Xing, Ting-Jung Lin, and Lei He. 2026. Therm-FM: Foundation Model Is All You Need for 3D-ICs Thermal Simulation. arXiv:2605.022663
  10. [10]Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R. Narasimhan. 2024. SWE-bench: Can Language Models Resolve Real-World GitHub Issues? In International Conference on Learning Representations. OpenReview.net, Vienna, Austria, 24 pages. https://openreview.net/forum?id=VTF8yNQM66
  11. [11]Wentian Jin, Sherrif Sadiqbatcha, Jinwei Zhang, and Sheldon X.-D. Tan. 2020. Full-Chip Thermal Map Estimation for Commercial Multi-Core CPUs with Generative Adversarial Learning. In IEEE/ACM International Conference on Computer-Aided Design. doi:10.1145/3400302.3415764DOI
  12. [12]Scott Ladenheim, Yi-Chung Chen, Milan D. Mihajlovic, and Vasilis F. Pavlidis. 2018. The MTA: An Advanced and Versatile Thermal Simulator for Integrated Systems. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 37, 12 (2018), 3123–3136. doi:10.1109/TCAD.2018.2879729
  13. [13]Yu-Min Lee, Shun-Ping Huang, and Ying-Hui Lin. 2025. Therunet-SP: 2.5D IC Thermal Simulation Using U-Net Convolution and Scaling Procedure. In 26th International Symposium on Quality Electronic Design. IEEE. doi:10.1109/ISQED65160.2025.11014417DOI
  14. [14]Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. 2021. Fourier Neural Operator for Parametric Partial Differential Equations. In International Conference on Learning Representations.
  15. [15]Yu-Sheng Lin, Li-Song Lin, Chin-Jui Chang, Ting-Yu Lin, Ya-Wen Yu, Shih-Hong Pan, Wei Cheng Lee, Kai-En Yang, Yi-Chen Lin, Tai-Yu Chen, and Jason Yeh. 2023. Fast SoC Thermal Simulation with Physics-Aware U-Net. In NeurIPS Workshop on Machine Learning and the Physical Sciences. https://neurips.cc/virtual/2023/76089
  16. [16]Ziyue Liu, Yixing Li, Jing Hu, Xinling Yu, Shinyu Shiau, Xin Ai, Zhiyu Zeng, and Zheng Zhang. 2023. DeepOHeat: Operator Learning-Based Ultra-Fast Thermal Simulation in 3D-IC Design. In 60th ACM/IEEE Design Automation Conference. 1–6. doi:10.1109/DAC56929.2023.10247998DOI
  17. [17]Lu Lu, Pengzhan Jin, Guofei Pang, Zongqian Zhang, and George Em Karniadakis. 2021. Learning Nonlinear Operators via DeepONet Based on the Universal Approximation Theorem of Operators. Nature Machine Intelligence 3 (2021), 218–229. doi:10.1038/s42256-021-00302-5
  18. [18]Yao Lu, Zhicheng Guo, Qijun Zhang, Shang Liu, Wenji Fang, Wenkai Li, and Zhiy​​ao Xie. 2024. COOL: A Cooling-aware Point Transformer Framework for Thermal Prediction in Advanced 3D/3.5D IC Packaging. In 63rd ACM/IEEE Design Automation Conference. doi:10.1145/3770743.3804429
  19. [19]Jingyu Pan, Chen-Chia Chang, Zhiyao Xie, Yiran Chen, and Hai Helen Li. 2024. EDALearn: A Comprehensive RTL-to-Signoff EDA Benchmark for Democratized and Reproducible ML for EDA Research. In Proceedings of the 43rd IEEE/ACM International Conference on Computer-Aided Design. 1–8. doi:10.1145/3667366.3697116arxiv.org/abs/2312.01674
  20. [20]Maziar Raissi, Paris Perdikaris, and George Em Karniadakis. 2019. Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. J. Comput. Phys. 378 (2019), 686–707. doi:10.1016/j.jcp.2018.10.045DOI
  21. [21]Rishikesh Ranade, Haiyang He, Jay Pathak, Norman Chang, Akhilesh Kumar, and Jimin Wen. 2022. A Thermal Machine Learning Solver for Chip Simulation. In Proceedings of the 2022 ACM/IEEE Workshop on Machine Learning for CAD. 111–117. doi:10.1145/3551901.3556484arxiv.org/abs/2209.04741
  22. [22]Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention. 234–241. doi:10.1007/978-3-319-24574-4_28
  23. [23]Yanliang Sha, Chengxin Zhang, and Quan Chen. 2026. PI-ONet: A Physics-Informed Operator Network for Efficient Thermal Analysis of Multilayer Chiplets. IEEE Transactions on Components, Packaging and Manufacturing Technology 16, 3 (2026), 493–505.DOI
  24. [24]Michael Joseph Smith, Shengyun Hwang, Vinicius Cabral Do Nascimento, Qiang Qiu, Cheng-Kok Koh, Qanesh Subbarayan, and Dan Jiao. 2023. Real-Time Precision Prediction of 3-D Package Thermal Maps via Image-to-Image Translation. In 2023 IEEE 32nd Conference on Electrical Performance of Electronic Packaging and Systems. 1–3. doi:10.1109/EPEPS58208.2023.10314947
  25. [25]Makoto Takamoto, Timothy Praditia, Raphael Leiteritz, Daniel MacKinlay, Francesco Alessiani, Dirk Pflüger, and Mathias Niepert. 2022. PDEBench: An Extensive Benchmark for Scientific Machine Learning. In Advances in Neural Information Processing Systems, Vol. 35. Curran Associates, Inc., Red Hook, NY, USA, 14 pages.arxiv.org/abs/2210.07182
  26. [26]Zhuofuo Tao, Yichen Shi, Yiru Huo, Rui Ye, Zonghang Li, Li Huang, Chen Wu, Na Bai, Zhiping Yu, Ting-Jung Lin, and Lei He. 2024. AMSNet: Netlist Dataset for AMS Circuits. In 2024 IEEE LMl Aided Design Workshop (LAD). 1–5. doi:10.1109/LAD62441.2024.10691781
  27. [27]Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. 2019. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In International Conference on Learning Representations. OpenReview.net, New Orleans, LA, USA. https://openreview.net/forum?id=rJ4kmR5t7
  28. [28]Mingyu Wang, Yuanqing Cheng, Weihe Zeng, Zhenjie Lu, Vasilis F. Pavlidis, and Wei W. Xing. 2024. ARO: Autoregressive Operator Learning for Transferable and Multi-Fidelity 3D-IC Thermal Analysis with Active Learning. In IEEE/ACM International Conference on Computer-Aided Design. doi:10.1145/3676536.3676713
  29. [29]Qipan Wang, Xueqing Li, Tianyu Jia, Yibo Lin, Runsheng Wang, and Ru Huang. 2024. ATPlace2.5D: Analytical Thermal-Aware Chiplet Placement Framework for Large-Scale 2.5D-IC. In IEEE/ACM International Conference on Computer-Aided Design. 39:1–39:9. doi:10.1145/3676536.3676648DOI
  30. [30]Zhihai Wang, Zijie Geng, Zhaojie Tu, Jie Wang, Yuxi Qian, Zhexuan Xu, Ziyan Liu, Siyuan Xu, Zhentao Tang, Shixiong Kai, Mingxuan Yuan, Jianye Hao, Bin Li, and Feng Wu. 2025. Benchmarking End-to-End Performance of AI-Based Chip Placement Algorithms. In Advances in Neural Information Processing Systems 38. 22670–22696. doi:10.52202/085713-0673
  31. [31]Gege Wen, Zongyi Li, Kamyar Azizzadenesheli, Anima Anandkumar, and Sally M. Benson. 2022. U-FNO: An Enhanced Fourier Neural Operator-Based Deep-Learning Model for Multiphase Flow. Advances in Water Resources 163 (2022), 104180. doi:10.1016/j.advwatres.2022.104180
  32. [32]Jimin Wen, Stephen Pan, Norman Chang, Wen-Tze Chuang, Wenbo Xia, Deqi Zhu, Akhilesh Kumar, En-Chi Yang, Karthik Srinivasan, and Ying-Shun Li. 2020. DNN-Based Fast Static On-Chip Thermal Solver. In 2020 36th Semiconductor Thermal Measurement, Modeling & Management Symposium (SEMI-THERM). 65–75. doi:10.23919/SEMI-THERM50369.2020.9142855
  33. [33]Chun Yuan Yang, Shijun Wang, Xiang Gao, Zhong Zhang, and Zhiping Xu. 2026. Real-Time 3D Thermal Prediction for Advanced Packaging via Machine Learning. International Journal of Heat and Mass Transfer 267 (2026), 128936. doi:10.1016/j.ijheatmasstransfer.2026.128936DOI
  34. [34]Ziyao Yang, Jingbo Sun, Vidya A. Chhabria, and Yu Cao. 2025. Adaptive Graph Learning for Efficient Thermal Analysis of Multi-Stacking Chiplet Systems under Interface Variations. In IEEE/ACM International Conference on Computer-Aided Design. 1–9. doi:10.1109/ICCAD62669.2025.11240700DOI
  35. [35]Xinling Yu, Ziyue Liu, Hai Li, Yixing Li, Xin Ai, Zhiyu Zeng, Ian Young, and Zheng Zhang. 2026. DeepOHeat-v1: Efficient Operator Learning for Fast and Trustworthy Thermal Simulation and Optimization in 3D-IC Design. IEEE Transactions on Components, Packaging and Manufacturing Technology 16, 1 (2026), 82–96.
  36. [36]Bingrui Zhang, Wei W. Xing, Xin Zhao, and Yiquan Sun. 2025. T-Fusion: Thermal Modeling of 3D ICs with Multi-Fidelity Fusion. In 30th Asia and South Pacific Design Automation Conference. 1406–1412. doi:10.1145/3658617.3679749
  37. [37]Dekang Zhang, Dan Niu, Zhiyu Cao, Yichao Dong, Jingweijia Tan, and Changyin Sun. 2025. Therm-PCT: A Geometry-Material Aware Point Cloud Transformer for Large-Scale Unstructured Thermal Analysis in 2.5D ICs. In IEEE/ACM International Conference on Computer-Aided Design. 1–9. doi:10.1109/ICCAD62669.2025.11241008
  38. [38]Tianxiang Zhu, Qipan Wang, Yibo Lin, Runsheng Wang, and Ru Huang. 2024. FaSt-Therm: Fast and Stable Full-Chip Transient Thermal Predictor Considering Nonlinear Effects. In IEEE/ACM International Conference on Computer-Aided Design. 144:1–144:9. doi:10.1145/3676536.3676738
  39. [39]Tianxiang Zhu, Qipan Wang, Yibo Lin, Runsheng Wang, and Ru Huang. 2024. FaSt-Therm: Fast and Stable Full-Chip Transient Thermal Predictor Considering Nonlinear Effects. In IEEE/ACM International Conference on Computer-Aided Design. 144:1–144:9. doi:10.1145/3676536.3676738DOI

Paper details

vlnc:W_y3mucp8h
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 10

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents