betaFeedback

WorksComputer Science

CAP: Learning to Optimize from Sparse Observations of Related Tasks

Abstract

In experiment-driven black-box optimization, each evaluation can consume materials, equipment time, and other resources, limiting the number of experiments available for a new task. Records from completed related optimization campaigns could help, but learning a sequential query policy remains challenging when task-specific experience consists of only a few sparse histories. We propose CAP (Candidate Acquisition Policy), which models shared structure and task-specific variation in fixed historical records to sample interactive practice functions. On these functions, CAP learns a feedback-conditioned query policy aimed at final optimization performance under a fixed evaluation budget. At deployment, its parameters remain fixed while each new observation informs the next query. Across five synthetic task families spanning 6 and 20 dimensions and two engineering simulation benchmarks, BOPTEST and SU2, CAP attains the lowest median final-budget value among the reported methods on four synthetic families and both engineering benchmarks. These results indicate that sparse records from completed related tasks can support adaptive query decisions on new tasks, making more effective use of limited, costly experimental evaluations.

Introduction

Experiment-driven black-box optimization seeks high-quality solutions with a limited number of objective evaluations. Each evaluation may consume materials or equipment time, or require a time-consuming engineering simulation, making effective use of every query on a new task important [16, 7]. Bayesian optimization (BO) uses observations and predictive uncertainty to guide subsequent queries under such budgets [7]. Yet a new task need not start entirely from scratch: completed optimization campaigns on related tasks leave records that may contain useful experience. This paper asks how that experience can be turned into effective query decisions on a new task.

We study a setting with limited historical experience: only sparse optimization records from a small number of related tasks are available, and these completed tasks cannot be evaluated further. The goal is to learn a query policy from the records that uses incoming feedback to optimize a new, related task within a fixed evaluation budget. Related tasks can share useful structure without having identical response functions, so configurations that worked well in the past cannot simply be reused. A policy must draw on historical experience while continually revising its decisions in light of observations from the current task.

Transfer BO methods can use historical observations to improve predictions or query selection on a new task [19]. Learned optimizers go further by learning query behavior from related tasks [17, 9]. Training such behavior requires tasks or approximations that can answer newly proposed queries; these interactions need not be physical experiments. In our setting, however, task-family-specific experience is limited to sparse, fixed records of completed campaigns. The records cannot directly answer queries proposed during policy training, and the available observations do not uniquely determine the response surfaces of related tasks. The central challenge is therefore not merely to identify promising locations from historical data, but to construct grounded interactive practice within this information boundary and learn a sequential strategy that adapts to feedback on a new task.

We propose CAP (Candidate Acquisition Policy). CAP models structure shared across historical tasks alongside task-specific variation, then samples interactive practice functions from the fitted distribution. These functions provide sequential optimization experience without further evaluations of the historical tasks. On them, CAP learns candidate-selection behavior aimed at final performance under a fixed evaluation budget. When deployed on a new related task, the policy parameters remain fixed: decisions use the growing observation context and candidate information from a frozen pretrained predictor, and each new evaluation informs the next query. Historical experience is thus distilled into reusable query behavior, while adaptation to a particular target task occurs through feedback rather than policy fine-tuning.

We evaluate CAP on five synthetic task families spanning 6 and 20 dimensions and on two engineering simulation benchmarks, building control with BOPTEST ([2]) and airfoil design with SU2 ([4]), against single-task, transfer, and learned optimizers. CAP attains the lowest median final-budget value among the reported methods on four synthetic families and both engineering benchmarks; FSAF leads on Levy20. These results indicate that sparse records from completed related tasks can support adaptive queries on new tasks, making more effective use of limited, costly evaluations.

Our main contributions are:

  • We develop a way to construct interactive practice functions from sparse, fixed records of related tasks, enabling sequential query-policy training from completed campaigns.

  • We introduce CAP, which combines record-derived practice with policy learning aimed at final performance under a fixed budget. At deployment, the policy adapts its decisions through the growing observation context without updating its parameters.

  • We evaluate the complete optimizer across synthetic task families with different landscapes and dimensions and two engineering simulation benchmarks, demonstrating its final-budget optimization performance.

Related Work

Work on query efficiency under limited evaluation budgets either improves search and acquisition rules or uses experience from related tasks to learn predictions and decisions. In the former direction, TuRBO organizes search within local trust regions ([5]), while FunBO discovers reusable acquisition functions ([1]). CAP focuses on a more constrained setting in the latter direction: only fixed records from a small number of related tasks are available, yet the goal is to train a policy that selects queries using feedback from a new task. We discuss related work on cross-task transfer, query policy learning, and in-context prediction.

Transfer Learning for Bayesian Optimization

Transfer BO typically uses historical experience in the surrogate or acquisition decisions for a new task. RGPE weights GP models according to the ranking performance of historical models on current-task observations ([6]); ABLR relates regression models across tasks through a shared representation ([13]); and FSBO meta-learns a deep-kernel surrogate that adapts to new-task observations ([19]). At the acquisition level, TAF combines historical-task information with expected improvement on the new task ([20]). CAP also uses cross-task relatedness, but the historical task model generates practice functions for policy training rather than predicting candidate responses at deployment; training incorporates historical experience into the policy parameters.

Learning Query Policies for Black-Box Optimization

MetaBO trains a neural acquisition function with reinforcement learning [17]; FSAF connects acquisition functions to action values [9]; and NAP jointly learns predictive representations and acquisition decisions [10]. OptFormer takes another route, learning query behavior from existing hyperparameter optimization trajectories [3].

Interactive training of the first three methods requires responses at points selected by the policy: MetaBO uses evaluable tasks or inexpensive approximations, FSAF uses sampleable functions, and NAP uses candidate responses available from source tasks. In our setting, only sparse records from a small number of completed tasks are available; if a policy selects an unrecorded point, the records cannot provide feedback, so subsequent training trajectories cannot proceed as in the original setups. Thus, the limitation is not in these policy models themselves, but in the inability to meet their original training conditions directly from fixed records. CAP constructs queryable computational practice from the records, then learns a feedback-conditioned policy aimed at final performance under a fixed budget.

Learned Priors and In-Context Prediction

Prior-data fitted networks (PFNs) make predictions conditioned on an observation context [11]; TabPFN applies this approach to prediction on small tabular datasets [8], and PFNs4BO studies its use in Bayesian optimization [12]. CAP uses a frozen pretrained predictor to provide candidate features for the current task and trains the query policy separately. This predictor differs from the practice-function model fitted to historical records: the former supports current decisions, whereas the latter provides an interactive environment only during training.

Method

Problem Setting and Overview

We consider related black-box minimization tasks with comparable decision variables, mapped to a common domain X=[0,1]d\mathcal{X} = [0, 1]^d. The available historical experience consists of fixed optimization records from KK completed tasks,

D={Dh}h=1K,Dh={(xh,i,yh,i)}i=1nh.(1)\mathcal{D} = \{\mathcal{D}_h\}_{h=1}^{K}, \qquad\mathcal{D}_h = \{(x_{h,i}, y_{h,i})\}_{i=1}^{n_h}. \tag*{(1)}

The tasks need not have identical response functions. Training may use these records and quantities derived from them, but cannot obtain further evaluations of the historical objectives or interact with a new target task.

On a new related task f⋆f_\star, an initial design of n0n_0 evaluations is followed by H=B−n0H = B - n_0 adaptive queries within a total budget BB. Let Ot\mathcal{O}_t contain the initial observations and the first tt adaptive evaluations, and let bt=min⁡(x,y)∈Otyb_t = \min_{(x,y)\in\mathcal{O}_t} y be the best value observed so far. The objective is a small terminal value θH\theta_H; when a task optimum is available to the evaluator, it can also compute terminal simple regret. Neither the optimum nor unqueried target responses are available to the policy. Historical record length nhn_h and target budget BB have distinct roles, even when an experimental protocol assigns them the same numerical scale.

CAP turns the fixed records into interactive computational practice and learns sequential query behavior over complete budgets. For a given historical archive and budget condition, training yields one policy whose parameters remain frozen when deployed on new tasks associated with that archive. The method is fitted and trained separately for different archives; a single set of weights is not assumed to transfer across unrelated task families. Adaptation to a new task comes from its growing observation context and the resulting query decisions, not from retraining the policy. Figure 1 summarizes this process.

Figure 1. Overview of CAP. Fixed historical records fit an approximate distribution of coherent practice functions on which complete trajectories train a candidate-selection policy. At each step, the menu and represented observations inform a frozen, externally pretrained TabPFN and the actor–critic; only the selected response updates the observation context. Full trajectories yield PPO returns, while responses of all practice candidates supply auxiliary labels qtq_t only to the training loss. At deployment, one frozen policy per historical archive and budget condition uses current-task feedback and pays for only the selected target query.

History-Conditioned Practice Functions

Fixed records provide responses only at previously queried locations and cannot directly answer new queries proposed during policy training. To obtain complete sequential training trajectories, we fit an approximate, history-conditioned task distribution and sample

f~∼P^D.(2)\tilde{f} \sim\widehat{\mathcal{P}}_{D}. \tag*{(2)}

Each draw defines a function path fixed throughout an optimization episode. Interacting with it is computation derived from the records, not another evaluation of a historical or target objective.

Shared structure and task variation. For the continuous part of the responses, we model historical observations with shared spatial structure and task-specific variation:

zh,i:=Tη(yh,i)=β+g(xh,i)+ah+uh(xh,i)+ϵh,i,q∼GP(0,ks),uh∼iidGP(0,ku),ah∼iidN(0,va),ϵh,i∼N(0,σϵ2).(3)\begin{aligned} z_{h,i} &:= T_{\eta}(y_{h,i}) = \beta+ g(x_{h,i}) + a_h + u_h(x_{h,i}) + \epsilon_{h,i},\\ q &\sim\mathcal{GP}(0,k_s), \qquad u_h \mathrel{\overset{\mathrm{iid}}{\sim}} \mathcal{GP}(0,k_u),\\ a_h &\mathrel{\overset{\mathrm{iid}}{\sim}} \mathcal{N}(0,v_a), \qquad\epsilon_{h,i} \sim\mathcal{N}(0,\sigma_{\epsilon}^{2}). \tag*{(3)} \end{aligned}

Here TηT_{\eta} transforms responses for historical modeling, β\beta is a common mean, gg captures structure shared across tasks, uhu_h captures task-specific spatial variation, and aha_h is an optional task-level offset. The kernels ksk_s and kuk_u describe the shared and task-specific processes, respectively; ϵh,i\epsilon_{h,i} is a fitting-noise term for historical observations. All KK records contribute to the joint fit. In a new practice task, the shared structure is conditioned on the records, while its task-specific process and offset are drawn anew. A practice function therefore need not reproduce any particular historical response surface.

We approximate prior function paths with random Fourier features and condition whole paths on the historical observations [14, 18]. The path and any applicable discrete response component are fixed at the start of an episode; repeated queries at the same location do not resample fitting noise. The resulting PD\mathcal{P}_{D} is an approximation constrained by sparse records, not an exact recovery of the true task distribution. Response-transformation families and whether a discrete component is enabled are specified for each experimental condition before target-task evaluation; their numerical parameters are fitted only from the corresponding historical records. These response-modeling choices do not change the subsequent policy architecture or training objective. Path construction and the response choices are detailed in Appendix § 6.

Feedback-Conditioned Candidate Acquisition

The historical archive influences query behavior through the trained policy parameters, but is not supplied as a direct input at each target-task decision. The policy instead uses the current task’s evaluated observations, candidate locations, predictions based only on those observations, and the decision stage. The practice generator’s latent variables and unqueried responses are unavailable.

Current-task response representation. To separate response modeling for practice-task generation from online decision features, define a context-dependent representation

yˉt,i=ϕt(yi;Ot),(xi,yi)∈Ot.(4)\bar{y}_{t,i} = \phi_t(y_i; O_t), \qquad(x_i,y_i) \in O_t. \tag*{(4)}

Unlike TηT_{\eta}, which is used to construct practice functions, ϕt\phi_t depends only on the current task’s evaluated observations and is recomputed after every query. The synthetic experiments use the identity representation; the engineering experiments use within-context normal scores based on response ranks, so wide response ranges do not compress input differences among favorable observations. Each representation is held fixed for its training condition and used identically at deployment; it is not selected using target-task outcomes. The representation affects only predictor and policy inputs. Incumbents, training returns, auxiliary labels, and reported objective values retain the original response units.

Candidate menu and online predictor. At step tt, a fixed-size menu Ct={xt,j}j=1MC_t = \{x_{t,j}\}_{j=1}^{M} combines a persistent global Sobol pool with local candidates regenerated around spatially separated, favorably observed locations. Selected global points are removed from the pool. Local sampling uses a predefined budget-dependent radius schedule, while its centers respond to the observations. The policy learns which available candidate to query; it does not learn the menu’s allocation or radius rule.

A frozen, externally pretrained TabPFN-v2 regressor predicts candidate means μt(x)\mu_t(x) and standard deviations σt(x)\sigma_t(x) from {(xi,yˉt,i)}(xi,yi)∈Ot\{(x_i,\bar{y}_{t,i})\}_{(x_i,y_i)\in O_t} [8]. These predictions are in the yˉ\bar{y} representation space. TabPFN supplies current-task decision features, whereas the historical model in Eq. (3) supplies training environments. Task-family-specific practice and policy learning come from the fixed records, distinct from TabPFN’s external pretraining.

Query decisions and feedback. A dual-stream attention actor–critic encodes observation and candidate tokens separately and uses candidate-to-context cross-attention to form feedback-conditioned candidate representations. A learned step embedding indicates the stage of the fixed query horizon. The actor assigns a logit ℓθ,t,j\ell_{\theta,t,j} to each candidate and defines

πθ(j∣st)=exp⁡(ℓθ,t,j)∑k=1Mexp⁡(ℓθ,t,k)(5)\pi_{\theta}(j \mid s_t) = \frac{\exp(\ell_{\theta,t,j})}{\sum_{k=1}^{M} \exp(\ell_{\theta,t,k})} \tag*{(5)}

where sts_t comprises the represented observations, candidate features, and the stage within the fixed budget. The critic shares the encoder and estimates state value. Training samples an action from πθ\pi_{\theta}; deployment selects its highest-scoring candidate. Only that candidate’s response is added to Ot+1O_{t+1}, after which the representation, predictions, and menu are rebuilt. The policy can thus revise subsequent decisions in response to new feedback, but learns selection within the predefined menu rather than its allocation or radius rule.

Learning from Terminal Returns and Candidate Responses

Practice functions provide two complementary training signals: terminal improvement over complete query trajectories and additional responses at the current candidates. The former targets fixed-budget optimization; the latter provides denser supervision at visited states, but reflects immediate response quality only.

Terminal objective. For each practice function f~\tilde{f}, a fixed reference set determines a positive response scale Cf~C_{\tilde{f}} before the episode. The scale remains constant within the episode and is used only for training. With btb_t computed from raw practice responses, define

rt=bt−bt+1Cf~,∑t=0H−1rt=b0−bHCf~.(6)\begin{aligned} r_t &= \frac{b_t-b_{t+1}}{C_{\tilde{f}}}, \qquad \sum_{t=0}^{H-1} r_t = \frac{b_0-b_H}{C_{\tilde{f}}}. \tag*{(6)} \end{aligned}

For a fixed practice function and initial design, the undiscounted return equals its scale-normalized terminal improvement; across functions, training optimizes the expectation of this quantity. No exact function optimum is needed for the reward.

We update the actor–critic with clipped PPO [15], using returns and advantages from complete sampled trajectories. A query without immediate improvement can therefore receive a learning signal through later improvements in its trajectory. Optimization and numerical settings are given in Appendix A.

State-adaptive candidate supervision. At each visited state, the sampled practice function can also answer queries for the other candidates. Their signed, immediate utilities are

ut,j=bt−f~(xt,j)Cf~.(7)u_{t,j} = \frac{b_t-\tilde{f}(x_{t,j})}{C_{\tilde{f}}}. \tag*{(7)}

We retain negative values so that candidates can still be ordered when none improves the incumbent. Sort utilities as ut,(1)≥⋯≥ut,(M)u_{t,(1)} \ge\cdots\ge u_{t,(M)} and form a soft label with a state-dependent temperature:

τt=max⁡{α(ut,(1)−ut,(k)),ϵτ},qt,j=(1−ζ)exp⁡(ut,j/τt)∑ℓ=1Mexp⁡(ut,ℓ/τt)+ζM.(8)\begin{aligned} \tau_t &= \max\left\{\alpha\left(u_{t,(1)}-u_{t,(k)}\right),\epsilon_{\tau}\right\},\\ q_{t,j} &= (1-\zeta)\frac{\exp(u_{t,j}/\tau_t)}{\sum_{\ell=1}^{M}\exp(u_{t,\ell}/\tau_t)}+\frac{\zeta}{M}. \tag*{(8)} \end{aligned}

Here kk is the candidate rank used to set the temperature, α>0\alpha> 0 controls its scale, ϵτ>0\epsilon_\tau> 0 supplies a numerical floor, and ζ∈[0,1]\zeta\in[0, 1] mixes the labels with a uniform distribution. We detach qtq_t from gradient computation and minimize

Laux=−Est∑j=1Mqt,jlog⁡πθ(j∣st).(9)\mathcal{L}_{\mathrm{aux}} = -\mathbb{E}_{s_t} \sum_{j=1}^{M} q_{t,j} \log\pi_\theta(j \mid s_t). \tag*{(9)}

These labels describe immediate response quality, not the long-term information value of a query. They complement, rather than replace, the complete-trajectory objective.

Joint training and deployment. The training loss combines the clipped PPO policy loss, a value loss, entropy regularization, and candidate supervision:

L=Lclip+cVLV−centEstH(πθ(⋅∣st))+λauxLaux.(10)\mathcal{L} = \mathcal{L}_{\mathrm{clip}} + c_V \mathcal{L}_V - c_{\mathrm{ent}}\mathbb{E}_{s_t}\mathcal{H}(\pi_\theta(\cdot\mid s_t)) + \lambda_{\mathrm{aux}}\mathcal{L}_{\mathrm{aux}}. \tag*{(10)}

Here Lclip\mathcal{L}_{\mathrm{clip}} is the PPO actor loss, LV\mathcal{L}_V trains the critic to predict complete-trajectory returns, H\mathcal{H} denotes policy entropy, and cVc_V, centc_{\mathrm{ent}}, λaux\lambda_{\mathrm{aux}} are loss weights. Responses of unselected candidates are used only to construct training labels; they do not enter the policy state, TabPFN context, or subsequent observation trajectory. These extra evaluations are computational queries to practice functions, not target-task evaluations.

After training, deployment retains the frozen predictor, candidate construction, and one fixed policy for the historical archive and budget condition. It does not use the practice generator or candidate labels. Each adaptive step pays for only the selected target query and returns the best point observed within the budget.

Experiments

We ask whether a policy learned from a small number of fixed historical optimization records can improve budget-limited optimization on new, related tasks. We first compare the complete optimizer across five synthetic task families with different landscapes and dimensions, then examine whether its performance extends to two engineering simulation benchmarks.

Experimental Setup

Tasks and budgets. We evaluate five synthetic families—Hartmann6, Ackley6, Levy6, Ackley20, and Levy20—each with 20 historical tasks (5d5d fixed observations per task) and 100 distinct target tasks; their construction is outlined in Appendix § 7.§ 2. BOPTEST building control and SU2 airfoil design each have 20 historical and 20 target tasks ([2, 4]). All methods use the same target tasks, shared initial design (n0=d/2n_0 = d/2), and total budget (B=5dB = 5d evaluations) within each benchmark. CAP trains one policy per historical archive and freezes it on target tasks. Further protocol is in Appendix § 7; synthetic scoring is in Appendix § 8.

Baselines. Single-task optimizers are EI, PI, UCB, RolloutEI-2, FunBO, and TuRBO; FunBO uses a discovered acquisition function and TuRBO uses local trust regions (Aglietti et al., [1]; Eriksson et al., [5]). Record-based transfer methods are TAF-ranking, RGPE, ABLR, and FSBO (Wistuba et al., [20]; Feurer et al., [6]; Perrone et al., [13]; Wistuba & Grabocka, [19]). FSAF, MetaBO, and NAP learn query policies through interaction (Hsieh et al., [9]; Volpp et al., [17]; Maraval et al., [10]). We also include publicly pretrained PFNs4BO as an external-prior reference (Müller et al., [12]). Each retains its native surrogate, candidate construction, and decision rule; objective-evaluation budgets are matched.

FSAF, MetaBO, and NAP need training tasks that answer new queries, but the historical records cannot. We therefore train them on the same record-derived, queryable practice-function distribution as CAP, within the same historical-information boundary. They share practice feedback, not CAP’s predictor, architecture, candidates, or loss. The distinct roles of CAP’s frozen TabPFN predictor and the externally pretrained PFNs4BO model are explained in § 3.3.

Evaluation metric. For synthetic tasks, we report median normalized simple regret across targets, at the final budget and along the trajectory. Since engineering optima are unknown, we report median best-observed objective values in original units. Lower is better. Appendix § 8 details scoring and aggregation.

Synthetic Task Families

Table 1 compares final regret across all methods; Figure 2 shows trajectories for a fixed cross-category selection. All trajectories appear in Appendix § 8.

MethodHartmann6Ackley6Levy6Ackley20Levy20
CAP0.02670.15140.02200.18060.1798
FSAF0.79360.67860.03840.78080.1589
MetaBO0.15110.60520.07210.78080.3311
NAP0.26060.16720.06860.74070.3460
TAF-ranking0.13650.26430.09850.72480.2804
RGPE0.12010.38210.07780.71250.2747
ABLR0.17650.56800.06160.73610.3212
FSBO0.09000.24790.06390.68220.2308
PFNs4BO0.16100.37170.0877N/AN/A
TuRBO0.10700.30650.08760.48160.2254
EI0.48700.50600.12900.71670.2839
PI0.45880.52300.11650.71550.2833
UCB0.48400.52910.13720.71330.2872
FunBO0.50100.51450.12190.71440.2840
RolloutEI-20.50630.53500.11460.72250.2824

Table 1. Final median normalized simple regret on 100 target tasks per family (lower is better; best in bold). PFNs4BO supports at most 18 dimensions and is omitted in 20D.

Figure 2. Median normalized simple regret across 100 target tasks per family (lower is better). Curves begin after the initial design, included in the evaluation count; panel scales differ. Appendix C shows all methods.

CAP has the lowest median final regret among the reported methods in four of the five families, including Ackley20 (Table 1). On Levy20, FSAF has the lowest median (0.1589), followed by CAP (0.1798). Thus the endpoint benefit spans different landscapes and dimensions, but does not extend to every baseline on every family. The trajectories in Figure 2 show how the methods improve with target-task feedback, complementing the fixed-budget comparison in the table.

Engineering Simulation Tasks

Synthetic families allow controlled variation between related tasks, whereas the engineering experiments use specific simulator objectives and operating conditions. BOPTEST varies operating time windows within a shared building and control space; SU2 varies flight conditions within a shared airfoil-design space. BOPTEST has d=6d = 6 and a budget of 30 simulator evaluations per target task; SU2 has d=10d = 10 and a budget of 50. Policy training uses only the fixed historical records and their derived practice tasks, not simulator calls on target tasks.

Table 2 reports the median final best-observed objective for all reported methods on both benchmarks. Figure 3 shows their progress within the simulation budget; trajectories for every reported method appear in Appendix § 9.

Figure 3. Median best-observed objective versus simulator evaluations (lower is better). Vertical axes use each benchmark’s original scale. The SU2 panel zooms to evaluations 10–50 and objective values 0.066–0.080; earlier evaluations still count toward the budget. Appendix D shows all methods.

MethodBOPTEST (6D)SU2 (10D)
CAP0.16510.06787
FSAF0.17100.07072
MetaBO0.20780.07048
NAP0.18780.07065
TAF-ranking0.17730.06935
RGPE0.19260.06988
ABLR0.44970.07018
FSBO0.27860.07024
PFNs4BO0.16950.06988
TuRBO0.18010.06901
EI0.20570.06944
PI0.19430.06963
UCB0.18080.07007
FunBO0.19350.06952
RolloutEI-20.18140.06950

Table 2. Final median best-observed objective across 20 target tasks per engineering benchmark (lower is better). Values use each benchmark’s original scale; bold marks the best result.

CAP obtains the lowest median final best-observed objective among the reported methods on both BOPTEST and SU2 (Table 2). The trajectories show how this performance develops across simulator evaluations (Figure 3). Together with the synthetic results, these experiments demonstrate its budget-limited optimization performance across the evaluated task families.

The two engineering benchmarks both show modest final-median margins. On BOPTEST, the final medians of CAP (0.1651), PFNs4BO (0.1695), and FSAF (0.1710) are close. Several methods improve rapidly early in the budget and approach similar values near its end. On SU2, CAP reaches 0.06787 after 50 evaluations, while the next lowest median among the reported methods is TuRBO’s 0.06901. The zoomed trajectory shows a continuing but small late-budget improvement. These comparisons are within each benchmark: BOPTEST and SU2 retain their own objective scales, and the reported medians do not imply a win on every target task.

Conclusion

We introduced CAP to turn fixed, sparse records of completed related tasks into interactive computational practice and learn a sequential query policy for a fixed evaluation budget. On a new task, the policy requires no further training: it adjusts subsequent queries as observations accumulate. Across five synthetic families

and two engineering simulation benchmarks, CAP achieves the lowest median final-budget value among the compared methods on four synthetic families and both engineering benchmarks, while FSAF leads on Levy20. These results show that even sparse, non-extendable records can provide useful experience for feedback-conditioned optimization on new tasks, helping make better use of limited, costly objective evaluations.

This setting matters when past campaigns cannot be extended: the practice used for policy learning is generated computationally from their fixed records, while target-task evaluations are reserved for deployment. The policy then uses its learned parameters together with the observations collected on the current task, without updating those parameters between queries. Our evidence concerns new tasks related to the recorded ones and sharing their decision space; it does not establish performance on unrelated task families. Within that scope, the results support learning a reusable query policy from a small historical archive rather than requiring fresh interactions with the historical objectives.

AI use statement

Generative AI tools were used to assist with language polishing of the manuscript, code optimization, and organization of figures and research materials. The authors reviewed the AI-assisted work and take responsibility for the final manuscript and research results.

Method Implementation

Practice-Function Construction

Flatten the continuous-response historical observations and let hih_i identify the task associated with record ii. The model in Eq. (3) gives the covariance

Cij=ks(xi,xj)+1[hi=hj]{ku(xi,xj)+va}+σϵ21[i=j].(11)C_{ij}=k_s(x_i,x_j)+1[h_i=h_j]\{k_u(x_i,x_j)+v_a\}+\sigma_\epsilon^2 1[i=j]. \tag*{(11)}

Both spatial kernels are isotropic Matérn-5/2 kernels. A new task shares only gg with historical tasks; its task-specific process u⋆u_\star and offset a⋆a_\star are sampled anew. Model parameters are fitted using the corresponding historical records, without choosing them from target-task responses or results.

We approximate prior paths with random Fourier features and condition whole paths on the historical observations. Let zDz_D be the transformed historical responses, zD0z_D^0 the prior draw at historical inputs (including the historical tasks’ processes, offsets, and fitting noise), and z⋆0(x)z_\star^0(x) the new task’s prior latent path. With cs(x)i=ks(x,xi)c_s(x)_i=k_s(x,x_i), the continuous practice path, conditional on a mean and response-transform component, is

z~⋆(x)=β+z⋆0(x)+cs(x)⊤C−1[zD−β1−zD0].(12)\widetilde{z}_\star(x)=\beta+z_\star^0(x)+c_s(x)^\top C^{-1}[z_D-\beta\mathbf{1}-z_D^0]. \tag*{(12)}

Applying the inverse response transformation, and any applicable fixed discrete response component, yields f~(x)\widetilde{f}(x). The path, transformation component, and discrete component remain fixed within a draw; historical fitting noise is not resampled on practice queries.

The joint model and path-conditioning procedure are shared across experiments. Response transformations and an optional discrete component accommodate different response distributions in the fixed historical records. Synthetic experiments use an affine transformation; engineering experiments use record-fitted monotone transformations, with a discrete component where repeated responses occur. These choices are fixed before target-task evaluation, with numerical parameters fitted only from the corresponding records; they do not alter the candidate policy, training objective, or deployment procedure.

Online Representation, Candidates, and Training

The online representation ϕt\phi_t in Eq. (4) serves decision inputs, whereas TηT_\eta serves practice-function construction. Synthetic runs use ϕt(yi;Ot)=yi\phi_t(y_i;O_t)=y_i. In engineering runs, let Nt=∣Ot∣N_t=|O_t| and let rir_i be the one-based average rank of yiy_i among the observed responses, with ties sharing their average rank. Then

ϕt(yi;Ot)=Φ−1(ri−0.5Nt).(13)\phi_t(y_i;O_t)=\Phi^{-1}\left(\frac{r_i-0.5}{N_t}\right). \tag*{(13)}

This representation is recomputed from current observations at every step, with the same rule used in training and deployment. It leaves raw-response incumbents, rewards, and evaluation unchanged. The wide range of historical engineering responses motivates representing their relative differences without introducing hidden task parameters.

Each decision uses M=256M=256 candidates: 128 points from an initial persistent scrambled Sobol pool and local points filling the remaining slots. Selected persistent points are removed. Local points are generated around up to three spatially separated, favorably observed locations. Their centers change with feedback, while the radius and allocation follow a predefined budget-dependent rule and are not policy actions. Context tokens contain locations and response-order features; candidate tokens contain locations, TabPFN predictive means and standard deviations in the online representation space, and a persistent-pool indicator. Separate attention streams encode context and candidates before candidate-to-context attention forms action scores.

The candidate construction, network design, and training objective are shared across experiments. The auxiliary-label parameters in Eq. (8) are k=20k=20, α=0.35\alpha=0.35, ϵτ=10−6\epsilon_\tau=10^{-6}, and ζ=0.001\zeta=0.001; the value, entropy, and auxiliary coefficients in Eq. (10) are cV=0.5c_V = 0.5, cent=0.01c_{\mathrm{ent}} = 0.01, and λaux=0.2\lambda_{\mathrm{aux}} = 0.2. PPO uses complete-trajectory returns without discounting.

Experimental Protocol

This appendix expands the experimental setup in § 4.1. The practice-function sampler and policy implementation are described in Appendix § 6; the benchmark task generators and evaluators are separate from that training procedure.

Task Archives and Evaluation Budgets

Each benchmark provides a fixed archive of K=20K = 20 related historical tasks, with 5d5d observed input–response pairs per task. The five synthetic families each have 100 target tasks with identities distinct from those in the corresponding historical archive. BOPTEST and SU2 each have 20 historical and 20 target tasks. Decision variables are mapped to [0,1]d[0, 1]^d within each benchmark. The dimensions are d=6d = 6 for Hartmann6, Ackley6, Levy6, and BOPTEST; d=10d = 10 for SU2; and d=20d = 20 for Ackley20 and Levy20.

At each target task, the methods receive the same initial design of n0=d/2n_0 = d/2 scrambled Sobol points and a total budget of B=5dB = 5d objective evaluations, including that design. Thus (n0,B)(n_0, B) is (3,30)(3, 30), (5,50)(5, 50), or (10,100)(10, 100) for 6D, 10D, or 20D tasks, respectively. The reported target-task runs use evaluation seed 42. Every target-task objective evaluation, including the initial design, counts toward BB; constructing and querying practice functions during training are computational operations. Once an archive is frozen, no method can request additional evaluations of a historical task. The synthetic reference values used for scoring are withheld from all optimizers and are defined in Appendix § 8.

Synthetic Task Construction

Hartmann6, Ackley6, Levy6, Ackley20, and Levy20 denote related-task families, not repeated optimization of a single unmodified benchmark function. All tasks are defined on [0,1]d[0, 1]^d. A benchmark generator samples each task’s parameters and provides objective responses to the historical logger or the target-task evaluator; neither the parameters nor unqueried responses are available to CAP training. Historical and target tasks have distinct identities, and all 100 sampled targets in each family are retained without selection by method performance.

Task variation. Hartmann6 retains the four basin centers PiP_i and base precision coefficients AijA_{ij} of the Hartmann function. For task parameters θ\theta, its objective has the form

fθ(x)=sθ[−∑i=14αi(θ)exp⁡(−∑j=16Aijmi(θ)cj(θ)(Wθ(x)j−Pij)2)].(14)f_{\theta}(x) = s_{\theta}\left[-\sum_{i=1}^{4}\alpha_i^{(\theta)}\exp\left(-\sum_{j=1}^{6}A_{ij}m_i^{(\theta)}c_j^{(\theta)}\left(W_{\theta}(x)_j-P_{ij}\right)^2\right)\right]. \tag*{(14)}

Here WθW_{\theta} is a boundary-preserving invertible warp, while αi(θ)\alpha_i^{(\theta)}, mi(θ)m_i^{(\theta)}, and cj(θ)c_j^{(\theta)} vary basin depth, width, and coordinate anisotropy. The base depths are (1,1.2,3,3.2)(1, 1.2, 3, 3.2). Warp shifts, scales, and pairwise coupling angles range over [−0.0354,0.0354][-0.0354, 0.0354], [0.9056,1.0944][0.9056, 1.0944], and [−11.8∘,11.8∘][-11.8^\circ, 11.8^\circ], respectively; depth factors range over [0.5,1.5][0.5, 1.5]. Width and anisotropy receive smaller task-specific perturbations. The generator-only factor sθs_{\theta} keeps the numerical reference minimum on the base Hartmann scale. Neither sθs_{\theta} nor the task parameters are supplied to an optimizer.

For Ackley and Levy, a task combines a base function, the same type of invertible warp, and a localized smooth perturbation. Let RR map unit-cube coordinates to the corresponding base-function domain, coordinatewise. Then

fθ(x)=fbase(R(z))+Aθexp⁡(−∥z−zopt∥22L2)ϕθ(z),z=Wθ(x).(15)f_\theta(x) = f_{\mathrm{base}}(R(z)) + A_\theta\exp\left(-\frac{\lVert z-z^{\mathrm{opt}}\rVert^2}{2L^2}\right)\phi_\theta(z), \qquad z = W_\theta(x). \tag*{(15)}

Specifically, R(z)=10z−5R(z) = 10z - 5 for Ackley and R(z)=20z−10R(z) = 20z - 10 for Levy, giving base-function domains [−5,5]d[-5,5]^d and [−10,10]d[-10,10]^d, respectively; zoptz^{\mathrm{opt}} is the corresponding base optimum in unit-cube coordinates. The localized perturbation ϕθ\phi_\theta uses 32 cosine features with task-specific coefficients and envelope width L=0.18d/6L = 0.18\sqrt{d/6}. Its amplitude is 0.3 times the family reference scale for Ackley and 0.1 for Levy. Warp shifts, scales, and coupling angles range over [−0.018,0.018][-0.018, 0.018], [0.952,1.048][0.952, 1.048], and [−6∘,6∘][-6^\circ, 6^\circ], respectively. These variations produce distinct related tasks within a common decision space.

Engineering Simulation Tasks

BOPTEST evaluates a six-parameter building-control problem using the multizone_office_simple_air FMU in BOPTEST v0.9.0. Tasks correspond to different operating windows in the same building and Chicago representative weather year. Each window has a seven-day warm-up followed by three scored days at one-hour control intervals. The six decision variables are occupied heating and cooling setpoints (18–22°C and 22–26°C), unoccupied heating and cooling setpoints (12–18°C and 26–32°C), supply-air temperature (12–18°C), and duct static pressure (100–350 Pa). A shared coordinate mapping enforces heating–cooling deadbands of at least 2°C when occupied and 4°C when unoccupied. The minimized scalar objective is costtot+tdistot+idistot/494\mathrm{cost}_{\mathrm{tot}} + \mathrm{tdis}_{\mathrm{tot}} + \mathrm{idis}_{\mathrm{tot}}/494; it is not normalized by a task-specific optimum.

SU2 evaluates ten-dimensional RAE2822 airfoil designs with SU2 v8.5.0, an SA turbulence model, fixed target lift coefficient, and cold-start RANS evaluations from a shared mesh. The design coordinates control five Hicks–Henne deformations on each of the upper and lower surfaces, each within ±0.001\pm0.001 chord. Tasks vary flight conditions: Mach number in [0.79,0.80][0.79, 0.80], Reynolds number in [6×106,7×106][6 \times10^6, 7 \times10^6], and target lift coefficient in [0.70,0.74][0.70, 0.74]. The benchmark minimizes a prespecified scalar objective: feasible simulations use CD/(1+CD)C_D/(1+C_D) when CM<0.093C_M < 0.093 and maximum thickness tmax⁡>0.12t_{\max} > 0.12; constraint violations receive 1+v/(1+v)1 + v/(1+v), where v=max⁡{0,CM/0.093−1,1−tmax⁡/0.12}v = \max\{0, C_M/0.093 - 1, 1 - t_{\max}/0.12\}, and classified geometry or numerical failures receive 2. The original scalar objectives, rather than regret to an unknown optimum, are reported for both simulators.

Baseline Information and Training

The single-task methods EI, PI, UCB, RolloutEI-2, FunBO, and TuRBO use the current target’s observations and their native surrogates and search procedures. TAF-ranking, RGPE, ABLR, and FSBO use the fixed historical records through their transfer mechanisms. FSAF, MetaBO, and NAP are trained on the same record-derived, queryable practice-function distribution as CAP, while retaining their own predictors, candidates, policies, and learning objectives; these practice queries do not access historical or target simulators. PFNs4BO uses its released externally pretrained model. CAP uses a separate frozen, externally pretrained TabPFN predictor for online features and learns its candidate policy from the historical archive. All methods retain their native target-task decision procedures, and only actual target-objective evaluations are budget-matched.

Synthetic Evaluation and Complete Trajectories

For target task ii, let bi,tb_{i,t} be the lowest objective value observed through evaluation tt. Given the task’s reference minimum mirefm_i^{\mathrm{ref}} and maximum MirefM_i^{\mathrm{ref}} for evaluation, normalized simple regret is

ri,t=bi,t−mirefMiref−miref.r_{i,t} = \frac{b_{i,t} - m_i^{\mathrm{ref}}}{M_i^{\mathrm{ref}} - m_i^{\mathrm{ref}}}.

The reference values are used only for offline scoring and are not supplied to the optimizers; reference minima obtained by finite search are not claimed to be certified global optima. At each evaluation count, we take the median of ri,tr_{i,t} across the 100 target tasks in a family. The horizontal axis includes evaluations used by the initial design, so trajectories begin once that design is complete. Table 1 reports final-budget values; Figure 4–Figure 7 give the complete trajectories by method category under the protocol in Appendix § 7.

Figure 4. Median normalized simple regret for CAP and the learned query policies FSAF, MetaBO, and NAP across the five synthetic families. Lower is better; vertical scales differ by family.

Figure 7. Median normalized simple regret for CAP, FunBO, and RolloutEI-2. Each point is a cross-task median at the indicated evaluation count.

Figure 5. Median normalized simple regret for CAP, TAF-ranking, RGPE, ABLR, FSBO, and PFNs4BO. The released PFNs4BO model supports at most 18 input dimensions, so it has no 20D curves.

Figure 6. Median normalized simple regret for CAP, TuRBO, EI, PI, and UCB. The evaluation count includes the initial design.

Complete Engineering Simulation Trajectories

The engineering benchmarks have no known global optimum from which to compute regret, so we use the original objective, as in the main text. For target task ii, let yi,sy_{i,s} be the objective value at simulator evaluation ss and bi,t=min⁡1≤s≤tyi,sb_{i,t} = \min_{1 \le s \le t} y_{i,s} the best value observed through evaluation tt. At each tt, the curves report the median of bi,tb_{i,t} over the 20 target tasks; lower is better. Evaluation counts include the initial designs of three points for BOPTEST and five for SU2. The SU2 panels display evaluations 10–50 on a linear, truncated vertical axis spanning 0.067–0.075 to resolve the late-budget differences; earlier evaluations still count toward the budget. Table 2 gives the final-budget comparison, while Figure 8–11 show every reported method by category.

Figure 8. Median best-observed objective for CAP and the learned query policies FSAF, MetaBO, and NAP on BOPTEST and SU2.

Figure 9. Median best-observed objective for CAP, TAF-ranking, RGPE, ABLR, FSBO, and PFNs4BO on both engineering benchmarks.

Figure 10. Median best-observed objective for CAP, TuRBO, EI, PI, and UCB on both engineering benchmarks.

Figure 11. Median best-observed objective for CAP, FunBO, and RolloutEI-2 on both engineering benchmarks.

References

  1. [1]Virginia Aglietti, Ira Ktena, Jessica Schrouff, Eleni Sgouritsa, Francisco J. R. Ruiz, Alan Malek, Alexis Bellot, and Silvia Chiappa. Funbo: Discovering acquisition functions for bayesian optimization with funsearch, 2024. URL https://arxiv.org/abs/2406.04824.
  2. [2]David Blum, Javier Arroyo, Sen Huang, Ján Drgona, Filip Jorissen, Harald Taxt Walnum, Yan Chen, Kyle Benne, Draguna Vrabie, Michael Wetter, et al. Building optimization testing framework (boptest) for simulation-based benchmarking of control strategies in buildings. Journal of Building Performance Simulation, 14(5):586–610, 2021.DOI
  3. [3]Yutian Chen, Xingyou Song, Chansoo Lee, Zi Wang, Qiuyi Zhang, David Dohan, Kazuya Kawakami, Greg Kochanski, Arnaud Doucet, Marc’aurelio Ranzato, Sagi Perel, and Nando de Freitas. Towards learning universal hyperparameter optimizers with transformers, 2022. URL https://arxiv.org/abs/2205.13320.
  4. [4]Thomas D Economon, Francisco Palacios, Sean R Copeland, Trent W Lukaczyk, and Juan J Alonso. Su2: An open-source suite for multiphysics simulation and design. AIAA Journal, 54(3):828–846, 2016.DOI
  5. [5]David Eriksson, Michael Pearce, Jacob Gardner, Ryan D Turner, and Matthias Poloczek. Scalable global optimization via local bayesian optimization. Advances in neural information processing systems, 32, 2019.arxiv.org/abs/1910.01739
  6. [6]Matthias Feurer, Benjamin Letham, and Eytan Bakshy. Scalable meta-learning for bayesian optimization. stat, 1050(6):7, 2018.
  7. [7]Peter I Frazier. A tutorial on bayesian optimization. arXiv preprint arXiv:1807.02811, 2018.arxiv.org/abs/1807.02811
  8. [8]Noah Hollmann, Samuel Müller, Lennart Purucker, Arjun Krishnakumar, Max Körfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. Accurate predictions on small data with a tabular foundation model. Nature, 01 2025. doi: 10.1038/s41586-024-08328-6. URL https://www.nature.com/articles/s41586-024-08328-6.DOI
  9. [9]Bing-Jing Hsieh, Ping-Chun Hsieh, and Xi Liu. Reinforced few-shot acquisition function learning for bayesian optimization. Advances in Neural Information Processing Systems, 34:7718–7731, 2021.arxiv.org/abs/2106.04335
  10. [10]Alexandre Maraval, Matthieu Zimmer, Antoine Grosnit, and Haitham Bou Ammar. End-to-end meta-bayesian optimisation with transformer neural processes. Advances in Neural Information Processing Systems, 36:11246–11260, 2023.arxiv.org/abs/2305.15930
  11. [11]Samuel Müller, Noah Hollmann, Sebastian Pineda Arango, Josif Grabocka, and Frank Hutter. Transformers can do bayesian inference. arXiv preprint arXiv:2112.10510, 2021.arxiv.org/abs/2112.10510
  12. [12]Samuel Müller, Matthias Feurer, Noah Hollmann, and Frank Hutter. Pfns4bo: In-context learning for bayesian optimization. In International Conference on Machine Learning, pp. 25444–25470. PMLR, 2023.arxiv.org/abs/2305.17535
  13. [13]Valerio Perrone, Rodolphe Jenatton, Matthias W Seeger, and Cédric Archambeau. Scalable hyperparameter transfer learning. Advances in neural information processing systems, 31, 2018.
  14. [14]Ali Rahimi and Benjamin Recht. Random features for large-scale kernel machines. Advances in neural information processing systems, 20, 2007.
  15. [15]John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal policy optimization algorithms, 2017. URL https://arxiv.org/abs/1707.06347.
  16. [16]Benjamin J Shields, Jason Stevens, Jun Li, Marvin Parasram, Farhan Damani, Jesus I Martinez Alvarado, Jacob M Janey, Ryan P Adams, and Abigail G Doyle. Bayesian reaction optimization as a tool for chemical synthesis. Nature, 590(7844):89–96, 2021.DOI
  17. [17]Michael Volpp, Lukas Fröhlich, Kirsten Fischer, Andreas Doerr, Stefan Falkner, Frank Hutter, and Christian Daniel. Meta-learning acquisition functions for transfer learning in bayesian optimization. arXiv preprint arXiv:1904.02642, 2019.arxiv.org/abs/1904.02642
  18. [18]James T. Wilson, Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky, and Marc Peter Deisenroth. Efficiently sampling functions from gaussian process posteriors, 2020. URL https://arxiv.org/abs/2002.09309.
  19. [19]Martin Wistuba and Josif Grabocka. Few-shot bayesian optimization with deep kernel surrogates. arXiv preprint arXiv:2101.07667, 2021.arxiv.org/abs/2101.07667
  20. [20]Martin Wistuba, Nicolas Schilling, and Lars Schmidt-Thieme. Scalable gaussian process-based transfer surrogates for hyperparameter optimization. Machine Learning, 107(1):43–78, 2018.DOI

Paper details

vlnc:W_nhxamsak
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Generative AI tools

View statement
Looking for related papers…
Contents