WorksComputer Science
Uncertainty Aware Quality-Diversity Optimization For Offline Biological Sequence Design
Abstract
Designing sequences such as nucleic acids and proteins with desired properties is a fundamental challenge in biology. Due to the vast, discrete nature of sequence spaces and the high cost of experimental evaluation, offline computational sequence design plays a crucial role in proposing novel sequences before costly wet-lab validation. In practice, it is also essential that proposed designs are diverse to increase the likelihood of downstream experimental success. This motivates methods that balance performance, novelty, and diversity, whilst mitigating against uncertainty inherent to offline optimization. Quality-Diversity optimization (QD) can discover diverse, high-performing solutions, making it well suited to this problem, but its elitist nature makes reliable exploration under uncertainty challenging. To address this, we introduce Prior-guided Offline MAP-Elites (POME), an uncertainty-aware QD framework explicitly adapted to the offline regime. Our method leverages foundation models as priors to guide search toward biologically plausible regions and enable robust exploration under uncertainty. Across three sequence design tasks, POME consistently improves both performance and diversity over prior offline QD methods, and achieves the most reliable balance compared to offline MBO baselines, obtaining the best performance on two tasks and the second-best on the third, while maintaining high diversity and novelty.
Introduction
Designing biological sequences with targeted functional properties, such as high ribosome load or strong binding affinity to transcription factors, is a fundamental challenge in synthetic biology [40], vaccine development [36] and therapeutic engineering [15]. In practice, practitioners often perform multiple rounds of generating variants, building them, testing their properties, and updating the design strategy [35]. A major obstacle to this process is that evaluating candidate sequences requires slow and costly wet-lab experiments that can take days to weeks, creating a bottleneck. Computational sequence generation therefore becomes a critical first step, allowing researchers to narrow the search space in silico before committing to experimental validation [12, 54, 8]. This computational generation commonly operates in an offline setting. Only a fixed dataset of designs evaluated in prior high-fidelity in vitro or in vivo experiments is available, while the true target property function remains unknown and expensive to query. Optimization is typically guided by surrogate models trained on this offline dataset, which approximate the true unknown function and are used to propose new, high-performing designs without access to additional evaluations. Importantly, biological design methods are typically expected to produce sets of diverse candidates rather than a single solution [26, 23, 28]. This need for diversity is essential because many candidates that seem promising computationally may fail in wet-lab validation. Generating a diverse set of sequences that spans multiple functional modes increases the likelihood that at least one will succeed experimentally. Moreover, a diverse set of solutions provides researchers with a richer understanding of the solution space. However, explicitly encouraging diversity introduces an additional optimization challenge, as it requires balancing performance against coverage of multiple plausible modes of the design space.
Quality-Diversity algorithms naturally address this need for diversity. Rather than seeking a single optimal solution, QD methods aim to generate a diverse set of high-performing candidates, each corresponding to a distinct behavioral mode defined by a user-specified feature vector [6]. Among QD algorithms, MAP-Elites is widely used for generating diverse, high-performing solution sets by discretising a user-defined feature space and maintaining the best solution per niche [31]. However, QD methods typically assume access to an accurate, or at least queryable, fitness function. In most cases, they operate in online settings, where evaluation feedback can be used to iteratively refine the search. By contrast, the setting of offline QD under epistemic uncertainty, where the objective function must be approximated from limited data, remains largely unexplored. A central challenge in this setting is that optimization should ideally discover novel solutions that improve upon those already present in the offline dataset. Achieving such improvements necessarily requires extrapolating beyond the support of the data using surrogate models. However, extrapolation in high-dimensional sequence spaces is inherently uncertain: surrogate models trained on limited data can be highly unreliable for out-of-distribution sequences. Direct optimization against these models often leads to adversarial or biologically invalid designs that exploit model errors rather than reflecting true biological performance [43, 45, 28].
In this work, we address this gap by proposing Prior-guided Offline MAP-Elites (POME), an uncertainty-aware Quality-Diversity approach for offline design. Our method explicitly accounts for epistemic uncertainty in surrogate models when guiding exploration across the feature space. However, uncertainty alone does not specify where to extrapolate safely beyond the offline data: in biological sequence spaces, many out-of-distribution regions are not only uncertain but biologically invalid, making uninformed exploration ineffective. To support controlled extrapolation, we incorporate foundation models as structured priors over the sequence space. These models, pre-trained on large biological sequence corpora, capture salient biological regularities such as codon usage, regulatory structure, and global plausibility [38, 9].
We show that incorporating foundation models as priors in offline QD optimization helps address the limitations of finite labeled data by injecting prior knowledge over sequence space, guiding search toward more meaningful regions of the search space. We also present POME-MO, a multi objective variant that allows researchers to control the certainty-performance trade-offs of the optimization. We show that explicitly adapting Quality-Diversity optimization to the offline setting is crucial for reliable exploration, and substantially outperforms existing approaches. Compared to prior offline QD methods, our framework consistently improves both performance and diversity across three biological tasks, with gains of 14 − 37% in performance and 22 − 35% in diversity, demonstrating that POME enables robust and dependable exploration under epistemic uncertainty. When compared to offline MBO baselines, our method achieves the most consistent balance across tasks, obtaining the best performance on two tasks and the second-best on the third, while maintaining high diversity and novelty. These results establish our approach as a practical and effective solution for Quality-Diversity optimization in strictly offline regimes. Finally, we show that leveraging foundation models as mutation operators substantially improves search efficiency in high-dimensional discrete design spaces, enabling the discovery of realistic solutions beyond those reachable with uninformed mutations.
Background
Offline model-based optimization. Offline Model-Based Optimization (MBO) [44, 28] is applicable across domains where evaluation is costly or constrained, such as materials discovery [20], robotics [53], and neural architecture search [56], as well as biological sequence design [1, 5, 23]. In offline MBO, algorithm aims to output a batch of candidate solutions, given access only to a static dataset of previously evaluated designs and their corresponding scores. The true target property function is unknown and cannot be queried during optimization. Instead, the algorithm must rely on models learned from the offline data to propose high-performing solutions. Designing bio-sequences in the offline setting presents unique algorithmic and biological challenges. Sequence spaces are combinatorial and discrete. For example, a 50-nucleotide RNA sequence has possible combinations, yet only a minute fraction of this space corresponds to viable biological sequences [39, 51], making exhaustive search infeasible. At the same time, offline optimization assumes access to a static dataset that is often biased: high-performing sequences tend to lie on a thin, under-sampled manifold [44]. These difficulties are further compounded by biological fitness landscapes being highly sensitive, rugged, and multimodal [39], so proximity in sequence space does not imply similar behavior. Without access to new evaluations, surrogate models must extrapolate from limited data, often leading to poor generalization and high epistemic uncertainty. Optimization against such models can exploit prediction errors (objective or reward hacking) widening the sim-to-real gap between computational design and wet-lab validation [44, 43, 45].
Quality-diversity optimization. Quality-Diversity optimization is a class of methods that explicitly aim to maintain collections of high-performing solutions that differ in their qualitative behavior [11, 6]. In many Quality-Diversity algorithms diversity is defined with respect to a user-specified feature vector: a mapping that assigns each solution a low-dimensional vector describing salient aspects of its behavior or structure. The choice of feature space determines along which dimensions diversity is encouraged and is typically domain and task dependent. MAP-Elites [31] is a flagship QD algorithm that operationalises this idea. It partitions a user-defined feature space into cells and stores the best-performing solution (the “elite”) in each. For example, in robotics, Cully et al. [10] describe locomotion controllers by the contact patterns of the robot’s legs with the ground. MAP-Elites then discovers diverse walking strategies characterized by different foot-ground contact behaviors, while optimizing locomotion performance within each niche. New candidates are generated by mutating existing elites, evaluated, and inserted if they outperform the current occupant of the corresponding cell, thereby optimizing performance within each niche while encouraging coverage across the feature space. MAP-Elites typically assumes that evaluations of candidate solutions are reliable. In this setting, the elitist update rule is well justified: elites are retained because they reflect true improvements under accurate evaluations. However, this assumption becomes problematic when evaluations are uncertain [16]. In particular, under imperfect evaluations, the elitism mechanism can cause overestimated solutions to be retained as elites, biasing the archive toward regions where surrogate predictions are least trustworthy. Addressing this failure mode is central to adapting Quality-Diversity optimization to the offline settings.
Problem formulation
We formally define the task of designing diverse biological sequences with specified target properties as an offline model-based quality-diversity optimization problem. Given a finite vocabulary (e.g. nucleotides, amino-acids); a sequence space of all length- sequences; an unknown true objective function (typically capturing the desired biological property); an offline labeled dataset with ; a feature function ; and a discretized feature space partitioned into cells, the goal is to return a batch of sequences that achieve high scores under while exhibiting high diversity in the feature space , ideally covering a significant portion of . Formally, the optimization target is:
The returned batch of sequences aims to include at least one high-performing sequence per feature bin in . Crucially, optimization is performed in a strictly offline setting, without access to online queries of the oracle function .
Method
We propose an offline Quality-Diversity algorithm for sequence design, built on the MAP-Elites framework [31]. We distinguish between two complementary notions of how atypical a sequence is (illustrated in Figure 1a): (i) out-of-distribution with respect to the offline dataset (§ 4.1); and (ii) deviation from natural biological sequences, captured independently of the offline dataset (§ 4.1). We hypothesize that exploration in natural sequence space should be permitted even when surrogate predictions are moderately uncertain, provided that candidates remain biologically plausible. By incorporating a prior over real-world sequence structure, we bias search away from unrealistic regions while still allowing controlled extrapolation toward high-performing designs.

Figure 1. (a) Surrogate and foundation models. (b) Optimization pipeline. Figure 1: Overview of POME, our offline QD optimization framework. (a) An ensemble of surrogate models is trained on the offline dataset, while a foundation model is pre-trained on large unlabeled biological corpora. (b) Sequences are sampled from the archive, mutated using the foundation model, evaluated via an uncertainty-aware combination of surrogate predictions and the foundation model prior, and reinserted if they improve the corresponding cell elite.
Algorithmic components and optimization loop
The proposed algorithm is guided by two core modeling components (see Figure 1a): (i) a foundation model, pretrained on large unlabeled corpora of biological sequences, captures global biological regularities and acts as a prior over the sequence space; and (ii) an ensemble of surrogate models, trained on the labeled offline dataset , which provide task-specific performance predictions and epistemic uncertainty estimates. These models are integrated within a MAP-Elites optimization framework that maintains an archive of candidate sequences organized over a discretized feature space using CVT-MAP-Elites [46]. Optimization proceeds as an iterative loop, following the standard QD paradigm [11] (See Figure 1b). The archive is initialized by inserting a batch of sequences sampled from the offline dataset. At each iteration, the following steps are performed:
Selection: elites are sampled uniformly at random from the current archive. Mutation: Each selected elite is mutated using the foundation model acting as an autoregressive generator. A uniformly random position is selected, and a consecutive subsequence is regenerated, enabling structured, biologically informed exploration in sequence space (§ 4.1). Evaluation: Each candidate sequence is assigned a fitness score using a posterior-based heuristic that combines predicted task performance, epistemic uncertainty, and biological plausibility (§ 4.2). Addition: Each candidate is mapped to its corresponding feature cell and replaces the current elite only if it achieves a higher fitness score under the approximated posterior-based evaluation; otherwise, it is discarded.
Prior: sequence likelihood. We use a sequence likelihood derived from the foundation model, which remains frozen throughout optimization to preserve its learned inductive biases (see Appendix § 10.§ 1). This model is pre-trained in an autoregressive fashion, using a causal next-token prediction objective [14]. The total log-likelihood of a sequence is computed as: , where denotes the prefix . Importantly, this prior is not a Bayesian prior in the traditional sense, but rather a learned proxy for biological plausibility, capturing global constraints learned from real data. It reflects how “natural” the candidate sequence is under the model’s learned distribution. While this prior helps guide the search away from biologically implausible regions of sequence space, it provides no information about task-specific performance and is independent of the target property being optimized. We use this prior estimate both (a) to generate new sequences (see Appendix § 10.§ 5) and (b) within the fitness function, as described in § 4.2.
Surrogate estimation. To estimate task-specific performance and assess the reliability of these predictions for a given candidate sequence, we use an ensemble of independently trained surrogate models, following [26]. Concretely, we train an ensemble of multi-layer perceptrons in a regression setting. For any sequence , each ensemble member produces a scalar prediction of task performance. We compute the ensemble mean , and variance . The ensemble mean provides an estimate of the expected task performance , while the standard deviation reflects epistemic uncertainty in the surrogate predictions. This uncertainty captures model disagreement arising from limited coverage of the offline dataset in a given region of sequence space [18, 22].
Fitness estimation: posterior-guided heuristic
In the evaluation stage of the optimization loop (Figure 1b), each candidate sequence is assigned a fitness score using a posterior-guided estimator, which constitutes the core mechanism by which POME handles epistemic uncertainty in the offline setting. Rather than directly maximizing surrogate predictions, fitness evaluation is framed as approximate posterior inference, explicitly balancing predicted performance with biological plausibility under the foundation model prior. Following a Bayesian decomposition and taking logarithms, this score can be expressed, up to an additive constant, as the sum of a prior term and a likelihood term: .
The log-prior is given by the foundation model as described in § 4.1 and reflects the biological plausibility of a sequence under the model’s learned distribution. The likelihood term is defined as the probability that the task performance exceeds a threshold given sequence . We set , using a percentile-based rule applied consistently across tasks. To instantiate the likelihood term, we assume a Gaussian approximation of the surrogate predictive distribution, , where and are the ensemble mean and variance defined in § 4.1. Under this Gaussian assumption, the log-probability that the true task performance exceeds the threshold is given by: , where denotes the standard normal cumulative distribution function.
This evaluation operator is central to POME: by explicitly integrating biological priors, epistemic uncertainty, and task-specific performance into a single scoring function, it enables reliable selection and replacement decisions in offline MAP-Elites. In combination with foundation model guided mutations, this formulation allows POME to prioritize both high-performing and trustworthy regions of the search space, addressing a key failure mode of offline QD methods.
POME-MO: Multi-objective QD formulation
In addition to the approximated posterior-based approach of POME (§ 4.2), we introduce POME-MO, a multi-objective QD formulation. Motivated by recent work in Uncertain QD, we treat performance and predictive certainty as potentially conflicting objectives [17]. We adopt a multi-objective MAP-Elites framework that maintains Pareto fronts within each feature cell [37], defined over predicted fitness and certainty (see § 4.1 and Figure 2). Importantly, this formulation yields a more interpretable output batch, exposing explicit trade-offs between predicted performance and certainty, rather than collapsing them into a single scalar score. POME-MO shares the same selection and mutation mechanisms as POME, the distinction lies in evaluation and archiving. Instead of assigning a single fitness value, candidates are evaluated along two objectives: predicted fitness () and certainty (). Each feature cell therefore stores a Pareto front rather than a single elite, and new candidates are retained only if they improve this front, with dominated solutions removed. We hypothesize that by preserving solutions that reflect different fitness–uncertainty trade-offs, this formulation allows controlled traversal of high-uncertainty regions when beneficial, facilitating access to otherwise unreachable high-fitness solutions and improving overall coverage relative to fitness-only optimization.

Figure 2. An example of a 2D Pareto front illustrating the trade-off between predicted fitness and certainty across solutions.
Additional details on POME and POME-MO are provided in Appendices § 10.§ 2 and § 10.§ 3.
Experimental setup
We follow the standardized offline model-based optimization protocol introduced in Design-Bench [44]. To enable benchmarking without real-world wet-lab experiments, evaluation is performed using an oracle model trained on a hidden full dataset. A restricted offline dataset, obtained by subsampling this full dataset, is provided to the optimization algorithm and constitutes its only source of supervision. The offline MBO method proposes candidate designs using only this offline subset, without access to the oracle or the remaining data. Candidate designs are evaluated post hoc by the oracle solely for benchmarking purposes. An overview of this evaluation protocol is shown in Appendix C, fig. 5. All methods are evaluated using a batch of solutions, excluding sequences from the initial offline dataset. Further details on archive downsampling are provided in Appendix B.4. More information on the experimental setup and tasks can be found in Appendix C.
Tasks. We evaluate our methods on three biological sequence design tasks from the Design-Bench benchmark suite [44]: 5’UTR, TFBind-10, and GFP. The 5’UTR task involves designing RNA sequences of length 50 to maximize ribosome load. The oracle is a ResNet-based predictor following the Design-Bench protocol. The offline datasets are constructed to emphasise low-performing regions of the search space by retaining only the bottom 50% of sequences ranked by predicted ribosome load. Mutations and biological plausibility priors are provided by a Helix-mRNA foundation model [50]. Feature vectors are defined using nucleotide frequency statistics, as proposed in one-shot QD [26]. The TFBind-10 task requires designing 10-nucleotide DNA sequences that maximize binding affinity to the pho4 transcription factor. The dataset originates from the exhaustive binding assay of Barrera et al. [2], and the oracle corresponds to an exact lookup table over the full sequence space. The offline dataset consists of sequences sampled uniformly from the bottom 50% of the affinity distribution. We use the Hyena-DNA [34] foundation model to guide mutations and impose biological plausibility. Feature vectors are defined based on sequence-space similarity to the offline dataset, following the one-shot QD framework [26]. The GFP task focuses on protein sequence design to maximize fluorescence of green fluorescent protein [42]. We use a ResNet-based oracle and construct the offline dataset by subsampling one third of the full dataset with probability proportional to , where denotes the oracle-predicted fluorescence score, biasing the dataset toward low-performing sequences. Mutations and prior estimates are guided by the ProtGPT2 protein foundation model [14]. Feature vectors are defined as in one-shot QD, capturing sequence-space similarity to the offline dataset.
Objectives. All evaluation metrics are computed with respect to the oracle model, which serves as a proxy for the true task-specific performance. Following the evaluation protocol used in previous works [26, 23], for an output batch of solutions, we report: Performance: Mean and maximum normalized oracle-predicted score over the output batch . Diversity: Average pairwise distance between all proposed solutions in . Novelty: Average distance of each proposed solution to its nearest neighbour in a reference set.
Baselines. We compare against a set of standard offline model-based optimization baselines and relevant Quality-Diversity methods. These include CbAS [5], which conditions a generative model on high predicted fitness; CMA-ES [21], an evolutionary strategy that adapts a search distribution using surrogate fitness evaluations; COMs [45], a conservative gradient-based offline optimization method that trains conservative surrogates by penalizing overestimation; GRAD, a simple gradient ascent baseline that directly optimizes the surrogate ensemble mean prediction; REINFORCE [48], a policy-gradient sequence optimization method; and BO-qEI [49], a Bayesian optimization baseline. We additionally include two QD approaches: MAP-Elites [31], using surrogate ensemble predictions to approximate fitness, and QD-One-Shot [26], an uncertainty-aware MAP-Elites variant that penalizes surrogate uncertainty and uses COMs as the surrogate models. For full details of all baselines, see Appendix C.3.
Results
We evaluate all methods on three design tasks, with all reported metrics averaged across 10 independent runs and reported as (mean std).
Performance across sequence design tasks
On the UTR task, POME achieves the strongest overall mean and max performance, while maintaining competitive diversity and novelty (Table 1). Offline MBO baselines such as CbAS, COMs,
| Name | Max | Mean | Diversity | Novelty |
| CbAS | 0.95 ± 0.01 | 0.71 ± 0.03 | 26.74 ± 0.60 | 19.70 ± 0.13 |
| BO-qEI | 0.88 ± 0.07 | 0.77 ± 0.05 | 27.61 ± 0.69 | 20.64 ± 0.40 |
| CMA-ES | 0.99 ± 0.01 | 0.58 ± 0.04 | 25.01 ± 1.20 | 21.24 ± 0.21 |
| GRAD | 0.91 ± 0.03 | 0.60 ± 0.01 | 26.26 ± 0.25 | 19.05 ± 0.19 |
| REINFORCE | 0.94 ± 0.02 | 0.67 ± 0.02 | 28.44 ± 0.11 | 19.60 ± 0.06 |
| COMs | 0.96 ± 0.02 | 0.75 ± 0.03 | 27.51 ± 0.90 | 19.67 ± 0.20 |
| MAP-Elites | 0.85 ± 0.01 | 0.77 ± 0.00 | 18.68 ± 0.39 | 19.59 ± 0.06 |
| One-Shot QD | 0.86 ± 0.02 | 0.77 ± 0.01 | 18.90 ± 1.97 | 19.60 ± 0.08 |
| POME | 1.03 ± 0.02 | 0.86 ± 0.01 | 25.55 ± 1.38 | 20.24 ± 0.21 |
| POME-MO | 0.99 ± 0.00 | 0.77 ± 0.00 | 26.63 ± 1.09 | 19.66 ± 0.15 |
Table 1. Performance, diversity, and novelty on the 5’UTR task. Results are averaged over 10 runs.
CMA-ES, and REINFORCE attain strong maximum scores and high diversity, but exhibit weaker mean performance, suggesting exploration into unreliable regions of the search space far from the offline data, leading to overestimation. On the TFBind-10 task, POME achieves the strongest overall performance, attaining the highest maximum score (0.89) and the highest mean score (0.61), tied with POME-MO (Table 2). Among the baselines, REINFORCE and CbAS achieve the highest diversity, but lag behind in mean performance, again suggesting overoptimistic optimization in the offline setting. The GFP landscape is the largest among the evaluated tasks in terms of both sequence length and vocabulary size, and exhibits particularly sharp trade-offs between exploration and reliability in offline optimization (Table 3). REINFORCE and BO-qEI show highly exploitative behavior: given relatively strong initial sequences, they achieve near-optimal scores by collapsing to a narrow region of sequence space, leading to very low diversity and novelty. COMs achieves moderate performance but exhibits unstable behavior, characterized by high variance and very limited diversity. In contrast, CMA-ES explores extremely broadly, achieving by far the highest diversity and novelty, but at the cost of poor performance, suggesting largely unguided exploration. Among methods that achieve more balanced coverage and do not collapse in diversity and novelty, POME and POME-MO attain the strongest overall performance, achieving the highest maximum and mean scores among the remaining approaches. CbAS remains competitive, maintaining high diversity and novelty, but with comparatively lower performance.
| Name | Max | Mean | Diversity | Novelty |
| CbAS | 0.85 ± 0.05 | 0.58 ± 0.01 | 6.52 ± 0.02 | 2.36 ± 0.04 |
| BO-qEI | 0.67 ± 0.11 | 0.56 ± 0.00 | 6.52 ± 0.03 | 2.29 ± 0.04 |
| CMA-ES | 0.88 ± 0.04 | 0.60 ± 0.02 | 5.07 ± 0.33 | 2.39 ± 0.08 |
| GRAD | 0.82 ± 0.06 | 0.57 ± 0.01 | 6.45 ± 0.04 | 2.31 ± 0.06 |
| REINFORCE | 0.85 ± 0.03 | 0.57 ± 0.01 | 6.53 ± 0.04 | 2.30 ± 0.05 |
| COMs | 0.74 ± 0.02 | 0.51 ± 0.02 | 6.00 ± 0.08 | 2.23 ± 0.04 |
| MAP-Elites | 0.78 ± 0.02 | 0.61 ± 0.01 | 5.27 ± 0.11 | 2.62 ± 0.05 |
| One-Shot QD | 0.78 ± 0.02 | 0.61 ± 0.00 | 5.23 ± 0.10 | 2.66 ± 0.08 |
| POME | 0.89 ± 0.02 | 0.61 ± 0.01 | 6.51 ± 0.19 | 2.51 ± 0.10 |
| POME-MO | 0.80 ± 0.05 | 0.61 ± 0.00 | 5.94 ± 0.11 | 2.59 ± 0.07 |
Table 2. Performance, diversity, and novelty on the TFBind task. Results are averaged over 10 runs.
| Name | Max | Mean | Diversity | Novelty |
| CbAS | 0.87 ± 0.07 | 0.45 ± 0.02 | 22.99 ± 1.78 | 10.49 ± 0.93 |
| BO-qEI | 0.99 ± 0.01 | 0.98 ± 0.00 | 3.32 ± 0.11 | 1.33 ± 0.04 |
| CMA-ES | 0.50 ± 0.03 | 0.29 ± 0.01 | 194.03 ± 1.3 | 183.1 ± 2.12 |
| GRAD | 0.27 ± 0.14 | 0.16 ± 0.19 | 4.95 ± 1.50 | 78.86 ± 27.58 |
| REINFORCE | 0.99 ± 0.00 | 0.98 ± 0.00 | 1.98 ± 0.18 | 0.66 ± 0.09 |
| COMs | 0.76 ± 0.30 | 0.76 ± 0.30 | 0.11 ± 0.16 | 6.72 ± 9.51 |
| MAP-Elites | 0.55 ± 0.10 | 0.43 ± 0.01 | 9.21 ± 0.67 | 7.76 ± 0.17 |
| One-Shot QD | 0.70 ± 0.19 | 0.40 ± 0.01 | 10.05 ± 0.96 | 7.39 ± 0.22 |
| POME | 0.96 ± 0.02 | 0.48 ± 0.03 | 12.29 ± 0.61 | 7.77 ± 0.25 |
| POME-MO | 0.95 ± 0.03 | 0.49 ± 0.02 | 13.61 ± 0.61 | 7.79 ± 0.18 |
Table 3. Performance, diversity, and novelty on the GFP task. Results are averaged over 10 runs.
To assess offline MBO methods, it is necessary to jointly evaluate solution quality and population-level properties. Figure 3 plots mean and maximum oracle performance against diversity across all methods and tasks, with starred points denoting Pareto optimal solutions. POME is the only method that Pareto dominates competing approaches in both mean and maximum performance diversity trade-offs across all three datasets. POME attains the highest peak performance on UTR and TFBind and the second-best performance on GFP, while maintaining diverse and stable repertoires. POME-MO further shows that explicitly preserving performance–uncertainty trade-offs within each niche improves coverage in more challenging landscapes.

Figure 3. Quality-Diversity trade-offs across tasks (max and mean score vs. diversity). Starred points denote Pareto-optimal methods and lines connect the Pareto front.
Behavior in comparison to the QD baselines
POME achieves gains of 14-37% in maximum performance and 22-35% in diversity over the QD baselines. This suggests that, when applying QD in the offline regime, either without accounting for epistemic uncertainty and biological priors (as in MAP-Elites), or by accounting for uncertainty but without incorporating design-space priors (as in One-Shot QD), optimization becomes biased toward overestimated surrogate predictions. These results are further supported by differences in optimization dynamics between the QD baselines and POME, as shown in Figure 4. On the GFP and 5’UTR tasks, MAP-Elites and One-Shot QD exhibit unstable behavior: after an initial improvement over the offline dataset, the true oracle score decreases over optimization, while surrogate predictions continue to increase. This suggests that surrogate overestimation drives the search toward unreliable areas when epistemic uncertainty is not adequately controlled. In contrast, POME maintains both higher and more stable oracle performance throughout optimization, alongside improved alignment between trends in surrogate predictions and true outcomes (we focus on trend alignment rather than absolute prediction values, since MAP-Elites operates via a comparative elite-selection mechanism). This stability translates into stronger archive-level quality and more reliable elite retention.

Figure 4. Relationship between surrogate-predicted score and true oracle performance across tasks (mean top-128 scores). Baseline QD methods show misalignment, whereas POME yields closer and more consistent alignment throughout optimization. Note that surrogate scores are on different scales across methods, hence plots are shown separately. Oracle evaluations are performed post hoc for analysis only and are not used at any stage of training, model development, or optimization.
Extended analysis and ablation studies
We conduct extensive evaluations to further characterize POME. In Appendix § 12, we report additional QD metrics. In Appendix § 13, we provide a computational complexity analysis. Furthermore, we conduct ablation studies to isolate the contributions of POME’s key components, including: (i) replacing foundation model-guided mutations with random mutations (Appendix § 14.§ 1), (ii) removing the surrogate model and relying solely on the foundation model prior for fitness estimation (Appendix § 14.§ 2), (iii) removing per-sample uncertainty estimation (Appendix § 14.§ 3), (iv) evaluating sensitivity to the quantile threshold (Appendix § 14.§ 4), and (v) assessing robustness to the choice of uncertainty estimator by replacing the ensemble with a Gaussian Process surrogate (Appendix § 14.§ 5). We additionally compare two variants, POME-Exp (Appendix § 14.§ 6.2) and POME-Pair (Appendix § 14.§ 6.1), which incorporate uncertainty and priors through alternative fitness formulations.
Related work
QD methods have shown strong performance in domains such as robotics and materials discovery [10, 25], but their application to bio-sequence design, particularly in offline settings, remains largely unexplored. To our knowledge, the only work applying QD to offline bio-sequence design is Donà et al. [26], which adapts MAP-Elites to this regime using Conservative Objective Models [45] and uncertainty-penalized scoring. More broadly, many QD extensions, such as surrogate-assisted methods including SAIL and BOP-Elites [19, 27], as well as gradient-informed discrete emitters [3], assume repeated oracle access. Most existing QD methods that model uncertainty [17, 16] are designed for aleatoric uncertainty, where repeated oracle queries allow uncertainty to be reduced through resampling, an assumption that does not hold in offline settings. In parallel, offline model-based optimization has become a prevalent paradigm for biological sequence design, driven by the cost of wet-lab evaluation [44]. These methods rely on surrogate models - ranging from neural networks and ensembles to Conservative Objective Models [45] and language model–based predictors [7], to approximate the oracle while mitigating OOD overestimation. Candidate sequences are generated through gradient-based optimization [45], generative models such as CbAS [5], or model-based reinforcement learning [1]. While these approaches achieve strong performance, they typically focus on identifying a single optimum or a small set of high-scoring solutions. In contrast, biological design often requires diverse batches of high-performing candidates, as highlighted in recent works such as GFlowNets [23], DynAMO [52], and one-shot QD [26]. This motivates integrating offline model-based optimization with quality-diversity principles. Our work lies at this intersection, combining offline surrogate-based optimization with QD to produce diverse, high-quality sequences under epistemic uncertainty. A more detailed discussion of our positioning relative to multi-objective QD, Bayesian optimization, and online surrogate methods is provided in Appendix § 9.
Conclusion, limitations and future work
We introduced POME, an uncertainty-aware Quality-Diversity framework for offline design that integrates surrogate predictions with epistemic uncertainty and foundation-model priors. Across tasks, POME achieves the strongest balance between performance, diversity, and novelty. Our analysis further shows that uncertainty awareness alone is insufficient in offline QD: without structured priors, QD methods remain vulnerable to surrogate overestimation. By coupling uncertainty-aware selection with generative priors, our framework enables controlled and reliable exploration of high-performing regions of the sequence space under strict offline constraints. Overall, these results indicate that our approach enables robust quality-diversity optimization in offline regimes. Our study has several limitations that point to natural directions for future work. Firstly, our evaluation is benchmark-based with approximated oracles. While standard for offline MBO, bridging the gap to wet-lab validation remains a critical next step for experimental translatability. Specifically, future research should explore multi-stage validation to assess if uncertainty-aware selection improves real-world success rates. Furthermore, the framework could be extended to broader settings, such as handling variable-length sequences and multi-objective optimization. Finally, future work could explore richer feature vectors, account for uncertainty in feature estimation itself, and extend the framework beyond biological sequences to other design domains with structured priors.
Extended related work
In this section, we provide a more detailed discussion of the positioning of our work relative to Multi-Objective Quality-Diversity (MO-QD) and online surrogate-assisted QD.
Distinctions from state-of-the-art and online QD
Our work focuses on improving offline optimization under surrogate uncertainty in biological sequence design. Since QD-One-Shot [26] is, to our knowledge, the only prior work directly targeting offline QD for biological sequence design, we consider it the most relevant - and we use it as our main baseline alongside MAP-Elites. Most other state-of-the-art methods assume an online or active-learning setting with repeated oracle access. This includes:
Surrogate-assisted quality diversity This research line uses surrogate models to improve sample efficiency in expensive domains, typically via an active learning loop: the surrogate guides candidate selection for true oracle evaluation, and the model is then periodically retrained on newly acquired data. For example, SAIL [19] utilizes Gaussian Process surrogates and uncertainty-aware acquisition maps to balance exploitation and exploration. Similarly, BOP-Elites [27] employs Expected Joint Improvement of Elites (EJIE) to model objectives and descriptors. Crucially, because these methods rely on the iterative refinement of surrogates through repeated oracle queries, they are not directly applicable to the strictly offline regime.
QD in discrete spaces Biological sequence design involves discrete search spaces where standard gradient-based optimization is not directly applicable. ME-GIDE [3] addresses this by estimating gradients to construct mutation proposal distributions that bias the search toward promising neighbors. However, ME-GIDE assumes an online setup with repeated oracle access. This makes it unsuitable for the strictly offline regime where the model cannot be iteratively updated.
QD under aleatoric uncertainty Recent research has explored Quality-Diversity under aleatoric uncertainty, primarily in stochastic environments like robotics or game generation [16, 17]. While both aleatoric and epistemic uncertainty produce fitness variance, their problem formulations and solution strategies differ fundamentally. Aleatoric methods assume estimates can be refined via repeated oracle queries, an interaction loop that is unavailable in offline settings. Consequently, their evaluation protocols and reliance on resampling are not directly applicable to the strictly offline regime, where uncertainty is epistemic and exploration must be carefully managed to avoid unreliable solutions caused by distribution shift.
Multi-objective quality-diversity
Several works have explored the intersection of multi-objective optimization and QD. These generally fall into two categories:
Diversity as an objective: One approach treats novelty and fitness as two objectives but with only local competition between solutions, making it structurally similar to MAP-Elites [30]. Other methods utilize specific selection operators [47] or treat quality and diversity as optimization targets, but again within a single-objective fitness framing [13]. Crucially, in all three cases the two "objectives" are fitness and diversity, whereas in POME-MO, diversity is handled by the archive structure as in standard QD, and the two objectives are instead predicted performance and surrogate certainty, both of which are fitness-level quantities we seek to jointly optimize.
"True" multi-objective QD: Approaches such as multi-objective evolutionary diversity optimization [33] and multi-objective covariance matrix adaptation [55] optimize multiple independent fitness objectives within each cell of a QD archive. However, these frameworks are designed for online settings with repeated oracle access. Under strict offline conditions, the benefit of such machinery is ultimately bounded by surrogate reliability rather than the multi-objective strategy itself.
Our approach, POME-MO, differs structurally from these. In POME-MO, diversity is handled by the archive structure as in standard QD, and the two objectives are instead predicted performance and surrogate certainty.
Additional method details
Biological foundation models as inductive biases
Autoregressive biological foundation models show strong generation and evaluation capabilities. For example, Evo 2 models genomic sequences at scale [4], while long-context models generate viable bacteriophage genomes validated in wet-lab experiments [29]. Such models capture biological structure and can predict functional properties across diverse holdout datasets derived from experimental measurements. This includes HyenaDNA [34], ProtGPT2 [14], Helix-mRNA [50]. These results suggest that autoregressive foundation models provide a powerful inductive bias over biological sequence space, capturing syntactic regularities and functional signals.
Posterior-guided heuristic scoring
Each candidate sequence is assigned a scalar fitness score derived from an approximate posterior over high-performing sequences. The score combines a task-agnostic biological prior with a task-specific likelihood term derived from the surrogate ensemble.
Threshold definition. We define a performance threshold using a fixed quantile of the offline dataset:
where and denote the minimum and maximum oracle values in the offline dataset. We use in all experiments.
Surrogate likelihood. For each sequence , the surrogate ensemble produces a predictive mean and variance . We approximate the predictive distribution as
Under this assumption, the likelihood that the true performance exceeds the threshold is given by
where denotes the standard normal cumulative distribution function.
Final score. The final fitness score used for archive insertion is defined as
where is the sequence log-likelihood under the frozen foundation model prior.
While the fitness score is structured according to a Bayesian decomposition, we clarify that its instantiation in POME serves as a principled posterior-guided heuristic. We distinguish this from strict Bayesian inference in three ways. First, the likelihood is derived from a surrogate ensemble trained on biased offline data. Second, the Gaussian assumption used for the predictive distribution is a heuristic approximation intended to provide a tractable, uncertainty-aware signal for elite replacement. Finally, the foundation model acts as a "biological prior" by capturing structural regularities from vast unlabeled corpora rather than representing a traditional subjective prior belief. This formulation remains a principled way to balance task performance, epistemic uncertainty, and biological validity, which we find is crucial for stable and reliable exploration in strictly offline regimes.
Multi-objective QD (POME-MO)
POME-MO extends POME to a multi-objective quality-diversity setting while preserving the same feature space, selection strategy, and mutation operators. At each iteration, elites are sampled uniformly from the archive and mutated using foundation-model-guided operators, as in the single-objective variant.
Objectives. Instead of assigning a single scalar fitness, each candidate sequence is evaluated along two objectives: predicted fitness and predictive certainty , obtained from the surrogate ensemble (section 4.1). These objectives capture a trade-off between performance and reliability under surrogate uncertainty.
Archive structure and insertion. Each feature cell maintains a Pareto front over the two objectives rather than a single elite. A candidate is inserted into a cell if it is non-dominated with respect to the current Pareto front, in which case any dominated solutions are removed. To preserve diversity along the Pareto front and limit archive growth, we adopt crowding-based replacement mechanisms following Janmohamed et al. [24], maintaining a maximum Pareto front size of 10 solutions per cell.
Downsampling of archives
All methods are evaluated using a fixed output batch size of sequences. Since MAP-Elites based methods maintain archives whose size depends on the feature discretisation, a downsampling step is required to produce a final repertoire of fixed cardinality.
POME. For POME we follow the downsampling procedure introduced in one-shot QD [26]. Specifically, we construct a Centroidal Voronoi Tessellation (CVT) with cells using the empirical distribution of solutions in the final archive, and reinsert all candidates into this reduced grid, retaining the highest-scoring solution per cell.
POME-MO: Multi-objective archives. This naive downsampling strategy is not suitable for POME-MO, as each cell contains a Pareto front over predicted fitness and certainty rather than a single elite. Downsampling solely based on predicted fitness leads to the retention of high-uncertainty solutions and results in an archive dominated by surrogate-driven regions of the search space.
To address this, we first rediscretize the feature space into CVT cells using the full set of solutions in the final POME-MO archive. Candidates are then reinserted into the reduced grid using the posterior-guided fitness score defined in § 4.2. This procedure yields a fixed-size repertoire that reflects a balance between predicted performance, surrogate uncertainty, and the foundation-model prior.
Common implementation details
All hyperparameters are selected solely based on validation performance on the offline dataset, in line with the offline model-based optimization setting. No ground-truth oracle queries beyond the provided offline dataset are used. All learned surrogate models are trained exclusively on the offline dataset and evaluated on a held-out validation split using identical optimization settings across methods.
The algorithm was run for 20,000 iterations. At each iteration, a batch of 128 genomes was sampled from the repertoire. Each genome in the batch was independently mutated and reinserted into the archive. The archive is structured as a CVT grid with 2,000 cells, following [26].
Surrogate ensembles. Surrogate predictors are implemented as ensembles of neural networks. Following prior work [26, 23, 45], each network consists of two hidden layers of width 2048 with ReLU activations. We additionally adopt the same relaxed input representation and training hyperparameters as in these works.
The input to each network is a relaxed, continuous approximation of a one-hot encoded sequence, given by
where , denotes the one-hot encoding, and is the vocabulary size. Since this transformation introduces a linear dependency between the coordinates of , the final dimension is removed to eliminate redundancy.
All surrogate models are trained using the Adam optimizer with a learning rate of , batch size 128, and for 50 epochs. Ensemble members are trained independently with different random initialisations, using a mean squared error loss.
Mutation operator. Offspring are generated by substituting a single position in the parent sequence using a frozen autoregressive foundation model. The mutation location is sampled uniformly at random, and exactly one mutation is applied per offspring. Following one-shot QD [26], on the GFP task we constrain mutations to remain within an edit distance of at most 10 from the wild-type sequence. This reflects the structure of the GFP task, which consists almost entirely of sequences mutated by at most 10 positions from the wild type, with the majority lying within a smaller edit distance. If a mutation causes a sequence to exceed this threshold, the mutated position is reverted.

Figure 5. Overview of the offline model-based optimization evaluation protocol. A hidden dataset is used to train an oracle, which may be used to relabel the visible offline dataset provided to the optimization algorithm. The offline MBO method then generates a batch of candidate designs, which are evaluated by the oracle for benchmarking.
Experimental setup
Tasks
We evaluate our methods on three sequence design tasks drawn from the Design-Bench benchmark suite [44]. These tasks represent distinct biological settings: mRNA translation efficiency, DNA transcription factor binding, and protein fluorescence. They differ in sequence length, vocabulary size, offline data subsampling, and oracle structure. Below, we describe the setup and preprocessing used for each task.
5’ Untranslated Transcribed Region (5’UTR). The 5’UTR task involves designing mRNA sequences of length 50 that achieve maximal ribosome load. The 5’ untranslated region (5’UTR) is a non-coding segment upstream of the coding sequence that strongly influences translation initiation [32]. Ribosome load refers to the number of ribosomes actively translating an mRNA and is a proxy for protein expression level. Following the approach of Trabucco et al., we adopt the filtering procedure from Sample et al. [41], selecting the top 280,000 sequences with the highest total read counts. This yields a dataset of mRNA sequences of length 50 paired with their corresponding ribosome load values.
Transcription Factor Binding 10 (TFBind-10). The TFBind10 task requires designing 10-nucleotide DNA sequences that maximize binding affinity with the transcription factor pho4. Binding affinity quantifies how strongly a DNA sequence interacts with a transcription factor. The pho4 transcription factor is a well-studied yeast regulator. The dataset originates from the large-scale transcription factor binding activity survey of Barrera et al. [2]. Unlike the UTR task, the full sequence space ( possibilities) is completely characterized, and the oracle therefore corresponds to an exact lookup table of binding affinities. In our preprocessing, we remove duplicate sequences by averaging their reported affinities.
Green Fluorescent Proteins (GFP). The GFP task is based on the Green Fluorescent Protein dataset introduced by Sarkisyan et al. [42]. The dataset studies how mutations of the Aequorea victoria protein affect fluorescence and consists of approximately 50,000 protein variants. All sequences are of fixed length 237 and are obtained through random substitutions relative to the wild-type sequence. We use the processed version released by Brookes et al. [5], following prior work [45, 23, 26].
Following one-shot QD [26], all datasets are min-max normalized prior to optimization.
Oracles
Following [44, 26], we use an approximate oracle based on a ResNet architecture for the 5’UTR and GFP tasks, since the available data does not cover the entire sequence space. The architecture consists of an embedding layer, a two-layer residual convolutional network, a self-attention layer, and a final linear projection. Input sequences are -normalized to zero mean and unit variance. For TFBind10, the oracle is an exact lookup function, as binding affinities are available for the complete sequence space.
To verify that our ResNet oracles are comparably reliable to those used in [26, 44], we evaluate their performance on held-out validation data. Our oracles achieve Spearman rank correlations of 0.8707 for the 5’UTR task and 0.8723 for the GFP task. These values fall within 1.5–2.5% of previously reported results. The trained oracles are used to relabel the sampled offline datasets.
Table 4 summarises the sequence design tasks used in our experiments, including their sequence space, objectives, oracle models, and offline datasets.
| Task | Sequence Space | Objective | Oracle | Offline Dataset |
| 5’UTR | 50-nt RNA (A, C, G, U) | Maximize ribosome load | ResNet-Based | 140,000 samples (bottom 50%) Range: – 0.1679-0.5924 (data) – 0.1632-0.7179 (oracle) |
| TFBind-10 | 10-nt DNA (A, C, G, T) | Maximize binding affinity (pho4) | Exact lookup | 100,000 samples (sampled uniformly from bottom 50%) Range: – 0.0-0.556 (data) – 0.0-1.0 (oracle) |
| GFP | 237-AA Protein | Maximize fluorescence values | ResNet-Based | 18,695 samples (sampled ) Range: – 0.7351-0.9614 (data) – 0.7351-0.9784 (oracle) |
Table 4. Overview of the sequence design tasks used in our experiments.
Baseline details
For the classic offline MBO baselines, we use the same architectures and implementations as defined in the Design-Bench benchmarking work [44]. Following prior work [44, 26, 52, 23], all non-QD baselines (CbAS, BO-qEI, CMA-ES, GRAD, REINFORCE, and COMs) generate multiple candidate sequences using their respective optimization or sampling procedures. For example, CbAS produces candidates by sampling from a learned generative distribution, whereas GRAD produces the final set of sequences obtained by running multiple gradient-based optimization trajectories in parallel.
For methods utilising MLP surrogate models, the architectures and training protocols (learning rates, number of epochs, and ensemble sizes) are kept identical to those described in Appendix § 10.§ 5, ensuring that performance differences arise from the search strategy rather than surrogate capacity.
MAP-Elites. We implement a MAP-Elites [31] variant tailored for fair comparison. We use a random mutation operator in which a position in the sequence is chosen uniformly at random and a single random substitution is performed. The surrogate model is an ensemble of ten MLPs trained on the offline dataset, consistent with the POME variants. Fitness predictions are obtained by averaging across ensemble members, modeling for a design with score . The insertion rule follows the standard MAP-Elites procedure, replacing the current elite in a cell if the new candidate achieves higher fitness.
QD-One-Shot. We implement the uncertainty-aware MAP-Elites variant for one-shot biological sequence design proposed by Donà et al. [26]. Unlike standard MAP-Elites, the surrogate model is an ensemble of ten MLPs trained as Conservative Objective Models (COMs) [45]. Each ensemble member produces a point prediction, from which the mean and standard deviation are computed. The aggregated fitness is penalized by a -scaled uncertainty term, , encouraging the selection of candidates that achieve high predicted performance while remaining in regions of lower epistemic uncertainty. Random mutation is performed using the same operator as in MAP-Elites.
For fair comparison, both QD-based baselines use the same pipeline parameters as the POME variants, including the number of iterations, number of niches, batch size, feature space definitions, and the maximum mutation constraints applied in the GFP task, as specified in Appendix § 10.§ 5.
Extended quality-diversity analysis
We provide a deeper analysis of the archive-level performance to further distinguish POME from existing offline QD baselines. Results are averaged over 10 runs (mean std).
The archive profile describes the distribution of performance across the archive by measuring the percentage of cells that contain an elite with an oracle-verified score above a specified threshold . Notably, POME shifts a significantly larger portion of the archive into high-fitness regions () compared to QD baseline approaches.
| Dataset | Method | ||||
| 5’UTR | MAP-Elites | ||||
| 5’UTR | One-Shot QD | ||||
| 5’UTR | POME | ||||
| 5’UTR | POME-MO | ||||
| TFBind | MAP-Elites | ||||
| TFBind | One-Shot QD | ||||
| TFBind | POME | ||||
| TFBind | POME-MO | ||||
| GFP | MAP-Elites | ||||
| GFP | One-Shot QD | ||||
| GFP | POME | ||||
| GFP | POME-MO |
Table 5. Archive profile: percentage of cells exceeding oracle thresholds .
Computational complexity analysis
We provide a detailed breakdown of the computational requirements of POME, distinguishing between one-time and per-iteration costs. Let be the number of candidates per batch, the ensemble size, the sequence length, and the offline dataset size.
One-time cost:
Surrogate training: (each MLP is 2-layer, constants omitted)
Foundation model: none (pre-trained, frozen).
Per iteration:
Surrogate inference: .
QD updates: .
Mutation + prior: . For decoder-only transformers, this scales as .
Comparison to base QD. Standard MAP-Elites incurs for surrogate evaluation, for QD updates, and for uninformed mutations. Although the foundation model in POME adds compute, it requires no training cost and enables compute-performance trade-offs. Overall, POME’s cost scales polynomially in (linear for surrogates, up to quadratic for transformers), avoiding combinatorial scaling despite the exponential search space.
While POME introduces additional computational overhead relative to base QD methods, we believe this trade-off is justified in the context of offline biological design. In this regime, the cost of extra compute is relatively low when compared to the high resource and time requirements of wet-lab validation. Since biological evaluation is a multi-stage and expensive process, we consider the allocation of additional compute to improve the reliability of proposed candidates a worthwhile investment.
Moreover, the QD loop is inherently parallelizable, surrogate and foundation model inference can be batched on GPUs, and frameworks (e.g., QDax) can accelerate execution. We therefore expect substantial speedups with standard parallelization without modifying the algorithm.
Empirical computational cost (UTR): Table 6 reports the runtime and power consumption averaged over 10 runs (20k iterations) on the UTR task. POME incurs approximately runtime and higher peak power than MAP-Elites, reflecting the foundation model overhead.
| Method | Runtime (min) | Peak GPU Power (W) |
| MAP-Elites | 20.89 | 192.51 |
| POME | 41.40 | 218.68 |
Table 6. Computational cost on the UTR task (averaged over 10 runs).
Ablation studies
This appendix presents supplementary ablation experiments analysing the contributions of individual components of POME and POME-MO. Results are reported separately for each task (5’UTR, TFBind-10, and GFP) as mean and standard deviation over 5 independent runs, and follow the same evaluation protocol as the main experiments.
Effect of foundation model guided mutations
To assess the role of structured mutations, we replace foundation model guided mutations with uninformed random token substitutions while keeping all other components fixed. Results for both POME and POME-MO across all tasks are reported in Table 7.
| Task | Method | Max | Mean | Diversity | Novelty |
| UTR | POME | ||||
| UTR | POME (random mut.) | ||||
| UTR | POME-MO | ||||
| UTR | POME-MO (random mut.) | ||||
| TFBind | POME | ||||
| TFBind | POME (random mut.) | ||||
| TFBind | POME-MO | ||||
| TFBind | POME-MO (random mut.) | ||||
| GFP | POME | ||||
| GFP | POME (random mut.) | ||||
| GFP | POME-MO | ||||
| GFP | POME-MO (random mut.) |
Table 7. Ablation of foundation-model guided mutations across tasks.
Effect of removing the surrogate model
We next evaluate variants that remove surrogate-based scoring and rely solely on the foundation model prior. This ablation applies to the posterior-based POME formulation; POME-MO is excluded as it explicitly relies on surrogate-derived objectives. Results across tasks are shown in Table 8.
| Task | Method | Max | Mean | Diversity | Novelty |
| UTR | POME | 1.03 ± 0.02 | 0.86 ± 0.01 | 25.55 ± 1.38 | 20.24 ± 0.21 |
| UTR | Prior-only | 1.00 ± 0.01 | 0.82 ± 0.02 | 25.20 ± 0.35 | 20.62 ± 0.07 |
| TFBind | POME | 0.89 ± 0.02 | 0.61 ± 0.01 | 6.51 ± 0.19 | 2.51 ± 0.10 |
| TFBind | Prior-only | 0.86 ± 0.01 | 0.58 ± 0.01 | 6.74 ± 0.07 | 2.43 ± 0.07 |
| GFP | POME (full) | 0.96 ± 0.02 | 0.48 ± 0.03 | 12.29 ± 0.61 | 7.77 ± 0.25 |
| GFP | Prior-only | 0.91 ± 0.02 | 0.47 ± 0.02 | 15.27 ± 0.73 | 7.97 ± 0.19 |
Table 8. Effect of removing surrogate-based scoring across tasks.
Uncertainty adaptivity
We compare adaptive, per-sample uncertainty estimation against a fixed uncertainty coefficient set to 1, which effectively assumes a normal distribution with constant variance and does not use the ensemble-predicted standard deviation on a per-sample basis. Results across all tasks are reported in Table 9.
| Task | Method | Max | Mean | Diversity | Novelty |
| UTR | POME (full) | 1.03 ± 0.02 | 0.86 ± 0.01 | 25.55 ± 1.38 | 20.24 ± 0.21 |
| UTR | Fixed uncertainty | 1.03 ± 0.01 | 0.82 ± 0.01 | 28.14 ± 1.00 | 20.46 ± 0.17 |
| TFBind | POME (full) | 0.89 ± 0.02 | 0.61 ± 0.01 | 6.51 ± 0.19 | 2.51 ± 0.10 |
| TFBind | Fixed uncertainty | 0.86 ± 0.03 | 0.62 ± 0.00 | 6.20 ± 0.37 | 2.54 ± 0.07 |
| GFP | POME (full) | 0.96 ± 0.02 | 0.48 ± 0.03 | 12.29 ± 0.61 | 7.77 ± 0.25 |
| GFP | Fixed uncertainty | 0.79 ± 0.20 | 0.44 ± 0.01 | 12.23 ± 0.45 | 7.80 ± 0.08 |
Table 9. Effect of adaptive vs. fixed uncertainty estimation.
Discussion. First, replacing foundation model guided mutations with uninformed random mutations reduces maximum performance on two of the three tasks (Table 7). This indicates that structured mutations are essential for efficiently navigating high-dimensional sequence spaces. Second, removing the surrogate model and relying solely on the foundation model prior for fitness estimation also results in a clear performance decrease (Table 8). This demonstrates that biological plausibility alone is insufficient for task-driven optimization, and that surrogate predictions are critical for directing search toward high-performing regions. Finally, removing per-sample uncertainty estimation from the surrogate model (effectively assuming a fixed normal distribution) leads to a substantial drop in performance, with the maximum GFP score decreasing from 0.96 to 0.79 and the mean 5′UTR score decreasing from 0.86 to 0.82 (table 9). Together, these results support our central claim that effective offline QD optimization requires the joint use of structured priors and uncertainty-aware surrogate guidance.
Sensitivity to threshold via
The likelihood estimation in POME depends on the threshold via the quantile parameter . We study its effect by varying and report results below.
Overall, performance varies smoothly with , indicating low sensitivity in this range. Key metrics (max and mean fitness) change only marginally (within a few percent), and no single value of consistently dominates across all metrics or tasks. This suggests that the method is robust to the exact choice of threshold. Importantly, we use a single value of across all tasks, without task-specific tuning, further supporting robustness to .
| Task | Max | Mean | Diversity | Novelty | |
| 5’UTR | 0.5 | 1.03 ± 0.01 | 0.83 ± 0.00 | 27.10 ± 1.60 | 20.17 ± 0.38 |
| 0.6 | 1.02 ± 0.01 | 0.84 ± 0.03 | 26.10 ± 0.55 | 20.18 ± 0.10 | |
| 0.7 | 1.01 ± 0.00 | 0.86 ± 0.01 | 25.38 ± 0.67 | 20.12 ± 0.07 | |
| 0.8 | 1.03 ± 0.01 | 0.86 ± 0.02 | 25.64 ± 0.97 | 20.31 ± 0.14 | |
| TFBind | 0.5 | 0.87 ± 0.03 | 0.56 ± 0.01 | 6.86 ± 0.06 | 1.58 ± 0.01 |
| 0.6 | 0.88 ± 0.02 | 0.57 ± 0.02 | 6.84 ± 0.07 | 1.57 ± 0.05 | |
| 0.7 | 0.89 ± 0.02 | 0.58 ± 0.01 | 6.77 ± 0.11 | 1.54 ± 0.06 | |
| 0.8 | 0.90 ± 0.02 | 0.61 ± 0.01 | 6.45 ± 0.19 | 1.51 ± 0.05 | |
| GFP | 0.5 | 0.94 ± 0.04 | 0.46 ± 0.02 | 13.04 ± 0.58 | 7.39 ± 1.14 |
| 0.6 | 0.92 ± 0.02 | 0.47 ± 0.04 | 12.81 ± 0.52 | 6.68 ± 0.82 | |
| 0.7 | 0.96 ± 0.02 | 0.51 ± 0.04 | 14.85 ± 0.60 | 6.37 ± 0.91 | |
| 0.8 | 0.95 ± 0.02 | 0.45 ± 0.02 | 12.74 ± 0.37 | 7.16 ± 0.81 |
Table 10. Sensitivity analysis of the quantile parameter across tasks.
Robustness to uncertainty estimator: GP Surrogate
We evaluate the impact of replacing the ensemble surrogate with a Gaussian Process (GP). A GP surrogate is trained on the offline dataset: sequences are converted into logits, and both inputs and labels are standardized before fitting. We use a Gaussian Process regressor with a standard RBF kernel, observation noise (), and multiple optimizer restarts for stability.
Importantly, as we operate in a strictly offline setting, the GP, like the ensemble, cannot be updated during optimization and is used as a fixed surrogate to provide both mean and variance estimates. We keep all other components of POME unchanged (foundation-model mutations and POME scoring), using the GP as a direct replacement for the ensemble surrogate.
The results in Table 11 show that GP-based uncertainty leads to competitive performance across all tasks, with improvements on some tasks (notably GFP) and slight degradation on others (e.g., TFBind mean performance). Results reported as mean ± std over 5 runs. Overall, these results suggest that POME is not tightly coupled to a specific uncertainty estimator and remains robust across different choices, while benefiting from improved uncertainty estimates. In particular, it can naturally incorporate stronger alternatives such as Gaussian Processes.
| Task | Method | Max | Mean | Diversity | Novelty |
| 5’UTR | POME (Ensemble) | 1.03 ± 0.02 | 0.86 ± 0.01 | 25.55 ± 1.38 | 20.24 ± 0.21 |
| POME (GP) | 1.03 ± 0.01 | 0.86 ± 0.03 | 23.47 ± 4.06 | 20.28 ± 0.06 | |
| TFBind-10 | POME (Ensemble) | 0.89 ± 0.02 | 0.61 ± 0.01 | 6.51 ± 0.19 | 2.51 ± 0.10 |
| POME (GP) | 0.91 ± 0.00 | 0.56 ± 0.01 | 6.26 ± 0.28 | 1.62 ± 0.05 | |
| GFP | POME (Ensemble) | 0.96 ± 0.02 | 0.48 ± 0.03 | 12.29 ± 0.61 | 7.77 ± 0.25 |
| POME (GP) | 0.97 ± 0.00 | 0.67 ± 0.06 | 13.46 ± 0.58 | 6.32 ± 0.35 |
Table 11. Comparison between Ensemble-based and GP-based uncertainty estimation in POME.
Fitness formulations: POME-Pair and POME-Exp
We further ablate the fitness formulation by examining how the prior over the search space, uncertainty estimation, and task-specific score prediction, are combined to guide optimization. More specifically, we introduce and evaluate two additional scoring variants: POME-Pair and POME-Exp.
POME-Pair: Pairwise ranking (advantage model)
A key limitation of the Gaussian assumption in the POME method is the need to define an explicit threshold. Interpreting the posterior event (§ 4.2) as "," requires introducing a fixed threshold to evaluate a Gaussian tail probability. However, this absolute thresholding may not be necessary. Since MAP-Elites is inherently an elite-based algorithm, replacement decisions are local: a new solution only needs to outperform the current elite in its respective cell. This suggests a more natural formulation: comparing the candidate directly against the elite, rather than scoring both against a global target.
Why not direct posterior computation. In the pairwise setting, an exact posterior formulation would require conditioning on a moving reference sequence whose quality evolves throughout optimization. This introduces a reference-dependent normalisation term that cannot be treated as constant, making direct posterior computation impractical.
Score function formulation. Instead of computing an exact posterior, we define a scoring function that combines pairwise evidence with a foundation model prior. At inference time, given a candidate and a reference sequence , we estimate the likelihood of improvement using a learned pairwise model:
where this likelihood is estimated by a learned pairwise ranking model.
Adaptive uncertainty-aware scoring. To combine task-specific scoring with biological plausibility in a reliability-aware manner, we combine the pairwise likelihood with the foundation model prior using an uncertainty-dependent weight:
where is a sample-specific weighting factor that increases with predictive uncertainty.
Adaptive key idea:
When the surrogate is confident (low uncertainty), we trust its output:
When the surrogate is uncertain, we fall back to the prior:
This adaptive weighting ensures that when the surrogate is confident about the pair (i.e., is low), the score relies more on the pairwise likelihood. Conversely, under high uncertainty, the influence of the prior is increased to avoid over-reliance on potentially unreliable predictions.
We estimate uncertainty using the standard deviation across the ensemble predictions. To ensure comparability across tasks with different scales of , we normalise this uncertainty using min–max statistics:
where the minimum is computed over the offline dataset and the maximum over a batch of randomly generated sequences.
We cap at 0.5 to avoid overly relying on the prior and retain task-specific signal. We also clip from below at 0 to avoid invalid or negative weighting when the predicted uncertainty falls below the estimated offline minimum. This maintains numerical stability and preserves the interpretation of as a soft trust coefficient between the surrogate and the prior.
Symmetric comparison for elite replacement. At selection time, we evaluate both directions to ensure a fair comparison: , . We replace the elite with candidate if:
This bidirectional evaluation accounts for both the evidence that outperforms , weighted by the plausibility of , and the evidence that outperforms , weighted by the plausibility of .
POME-Exp: expectation-guided optimization
In this variant, the fitness of a candidate sequence is computed as a weighted combination of its predicted performance and its biological plausibility. Specifically, we combine the expected fitness (estimated by the surrogate) with the log-likelihood under a foundation model prior:
where is an adaptive weighting factor that adjusts the relative influence of the prior and the surrogate depending on the model’s confidence in its prediction.
We use the same adaptive scheme for computing as described previously in Section F.6.1. In brief, is derived from the normalized uncertainty of the surrogate ensemble: high uncertainty leads to a higher , increasing reliance on the prior. This allows the optimization to fall back on biologically plausible regions when the surrogate is unreliable, and focus on performance when the surrogate is confident.
Scale normalisation. The two components and are not naturally on the same scale, so we apply separate normalisation procedures before combination.
The surrogate model is trained on a dataset normalised to the range , so its predictions typically fall within or near this interval. However, since the predictor is not explicitly constrained to the range, the output is not strictly bounded. In practice, most predictions fall below 1, as the offline dataset primarily contains suboptimal designs. We therefore clip to the range .
The log-prior can vary significantly and is normalised using a min–max procedure analogous to that used for adaptive :
The result is clipped to the range.
This normalisation ensures that the prior and expected performance are weighted on a consistent scale, allowing the adaptive weighting via to be meaningful and stable across candidates.
Results
Table 12 reports results for the proposed fitness formulation variants, POME-Pair and POME-Exp, across all tasks. Both variants underperform the full POME formulation overall, particularly in terms of stability across tasks. POME-Pair achieves strong performance on the GFP task but performs less well on TFBind-10, while POME-Exp exhibits the opposite trend, performing comparatively better on TFBind-10 but worse on GFP.
| Task | Method | Max | Mean | Diversity | Novelty |
| UTR | POME-Pair | ||||
| UTR | POME-Exp | ||||
| TFBind | POME-Pair | ||||
| TFBind | POME-Exp | ||||
| GFP | POME-Pair | ||||
| GFP | POME-Exp |
Table 12. Effect of alternative fitness formulations (POME-Pair and POME-Exp) across all tasks. Results are reported as mean standard deviation over 5 runs.
Despite this reduced stability, both variants remain highly competitive when compared to QD baselines such as MAP-Elites and one-shot QD. These results suggest that incorporating biological priors and uncertainty-aware surrogate guidance, even through simplified or alternative fitness formulations, already provides gains over prior offline QD approaches.
Broader impacts
This paper presents work whose goal is to advance the field of Machine Learning, specifically in offline quality-diversity optimizations. While the methods studied here are evaluated on benign benchmark tasks and rely entirely on offline data and computational oracles, sequence design methods could in principle be misused if applied to harmful objectives. However, deploying such applications would require substantial domain-specific expertise and experimental infrastructure (e.g. wet-lab facilities), which is beyond the scope of this work. We therefore focus exclusively on controlled, non-harmful settings and established benchmarks, and do not foresee immediate negative societal consequences arising from the results presented here.
References
- [1]Christof Angermueller, David Dohan, David Belanger, Ramya Deshpande, Kevin Murphy, and Lucy Colwell. Model-based reinforcement learning for biological sequence design. In International conference on learning representations, 2019.
- [2]Luis A Barrera, Anastasia Vedenko, Jesse V Kurland, Julia M Rogers, Stephen S Gisselbrecht, Elizabeth J Rossin, Jaie Woodard, Luca Mariani, Kian Hong Kock, Sachi Inukai, et al. Survey of variation in human transcription factors reveals prevalent dna binding changes. Science, 351(6280):1450–1454, 2016.DOI
- [3]Raphaël Boige, Guillaume Richard, Jérémie Dona, Thomas Pierrot, and Antoine Cully. Gradient-informed quality diversity for the illumination of discrete spaces. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 119–128, 2023.DOI
- [4]Garyk Brixi, Matthew G Durrant, Jerome Ku, Michael Poli, Greg Brockman, Daniel Chang, Gabriel A Gonzalez, Samuel H King, David B Li, Aditi T Merchant, et al. Genome modeling and design across all domains of life with evo 2. BioRxiv, pages 2025–02, 2025.
- [5]David Brookes, Hahnbeom Park, and Jennifer Listgarten. Conditioning by adaptive sampling for robust design. In International conference on machine learning, pages 773–782. PMLR, 2019.arxiv.org/abs/1901.10060
- [6]Konstantinos Chatzilygeroudis, Antoine Cully, Vassilis Vassiliades, and Jean-Baptiste Mouret. Quality-diversity optimization: a novel branch of stochastic optimization. In Black Box Optimization, Machine Learning, and No-Free Lunch Theorems, pages 109–135. Springer, 2021.arxiv.org/abs/2012.04322
- [7]Can Chen, Yingxue Zhang, Xue Liu, and Mark Coates. Bidirectional learning for offline model-based biological sequence design. In International Conference on Machine Learning, pages 5351–5366. PMLR, 2023.
- [8]Ryan E Cobb, Ran Chao, and Huimin Zhao. Directed evolution: past, present, and future. AIChE Journal, 59(5):1432–1440, 2013.pubmed.ncbi.nlm.nih.gov/25733775
- [9]Micaela E Consens, Cameron Dufault, Michael Wainberg, Duncan Forster, Mehran Karimzadeh, Hani Goodarzi, Fabian J Theis, Allan Moses, and Bo Wang. Transformers and genome language models. Nature Machine Intelligence, pages 1–17, 2025.DOI
- [10]Antoine Cully, Jeff Clune, Danesh Tarapore, and Jean-Baptiste Mouret. Robots that can adapt like animals. Nature, 521(7553):503–507, 2015.
- [11]Antoine Cully and Yiannis Demiris. Quality and diversity optimization: A unifying modular framework. IEEE Transactions on Evolutionary Computation, 22(2):245–259, 2017.DOI
- [12]Robert M Dirks, Milo Lin, Erik Winfree, and Niles A Pierce. Paradigms for computational nucleic acid design. Nucleic acids research, 32(4):1392–1403, 2004.
- [13]Anh Viet Do, Mingyu Guo, Aneta Neumann, and Frank Neumann. Evolutionary multi-objective diversity optimization. In International Conference on Parallel Problem Solving from Nature, pages 117–134. Springer, 2024.
- [14]Noelia Ferruz, Steffen Schmidt, and Birte Höcker. Protgpt2 is a deep unsupervised language model for protein design. Nature communications, 13(1):4348, 2022.
- [15]Christopher D Fjell, Jan A Hiss, Robert EW Hancock, and Gisbert Schneider. Designing antimicrobial peptides: form follows function. Nature reviews Drug discovery, 11(1):37–51, 2012.DOI
- [16]Manon Flageat and Antoine Cully. Uncertain quality-diversity: evaluation methodology and new methods for quality-diversity in uncertain domains. IEEE Transactions on Evolutionary Computation, 28(4):891–902, 2023.
- [17]Manon Flageat, Hannah Janmohamed, Bryan Lim, and Antoine Cully. Exploring the performance-reproducibility trade-off in quality-diversity. IEEE Transactions on Evolutionary Computation, 2025.arxiv.org/abs/2409.13315
- [18]Stanislav Fort, Huiyi Hu, and Balaji Lakshminarayanan. Deep ensembles: A loss landscape perspective. arXiv preprint arXiv:1912.02757, 2019.arxiv.org/abs/1912.02757
- [19]Adam Gaier, Alexander Asteroth, and Jean-Baptiste Mouret. Data-efficient exploration, optimization, and modeling of diverse designs through surrogate-assisted illumination. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 99–106, 2017.DOI
- [20]Kam Hamidieh. A data-driven statistical model for predicting the critical temperature of a superconductor. Computational Materials Science, 154:346–354, 2018.arxiv.org/abs/1803.10260
- [21]Nikolaus Hansen. The cma evolution strategy: a comparing review. Towards a new evolutionary computation: Advances in the estimation of distribution algorithms, pages 75–102, 2006.
- [22]Trevor Hastie. The elements of statistical learning: data mining, inference, and prediction, 2009.
- [23]Moksh Jain, Emmanuel Bengio, Alex Hernandez-Garcia, Jarrid Rector-Brooks, Bonaventure FP Dossou, Chanakya Ajit Ekbote, Jie Fu, Tianyu Zhang, Michael Kilgour, Dinghuai Zhang, et al. Biological sequence design with flownets. In International Conference on Machine Learning, pages 9786–9801. PMLR, 2022.arxiv.org/abs/2203.04115
- [24]Hannah Janmohamed, Thomas Pierrot, and Antoine Cully. Improving the data efficiency of multi-objective quality-diversity through gradient assistance and crowding exploration. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 165–173, 2023.DOI
- [25]Hannah Janmohamed, Marta Wolinska, Shikha Surana, Thomas Pierrot, Aron Walsh, and Antoine Cully. Multi-objective quality-diversity search for crystal structure prediction. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1273–1281, 2024.DOI
- [26]DONA Jérémie, Arthur Flajolet, Andrei Marginean, Antoine Cully, and Thomas Pierrot. Quality-diversity for one-shot biological sequence design. In ICML’24 Workshop ML for Life and Material Science: From Theory to Industry Applications, 2024.
- [27]Paul Kent, Adam Gaier, Jean-Baptiste Mouret, and Juergen Branke. Bop-elites, a bayesian optimisation approach to quality diversity search with black-box descriptor functions. arXiv preprint arXiv:2307.09326, 2023.arxiv.org/abs/2307.09326
- [28]Minsu Kim, JiaYao Gu, Ye Yuan, Taeyoung Yun, Zixuan Liu, Yoshua Bengio, and Can Chen. Offline model-based optimisation: Comprehensive review. arXiv preprint arXiv:2503.17286, 2025.arxiv.org/abs/2503.17286
- [29]Samuel H King, Claudia L Driscoll, David B Li, Daniel Guo, Aditi T Merchant, Garyk Brixi, Max E Wilkinson, and Brian L Hie. Generative design of novel bacteriophages with genome language models. BioRxiv, pages 2025–09, 2025.DOI
- [30]Joel Lehman and Kenneth O Stanley. Evolving a diversity of virtual creatures through novelty search and local competition. In Proceedings of the 13th annual conference on Genetic and evolutionary computation, pages 211–218, 2011.DOI
- [31]Jean-Baptiste Mouret and Jeff Clune. Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909, 2015.DOI
- [32]Nagammal Neelagandan, Irene Lamberti, Hugo JF Carvalho, Cédric Gobet, and Felix Naef. What determines eukaryotic translation elongation: recent molecular and quantitative analyses of protein synthesis. Open biology, 10(12):200292, 2020.DOI
- [33]Aneta Neumann, Wanru Gao, Markus Wagner, and Frank Neumann. Evolutionary diversity optimization using multi-objective indicators. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 837–845, 2019.arxiv.org/abs/1811.06804
- [34]Eric Nguyen, Michael Poli, Marjan Faizi, et al. Hyenadna: Long-range genomic sequence modeling at single nucleotide resolution. arXiv preprint arXiv:2306.15794, 2023.arxiv.org/abs/2306.15794
- [35]Jens Nielsen and Jay D Keasling. Engineering cellular metabolism. Cell, 164(6):1185–1197, 2016.DOI
- [36]Norbert Pardi, Michael J Hogan, Frederick W Porter, and Drew Weissman. mrna vaccines—a new era in vaccinology. Nature reviews Drug discovery, 17(4):261–279, 2018.DOI
- [37]Thomas Pierrot, Guillaume Richard, Karim Beguir, and Antoine Cully. Multi-objective quality diversity optimization. In Proceedings of the genetic and evolutionary computation conference, pages 139–147, 2022.DOI
- [38]Alexander Rives, Joshua Meier, Tom Sercu, Siddharth Goyal, Zeming Lin, Jason Liu, Demi Guo, Myle Ott, C Lawrence Zitnick, Jerry Ma, et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proceedings of the National Academy of Sciences, 118(15):e2016239118, 2021.DOI
- [39]Philip A Romero and Frances H Arnold. Exploring protein fitness landscapes by directed evolution. Nature reviews Molecular cell biology, 10(12):866–876, 2009.DOI
- [40]Howard M Salis, Ethan A Mirsky, and Christopher A Voigt. Automated design of synthetic ribosome binding sites to control protein expression. Nature biotechnology, 27(10):946–950, 2009.DOI
- [41]Paul J Sample, Ban Wang, David W Reid, Vlad Presnyak, Iain J McFadyen, David R Morris, and Georg Seelig. Human 5′ utr design and variant effect prediction from a massively parallel translation assay. Nature biotechnology, 37(7):803–809, 2019.DOI
- [42]Karen S Sarkisyan, Dmitry A Bolotin, Margarita V Meer, Dinara R Usmanova, Alexander S Mishin, George V Sharonov, Dmitry N Ivankov, Nina G Bozhanova, Mikhail S Baranov, Onuralp Soylemez, et al. Local fitness landscape of the green fluorescent protein. Nature, 533(7603):397–401, 2016.DOI
- [43]Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199, 2013.arxiv.org/abs/1312.6199
- [44]Brandon Trabucco, Xinyang Geng, Aviral Kumar, and Sergey Levine. Design-bench: Benchmarks for data-driven offline model-based optimization. In International Conference on Machine Learning, pages 21658–21676. PMLR, 2022.arxiv.org/abs/2202.08450
- [45]Brandon Trabucco, Aviral Kumar, Xinyang Geng, and Sergey Levine. Conservative objective models for effective offline model-based optimization. In International Conference on Machine Learning, pages 10358–10368. PMLR, 2021.arxiv.org/abs/2107.06882
- [46]Vassilis Vassiliades, Konstantinos Chatzilygeroudis, and Jean-Baptiste Mouret. Using centroidal voronoi tessellations to scale up the multidimensional archive of phenotypic elites algorithm. IEEE Transactions on Evolutionary Computation, 22(4):623–630, 2017.arxiv.org/abs/1610.05729
- [47]Ren-Jian Wang, Ke Xue, Haopu Shang, Chao Qian, Haobo Fu, and Qiang Fu. Multi-objective optimization-based selection for quality-diversity by non-surrounded-dominated sorting. In IJCAI, pages 4335–4343, 2023.DOI
- [48]Ronald J Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8(3):229–256, 1992.
- [49]James T Wilson, Riccardo Moriconi, Frank Hutter, and Marc Peter Deisenroth. The reparameterization trick for acquisition functions. arXiv preprint arXiv:1712.00424, 2017.arxiv.org/abs/1712.00424
- [50]Matthew Wood, Mathieu Klop, and Maxime Allard. Helix-mrna: A hybrid foundation model for full sequence mrna therapeutics. arXiv preprint arXiv:2502.13785, 2025.arxiv.org/abs/2502.13785
- [51]Emily E Wrenbeck, Justin R Klesmith, James A Stapleton, Adebola Adeniran, Keith EJ Tyo, and Timothy A Whitehead. Plasmid-based one-pot saturation mutagenesis. Nature Methods, 13(11):928–930, 2016.DOI
- [52]Michael S Yao, James Gee, and Osbert Bastani. Diversity by design: Leveraging distribution matching for offline model-based optimization. In Forty-second International Conference on Machine Learning, 2025.arxiv.org/abs/2501.18768
- [53]Tianhe Yu, Garrett Thomas, Lantao Yu, Stefano Ermon, James Y Zou, Sergey Levine, Chelsea Finn, and Tengyu Ma. Mopo: Model-based offline policy optimization. Advances in Neural Information Processing Systems, 33:14129–14142, 2020.arxiv.org/abs/2005.13239
- [54]He Zhang, Liang Zhang, Ang Lin, Congcong Xu, Ziyu Li, Kaibo Liu, Boxiang Liu, Xiaopin Ma, Fanfan Zhao, Huiling Jiang, et al. Algorithm for optimized mrna design improves stability and immunogenicity. Nature, 621(7978):396–403, 2023.DOI
- [55]Shihan Zhao and Stefanos Nikolaidis. Multi-objective covariance matrix adaptation map-annealing. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 673–682, 2025.arxiv.org/abs/2505.20712
- [56]Barret Zoph and Quoc V Le. Neural architecture search with reinforcement learning. arXiv preprint arXiv:1611.01578, 2016.arxiv.org/abs/1611.01578