alphaFeedback

WorksComputer Science

To Route or to Adapt? Multi-Expert Diffusion Planners in Unseen Regions

AI contributions
Not recorded for this paper
View details
Ancillary data
1 code link
View

Abstract

Diffusion trajectory planners with domain-specific experts face a practical question in unseen regions: can they rely on selecting among existing experts, or must the planner itself adapt? We study this question using a planner with a shared adapter and per-domain expert adapters. Across three real-world held-out maps, none of eight test-time routing schemes improves the fleet-mean lateral offset over the static default, which uses the same expert for every scene. Even an oracle that selects the best expert for each scene reduces the mean offset by only 0.9 m. In contrast, reward-based fine-tuning on just 20 target-region scenes yields substantially larger gains. On matched evaluation slices, joint replay achieves a fleet-mean offset of 6.9 m, compared with 12.4 m for the static default. Comparisons under the same target-region training budget show that target-region training drives the improvement, while replaying training scenes limits forgetting on the original ODDs. On nuPlan, fine-tuning across training cities also improves open-loop offsets, although closed-loop performance deteriorates. Further diagnostics reveal that two test-time adaptation baselines achieve low offsets by producing degenerate trajectories. These results show the limited headroom for selecting among existing experts and the greater open-loop gains available from adapting the planner.

Introduction

Deploying a trajectory planner in an unseen region presents a challenge for models trained with domain-specific experts. One approach is to select the most suitable expert for each new scene, reusing what the planner has already learned. Another is to update the model using data from the new region. The former avoids additional training but is limited by the available experts; the latter can change the planner’s predictions but risks degrading performance on the original training domains. How much can expert selection actually achieve before adaptation becomes necessary?

We investigate this question using a reward-fine-tuned diffusion trajectory planner [1, 2] with a shared adapter and four per-ODD expert adapters. The four training ODDs are ODD-Hongo (the University of Tokyo’s Hongo campus), ODD-Kashiwa (suburban Kashiwa), ODD-Shulan (a controlled test site), and ODD-Nagoya (Nagoya University campus). The three held-out maps are Knowledge Hub (a research campus), Ishiodai (a suburban district), and Morikoro (an open park), all in Aichi Prefecture, Japan. Within the Generator–Selector framework of the Autoware end-to-end reference architecture [3], we compare methods that select among existing expert trajectories with methods that modify the planner’s adapter weights, as shown in Figure 1.

Method overview aligned with the Autoware E2E Generator–Selector reference architecture

Figure 1. Method overview aligned with the Autoware E2E Generator–Selector reference architecture [3]. The Generator (the adapter stack) emits K=4K=4 candidate trajectories, and the Selector chooses one by routing or scoring; the vMF mixture and the fine-tune mechanisms of § 5 instead change the Generator’s weights; a Safety Gate enforces the Reachability-of-Safe-State constraint.

We first examine whether routing can make better use of the existing experts. Across the three held-out maps, none of eight routing schemes improves the fleet-mean lateral offset over the static default, which uses the geographically nearest training expert (ODD-Nagoya on all three maps). More importantly, an oracle that selects the lowest-offset expert trajectory for each scene improves the mean offset by only 0.9 m. Even perfect selection among the four existing trajectories therefore offers little additional benefit. We next examine whether updating the planner can overcome this limitation.

Fine-tuning the shared adapter on geometrically perturbed training scenes improves performance on the open-park map, while reward-based fine-tuning with 20 target-region scenes provides substantially larger gains. On matched evaluation slices, joint replay, which mixes target-region and training scenes during fine-tuning, achieves a fleet-mean offset of 6.9 m, compared with 12.4 m for the static default. Comparisons with other fine-tuning methods show that target-region training drives the improvement, while replay primarily preserves performance on the original training ODDs.

We also examine the limits of these improvements. On nuPlan, fine-tuning across three training cities reduces open-loop lateral offset in each held-out city but degrades closed-loop performance. In addition, two test-time adaptation baselines produce low lateral offsets by collapsing toward nearly stationary or scene-independent trajectories. These observations distinguish improvements in open-loop trajectory metrics from improvements in driving behaviour, which remain to be established for the proposed adaptation methods.

Related Work

Diffusion planning and conformal prediction. Our planner builds on reward-based diffusion policy training [1, 2], using a shared adapter and per-ODD experts. Conformal prediction has been applied to trajectory uncertainty [4, 5] and semantic uncertainty in BEV planning [6]. Selective conformal risk control combines abstention with calibrated prediction [7]. We examine whether a conformal corridor can help select among the trajectories of existing experts when the deployment region differs from the calibration domains.

Geographic conditioning in driving. GeCo [8] uses geographic channel attention and contrastive imitation learning to train a policy across regions. Drive-Anywhere [9] instead uses multimodal foundation model representations to improve generalisation to unseen environments. Our setting differs from both: the planner and its domain-specific experts are already trained, and we examine whether geographic location can guide their selection or weight mixing without retraining the backbone.

Expert routing and weight merging. Related approaches include online expert selection for trajectory prediction [10], mixtures of denoising experts for robotic manipulation [11], and CLIP-based LoRA retrieval for open-vocabulary segmentation [12]. These methods differ in their tasks and available supervision. We evaluate both selecting among the trajectories generated by existing experts and combining their adapter weights. The latter is related to model soups and weight-space merging [13, 14], although our geographic mixing weights depend on the deployment location.

Multi-task learning and domain adaptation. The shared-plus-expert adapter structure is related to multi-task learning with shared representations [15, 16]. For adaptation, we study fine-tuning on geometrically perturbed training scenes, related to scene augmentation for OOD generalisation [17, 18] and generative simulation [19, 20]. We also fine-tune with a small set of target-region scenes, using replay of training scenes to limit forgetting [21, 22]. Separately, we evaluate test-time adaptation baselines [23, 24] and analyse their degenerate predictions in App. § 10 and App. § 11.

Method

Generator–Selector decomposition. We follow the Generator–Selector framework of the Autoware end-to-end reference architecture [3], as shown in Figure 1. The Generator consists of a diffusion planner [2] with a shared low-rank adapter (LoRA [25]) and four per-ODD expert adapters of comparable rank. For each scene, we activate the shared adapter together with each expert in turn, producing K=4K = 4 candidate trajectories. The Selector ranks these candidates and returns a single trajectory.

We evaluate eight routing schemes that choose among or weight the existing candidates, alongside three mechanisms that modify the adapter weights before generation. The conformal routing scheme also uses geographic weight mixing as a fallback, as described in § 5.1. The adapter ranks and optimisation settings are inherited from the training of the adapter stack (App. § 21). The per-ODD structure supports independent updates and rollbacks for regions with different data volumes and maintenance schedules. Our experiments do not cover monolithic planners trained on pooled data.

Eight routing schemes. We evaluate eight schemes grouped by the information used to choose an expert.

Feature and geometry. (i) A two-hidden-layer MLP takes eight groups of scene features: lane count, mean curvature, mean lane length, lateral and longitudinal lane spread, neighbour speed, route-lane count, and ego state. (ii) Lane-following scores each candidate by its perpendicular distance to the nearest route-lane centreline.

Consistency and uncertainty. (iii) Self-consistency scores the agreement among five trajectories generated by each expert, using mean pairwise trajectory distance. (iv) A magnitude-normalised variant uses the same samples. (v) A split-conformal corridor uses a multi-noise nonconformity score calibrated on training scenes (App. § 23).

Loss and reward. (vi) Denoising-loss scoring ranks experts using their denoising losses [26]. (vii) A reward-supervised dynamic gate is trained directly on realised lateral offset (§ 4). (viii) Reward-as-scorer selects arg⁡max⁡R(τe)\arg\max R(\tau_e) using the planner’s training reward.

We compare each scheme with the static default on the scenes where it is evaluated.

Three constructive mechanisms. We also investigate three ways to modify the planner’s adapters, shown in Figure 2. First, geographic weight mixing (the vMF mixture) combines the existing expert weights according to their distances from the deployment location (§ 5.1). Second, shared-adapter repair fine-tunes the shared module on training scenes augmented with lanelet rotations, centreline warps, and boundary removal (§ 5.2). Third, joint replay fine-tunes the full adapter stack using target-region scenes together with 200 training scenes (§ 5.3). The latter two methods update model parameters, whereas geographic mixing combines existing parameters without further optimisation.

Three constructive mechanisms

Figure 2. Three constructive mechanisms. (A) vMF mixture: experts weighted by distance to the deployment location (§ 5.1). (B) Shared-adapter repair: only the shared module is fine-tuned, on perturbed training scenes (§ 5.2). (C) Joint replay: the whole adapter stack is fine-tuned on training and target-region scenes; inset: target-region error (§ 5.3).

Reward and safety gate. We use the trajectory-level reward inherited from the training of the adapter stack, with terms for forward progress, route alignment, comfort, and safety. The safety term draws on the Reachability-of-Safe-State requirement discussed in the Autoware reference architecture [3]. The full reward, its weights, and the braking-distance parameters are provided in App. § 21.

A Safety Gate downstream of the Selector rejects trajectories that violate hard limits on lateral offset, braking distance, or forward progress. All lateral-offset results in this paper are measured on the Selector’s output before the Safety Gate.

Terms and evaluation protocol. We evaluate planned trajectories over 8 s at 10 Hz. For a trajectory τ={(xt,yt)}t=180\tau= \{(x_t, y_t)\}_{t=1}^{80} expressed in the ego frame aligned with the start lanelet, the lateral offset is the maximum absolute lateral coordinate. The fleet mean gives equal weight to the three held-out maps:

o(τ)=max⁡t∣yt∣,oˉ=13∑m1∣Sm∣∑s∈Smo(τs).(1)o(\tau) = \max_t |y_t|,\qquad\bar{o} = \frac{1}{3}\sum_m \frac{1}{|S_m|}\sum_{s\in S_m} o(\tau_s). \tag*{(1)}

where SmS_m is the evaluation scene set for map mm. This metric measures lateral displacement relative to the initial lanelet axis, rather than distance to the route centreline or a recorded trajectory.

The static default always activates the expert of the geographically nearest training ODD. For all three held-out maps, this is ODD-Nagoya, which also has the lowest offset among the four fixed experts.

We define oracle headroom as the improvement obtained by selecting, for each scene, the lowest-offset trajectory among the four experts:

Horacle=1N∑s=1N[o(τsstatic)−min⁡eo(τse)].(2)H_{\mathrm{oracle}} = \frac{1}{N}\sum_{s=1}^{N}\left[o(\tau_s^{\mathrm{static}}) - \min_e o(\tau_s^e)\right]. \tag*{(2)}

This measures the potential gain from selecting among the four existing candidate trajectories; it does not bound the performance of weight mixing or fine-tuning.

We use two evaluation pools. Pool A contains 24 scenes used for the routing experiments. Pool B is used for fine-tuning evaluation and consists, for each training seed, of scenes drawn from lanelets disjoint from that seed’s training scenes. Table 1 specifies the evaluation pool for each experiment. Results from different pools are reported separately.

ExperimentModel evaluatedTrainingEvaluation
Routing schemes (§ 4)adapter stackselector onlyPool A (24)
Oracle headroom (§ 4)per-scene oraclenonePool A; 104 scenes
vMF mixture (§ 5.1)average of expertsclosed-form weightsPool A (24)
Shared-adapter repair (§ 5.2)shared module500 steps, perturbed scenesPool A (24)
Joint replay, baselines (§ 5.3)adapter stack500 steps, 20 target scenesPool B, 8 seeds
nuPlan cross-city (§ 6)rank-4 shared LoRA500 steps on 3 citiesnuPlan, open loop
Real vehicle, DPO (§ 6)other adaptersreward or DPOODD-Kashiwa course

Table 1. Model, training and evaluation pool of each experiment (pools defined in § 3).

Limited Headroom for Expert Routing

We begin by measuring how much could be gained from selecting among the four existing experts. For each scene, an oracle chooses the expert trajectory with the lowest lateral offset. This gives an upper bound on the improvement available to any selector restricted to those four trajectories, though not to methods that combine expert weights or update the planner.

On Pool A, the oracle improves the mean offset over the static default by only 0.9 m. The gain remains small on a larger 104-scene pool with new start lanelets (1.3 m) and on the disjoint evaluation slices of Pool B (1.1 m). Thus, most of the offset cannot be reduced by choosing a different existing expert for each scene. For comparison, joint replay (§ 5.3) reduces the mean offset on Pool A by 9.1 m. Seven of these scenes are among joint replay’s training scenes; on the remaining 17 scenes, the improvement is 12.7 m (p=0.0008p = 0.0008).

We next evaluate eight routing schemes on Pool A, reported in Table 2 and Figure 3a. The static default uses the geographically nearest expert, ODD-Nagoya, which is also the best fixed expert on all three held-out maps. It achieves a fleet-mean offset of 13.74 m. The conformal corridor slightly improves on this baseline on Knowledge Hub and Ishiodai, but performs worse on Morikoro, leaving its fleet mean higher than the static default. None of the schemes evaluated across all three maps improves the fleet mean. Paired Wilcoxon tests find no significant improvement, while six schemes perform significantly worse (p≤0.012p \le0.012; all six remain significant after Holm correction). Morikoro contributes the largest offsets. Its open-park layout differs from the training ODDs, all of which contain paired opposing lanes (App. § 26).

Routing schemeKnowledge HubIshiodaiMorikoroFleet
Scene-conditioned MLP4.5 ± 0.89.0 ± 4.263.3 ± 58.025.61
Self-consistency14.3 ± 4.17.7 ± 4.646.3 ± 35.322.76
Self-consistency (normalised)14.3 ± 4.17.7 ± 4.646.3 ± 35.322.76
Lane-following6.0 ± 2.17.8 ± 4.041.1 ± 46.918.29
Denoising-loss14.0 ± 4.08.1 ± 4.342.9 ± 33.721.67
Conformal corridor (T=15T=15)4.0 ± 0.14.6 ± 0.738.9 ± 37.115.86
Reward-supervised gaten/an/a32.3 ± 0.6n/a
Reward-as-scorer13.6 ± 3.69.2 ± 4.756.9 ± 51.826.57
Static default (ODD-Nagoya)4.5 ± 0.84.8 ± 0.831.9 ± 32.113.74

Table 2. Eight routing schemes versus the static default: lateral offset (m) on Pool A, mean ± std over scenes, and the fleet mean. Six of the eight are significantly worse than the default under paired per-scene tests (p≤0.012p \le0.012), none significantly better. The reward-supervised gate was run on Morikoro only (± over 50 seeds).

The routing schemes encounter different problems on the held-out maps. The scene-conditioned MLP separates the training ODDs perfectly but assigns most held-out scenes to ODD-Hongo, resulting in large offsets. Self-consistency favours small-magnitude trajectories and effectively selects the shared module alone. The denoising loss has little correlation with realised offset, while the planner’s own reward frequently selects ODD-Shalun instead of the lowest-offset expert. The reward-supervised gate converges almost entirely to ODD-Nagoya, recovering approximately the static default. The conformal corridor abstains on every scene at T=5T = 5 m; at T=15T = 15 m, its output reduces to the geographic weight mixture of § 5.1. Further results are provided in App. § 22.

We also test whether scene features can predict which expert will have the lowest offset. Leave-one-out classifiers using either hand-crafted scene features or the planner’s encoder embeddings do not outperform the majority-class baseline on the 24- or 104-scene pools (permutation p≥0.29p \ge0.29). A richer 38-dimensional feature set separates the training ODDs perfectly but does not improve selection on the held-out maps (App. § 20). A sum of per-coordinate mutual-information estimates [27] between the encoder embedding and the oracle label is at most suggestive (p=0.088p=0.088 with 24 scenes in 256 dimensions). The conformal predictor faces a separate problem: its training and held-out residuals fail an exchangeability test (p=0.0035p = 0.0035; App. § 23).

These results show that the tested representations and routing methods do not reliably identify better experts under cross-region shift. Together with the small oracle headroom, they suggest that more effective selection among the four existing experts would offer limited benefit on these maps.

Beyond Expert Selection: Weight Mixing and Adaptation

We next examine three alternatives to selecting among existing expert trajectories. Geographic weight mixing combines pretrained experts without further training; shared-adapter repair uses geometrically perturbed training scenes; and joint replay introduces a small number of target-region scenes. Only the last method requires target-region training data. Figure 3b compares their results.

Geographic Weight Mixing

We first test whether geographic proximity can guide the combination of existing experts. Let dgeo(ℓ,μd)d_{\mathrm{geo}}(\ell,\mu_d) denote the great-circle distance between deployment location ℓ\ell and the centre μd\mu_d of training ODD dd. We compute a weighted average of the merged expert weights WdW_d:

W~(ℓ)=∑dαd(ℓ)Wd,αd(ℓ)=exp⁡(−dgeo(ℓ,μd)/τ)∑jexp⁡(−dgeo(ℓ,μj)/τ).(3)\widetilde{W}(\ell) = \sum_d \alpha_d(\ell) W_d,\qquad\alpha_d(\ell) = \frac{\exp(-d_{\mathrm{geo}}(\ell,\mu_d)/\tau)}{\sum_j \exp(-d_{\mathrm{geo}}(\ell,\mu_j)/\tau)}. \tag*{(3)}

The temperature τ\tau controls the contribution of distant experts. We evaluate τ∈{1,10,50,200}\tau\in\{1, 10, 50, 200\} km; as τ\tau approaches zero, the mixture approaches the nearest-expert static default (App. § 12).

At τ=200\tau= 200 km, the mixture slightly improves Knowledge Hub and Ishiodai but increases the Morikoro offset from 31.9 to 38.9 m. Its fleet mean is 15.86 m, compared with 13.74 m for the static default (Table 10). Learning the mixture coefficients directly from 20 target-region scenes performs worse (App. § 13). Neither approach improves the fleet mean over the static default.

τ\tau (km)Knowledge HubIshiodaiMorikoro
1 / 10 / 50 (one-hot →\rightarrow static default)4.51 ±\pm 0.794.82 ±\pm 0.8431.9 ±\pm 32.1
200 (soft mix)4.02 ±\pm 0.114.63 ±\pm 0.6838.9 ±\pm 37.1
200 (top-2 mix)4.13 ±\pm 0.734.49 ±\pm 0.8040.7 ±\pm 37.7

Table 10. Lateral offset (m) of the vMF mixture at four temperatures. As τ→0\tau\rightarrow0 the mixture reduces to the static default (all weight on ODD-Nagoya); as τ→∞\tau\rightarrow\infty it becomes the uniform average of the experts.

Shared-Adapter Repair with Geometric Perturbations

We next fine-tune the shared adapter without using target-region training scenes. For 500 steps, we train on scenes from the original ODDs with three geometric perturbations: per-lanelet SE(2)SE(2) rotations of up to 45∘45^\circ, cubic Bezier centreline warps of up to 3 m, and random removal of one lane boundary with probability 0.5. These perturbations introduce variations in lane orientation, curvature, and boundary structure that are relevant to the open-park map.

The repaired shared adapter more than halves Morikoro’s offset relative to the original shared adapter and also improves the other two maps. When combined with the ODD-Kashiwa expert, it achieves 11.1 m on Morikoro, compared with 31.9 m for the static default. Ablations across three seeds show that lanelet rotation contributes the largest improvement (App. § 14).

Joint Replay with Target-Region Scenes

We then fine-tune the full adapter stack θ\theta using target-region scenes together with scenes from the original training ODDs. The training set contains 20 target-region scenes from Ishiodai (DtgtD_{\mathrm{tgt}}) and 200 training scenes (DsrcD_{\mathrm{src}}), with 50 from each training ODD. Replaying training scenes follows the rehearsal approach to continual learning [21, 22]. We optimise the trajectory-level reward for 500 steps:

max⁡θ∑x∈Dsrc∪DtgtRc(x)(τθ(x);x).(4)\max_{\theta}\sum_{x\in D_{\mathrm{src}}\cup D_{\mathrm{tgt}}} R_{c(x)}(\tau_{\theta}(x);x). \tag*{(4)}

Here τθ(x)\tau_{\theta}(x) is the trajectory generated by a differentiable DPM-Solver++ rollout, and Rc(x)R_{c(x)} uses the reward weights assigned to the scene’s ODD. Training scenes activate their respective experts, while target-region scenes use the shared adapter alone with ODD-Nagoya reward weights. The reward is computed from scene maps and routes, without requiring recorded driving trajectories.

On Pool B, joint replay achieves a fleet-mean offset of 6.91±2.166.91 \pm2.16 m across eight seeds, compared with 12.4 m for the static default (Table 3).1 Because all target-region training scenes come from Ishiodai, improvements on Knowledge Hub and Morikoro reflect transfer to the other two held-out maps. The sample-complexity results in Figure 4 also show reduced variation across seeds as the target training set grows to 20 scenes.

MethodTarget [m] ↓\downarrowForgetting [m] ↓\downarrow
Shared module only20.0±2.420.0 \pm2.40
Static default12.4±3.012.4 \pm3.00
Fine-tune best fixed expert4.69±1.904.69 \pm1.90+22.6±2.9+22.6 \pm2.9
Target-only LoRA5.34±4.465.34 \pm4.46+37.4±11.9+37.4 \pm11.9
Target-only + L2L_2-SP4.04±0.774.04 \pm0.77+37.8±13.2+37.8 \pm13.2
Adapter from scratch6.03±2.646.03 \pm2.64+17.3±23.4+17.3 \pm23.4
EWC (λ=102\lambda= 10^2, 3 seeds)8.20±0.838.20 \pm0.83+4.7±1.3+4.7 \pm1.3
Prioritised replay6.78±1.336.78 \pm1.33+1.7±0.8+1.7 \pm0.8
Joint replay (ours)6.91±2.166.91 \pm2.16+0.9±1.4+0.9 \pm1.4

Table 3. Baselines with the same 20 target scenes, 500 steps, LoRA ranks and learning rate; mean ±\pm std over eight seeds, each on its own held-out slice (Pool B). Forgetting is the summed increase in lateral offset over the four training ODDs.

Fleet-mean offset for joint replay with different numbers of target-region training scenes

Figure 4. Joint replay with nn target-region training scenes: mean ±\pm std over three seeds (gray dots: single seeds), each on its own held-out slice. Blue: static default on such slices; hollow marker: one seed at n=80n=80 (App. § 17).

Target-region training and replay. To separate the effects of target-region training and replay, we compare methods using the same 20 target scenes, optimisation steps, LoRA ranks, and learning rate (Table 3). All methods trained on target-region scenes achieve offsets of approximately 4–8 m. Target-only fine-tuning with L2L_2-SP [28] gives the lowest target offset (4.04 m), although its 95th-percentile jerk is 27% higher than that of joint replay.

The main difference is performance retention on the training ODDs. Fine-tuning without replay or EWC increases their summed offset by 17–38 m, including when L2L_2-SP regularisation is used. EWC [29] reduces forgetting at the cost of higher target offsets. Joint replay limits the summed regression to 0.9±1.40.9 \pm1.4 m while retaining a target offset of 6.91±2.166.91 \pm2.16 m. Prioritised replay shows no clear advantage over uniform replay. These comparisons indicate that target-region training accounts for the offset reduction, whereas replay mainly preserves performance on the original training ODDs.

Additional trajectory diagnostics. The target-region scenes contain no neighbouring agents, so time-to-collision and collision rates cannot be evaluated. We instead report additional trajectory diagnostics in App. § 25. Jerk and lateral acceleration are calculated from unsmoothed finite differences of the raw 10 Hz trajectories, so only comparisons between models are meaningful.

Compared with the static default, joint replay reduces the 95th-percentile jerk by 26% and increases forward progress over 8 s from 164 to 187 m. Lateral acceleration changes little, and large lateral excursions relative to the initial lanelet remain. The from-scratch variant of joint replay reduces lateral acceleration and the frequency of excursions beyond the straight ±3\pm3 m band, but substantially degrades performance on the training ODDs (App. § 16).

Variance-Collapse Diagnostics for Test-Time Adaptation

Low lateral offset alone does not establish that a trajectory is useful. We examine two test-time adaptation methods that achieve low offsets but produce degenerate trajectories: TENT [23], which updates normalisation parameters during inference, and a hypernetwork that predicts LayerNorm offsets from geographic location.

We use two diagnostics: the variance σK2\sigma_K^2 across KK samples from the same scene and the mean pairwise L2L_2 distance between trajectories from different scenes. Starting from the static default, TENT achieves an offset of 3.37 m, but its cross-scene trajectory distance falls from over 100 m to approximately 10 m, consistent with similar predictions across different scenes. The hypernetwork reduces σK2\sigma_K^2 by two orders of magnitude and produces only 12 m of forward progress over 8 s. These cases illustrate how low lateral offset can accompany a loss of trajectory diversity or forward motion (App. § 10, App. § 11).

Cross-City Evaluation and Real-Vehicle Runs

Cross-city evaluation on nuPlan. We evaluate cross-city transfer on nuPlan using four leave-one-city-out splits. For each split, we fine-tune a rank-4 shared LoRA on the other three cities using the planner’s diffusion training loss. Across three seeds and using the same lateral-offset metric as on the held-out maps, fine-tuning reduces the open-loop lateral offset on Singapore from 8.64 to 5.60±0.785.60 \pm0.78 m, by 35%, despite the difference in traffic direction. Improvements over the base planner are also observed in the other held-out cities (App. § 19). Unlike the target-region experiments, this evaluation uses no data from the held-out city and measures transfer from fine-tuning on the training cities.

Real-vehicle runs of the base planner. The base diffusion planner has also been tested on a physical vehicle with two adapter configurations: a production DPO LoRA trained on human preferences and a reward-trained shared-plus-expert adapter. For the latter, we conducted two runs on the ODD-Kashiwa course with the ODD-Kashiwa expert active. The first completed the course, with a comfort-violation rate of 47.7% under our proxy, compared with 37.7% for a human driver. In the second run, the vehicle travelled 72 m at speeds no greater than 0.23 m/s before stopping. These runs document the behaviour of the base planner on a physical vehicle; the joint-replay adapters have not yet been tested on the vehicle. Additional results for the DPO adapter are given in App. § 24.

Discussion, Limitations, and Conclusion

Our experiments show that selecting among the four existing experts offers limited improvement on the held-out maps, even with per-scene oracle selection. Updating the planner with a small amount of target-region data produces much larger reductions in open-loop lateral offset. Under matched training conditions, replaying training scenes mainly helps retain performance on the original ODDs rather than accounting for the target-region gains.

Geographic proximity. On the three primary held-out maps, ODD-Nagoya is both the nearest training ODD and the best fixed expert. We examine two additional regions to separate these effects. In a suburban area adjacent to ODD-Kashiwa but outside its training footprint, the nearest expert performs 1.4 m worse than ODD-Nagoya (p=0.001p = 0.001, n=30n = 30). In a dense urban region nearest to ODD-Hongo, the ODD-Hongo expert performs worst among the four (App. § 27). Geographic proximity therefore does not consistently identify the best expert. The success of the static default on our primary maps appears to reflect the strength of ODD-Nagoya rather than its proximity alone.

Limitations. The main limitation is that all results on the held-out maps are open-loop. In nuPlan’s reactive closed-loop simulator, the fine-tuned models score below the unadapted planner in all four held-out cities, with significant differences in three. For Singapore, the simulator score decreases from 0.858 to 0.598, and drivable-area compliance from 0.97 to 0.76. The joint-replay adapters have not been evaluated on a physical vehicle.

The primary held-out evaluation is also limited in scale, covering 4–10 road lanelets per map. We extend the oracle and feature-classifier analyses to 104 scenes, but the full eight-method routing comparison remains on the smaller pool. Our findings therefore concern the tested experts, routing methods, and representations. Their applicability to monolithic planners trained on pooled data [2] remains unknown.

The maps are proprietary. We release the model weights, scene splits, evaluation pipeline, and per-scene results through the project repository.

Conclusion. Overall, the results favour updating the planner over selecting among its existing experts when the objective is to reduce open-loop lateral offset in unseen regions. Whether these gains translate into better closed-loop driving remains an open question.

Acknowledgments

This work was supported by JSPS KAKENHI Grant Number JP26KJ0799 and by TIER IV, Inc.

Overview of the Appendix

This appendix gives the details behind the main text. Table 4 lists each appendix section next to the main-text section it supports. Appendix § 24 reports the real-vehicle runs and a separate study of DPO adapters on the same base planner; it is context for § 6 and does not evaluate the adaptation methods proposed in this paper.

Test-Time Adaptation Details

TENT Recipes and Variance-Collapse Diagnostics

Table 5 reports TENT-style test-time adaptation under two recipes on the disjoint target-region evaluation pool of seed 7. The lightweight recipe, TENT-LN, updates only the affine parameters of the decoder LayerNorm layers. Its loss is the variance across K=4K=4 sampled trajectories, which serves as the diffusion analogue of the prediction entropy used by TENT [23, 24]. TENT-LN runs 5 SGD steps at lr=10−410^{-4}, starting from a fresh model for each scene, and its trainable parameters make up ∼0.01%\sim0.01\% of the model. The full recipe, TENT-online, follows the defaults of Wang et al. (2021) where the architecture allows: Adam at lr=10−310^{-3}, K=32K=32 samples, model state carried over from scene to scene, and 10 epochs over the stream of 24 target-region scenes. We update LayerNorm rather than BatchNorm affine parameters because the Diffusion-Planner base planner has no Batch-Norm layers; this is the standard substitution for transformer-based planners [24]. A SAR variant backpropagates, in each epoch, only on the 50% of scenes with the lowest variance.

Collapse diagnostics. The best TENT-online fleet mean, 4.11 m at epoch 1, comes from variance collapse rather than from learning the new region. Over ten epochs, the KK-sample variance loss falls by four orders of magnitude (40.6 →\to 0.0095), while the fleet mean rises to 5.09 m. For a diffusion trajectory planner under cross-region shift, any non-trivial TTA fleet mean should be reported together with (i) the within-scene variance σK2\sigma_K^2 across KK samples and (ii) the pairwise L2L_2 distance between the mean trajectories of different scenes [30, 17]. Healthy configurations have σK2∼10−11\sigma_K^2 \sim10^{-11} and a cross-scene L2∈[105,150]L_2 \in[105,150] m. TENT started from the static default reaches 3.37 m, but its cross-scene L2L_2 collapses to 10.2 m. The hypernetwork-LN recipe (§B.1) reduces σK2\sigma_K^2 to 4×10−134 \times10^{-13}. Stacking TENT on the hypernetwork recipe gives a cross-scene L2L_2 of 1.2 m and 3.7 m of forward progress at 0.46 m/s.

Table 5: Test-time adaptation baselines on the disjoint target-region evaluation pool of seed 7. TENT updates only the affine parameters of the decoder LayerNorm layers, using a trajectory-variance loss over KK samples. TENT-LN: K=4K=4, 5 SGD steps, fresh model for each scene. TENT-online: K=32K=32, Adam with lr=10−3\mathrm{lr}=10^{-3}, 10 epochs, model state carried over between scenes.

MethodKnowledge HubIshiodaiMorikoroFleet mean
Shared module only (TTA slice)14.26±4.1314.26 \pm4.137.43±6.117.43 \pm6.1137.40±29.6837.40 \pm29.6819.7019.70
Shared module only (HyperLN slice)———22.7622.76
TENT-LN (K=4K=4, 5 steps)14.15±4.1814.15 \pm4.187.47±6.147.47 \pm6.1436.99±29.4536.99 \pm29.4519.5419.54
TENT-online (K=32K=32, epoch 1)———4.11
TENT-online (K=32K=32, epoch 10)———5.095.09
TENT-online SAR (K=32K=32, epoch 4)———4.564.56
Static default (ODD-Nagoya)4.514.514.824.8231.8831.8813.7413.74
Joint replay (single checkpoint)2.242.777.784.26

Table 5.

Hypernetwork-Conditioned LayerNorm

Recipe, Results and Diagnostic Probe

This section describes a context-aware TTA recipe that trains a supervised mapping from the ECEF unit vector ℓ\ell of the deployment location to offsets (Δγ,Δβ)(\Delta\gamma, \Delta\beta) of the 36,608 LayerNorm affine parameters in the decoder DiT. The recipe reaches a low lateral offset, but the diagnostic probe of Table 7 shows that this offset is an artefact of nearly stationary trajectories.

Configurationlat (m)progress (m, 8 s)speed (m/s)cross-scene L2L_2
Frozen shared module only24.89170.021.3150.4
Static default (ODD-Nagoya)16.04166.720.8105.0
vMF mixture τ=200\tau=200 km19.64172.221.5124.2
Hypernet-LN (this work)5.2712.31.573.0
Hypernet-LN + TENT polish1.213.70.461.2
Static default + TENT polish3.40174.821.910.2

Table 7. Diagnostic probe of the hypernetwork-LN recipe (§B.1) and of the TENT polish variants (§A.1). Forward progress is ∥x(T)−x(0)∥\lVert x(T)-x(0)\rVert at T=8 sT=8\,\mathrm{s}; mean speed is progress/TT. Cross-scene L2L_2 is the mean pairwise distance between the trajectories of different scenes, each centred at its own starting frame; healthy models give a large L2L_2.

Recipe. Let ℓ∈S2\ell\in S^2 be the ECEF unit vector of the deployment location (§ 5.1). The hypernetwork hθ:S2→R36,608h_\theta: S^2 \to\mathbb{R}^{36,608} is a three-layer MLP with hidden width 64 and SiLU activations; it has 4.73 M parameters in total, and its output layer is zero-initialised. During training, each scene from a training ODD is paired with the ECEF unit vector ℓd\ell_d of that ODD. At every forward pass we compute (Δγ,Δβ)=hθ(ℓd)(\Delta\gamma, \Delta\beta) = h_\theta(\ell_d) and apply these offsets to the LayerNorm modules through a forward hook that computes F.layer_norm⁡(x,w+Δγ,b+Δβ,ε)F.\operatorname{layer\_norm}(x, w+\Delta\gamma, b+\Delta\beta, \varepsilon). We then run the diffusion sampler and minimise the mean-squared error to the recorded ego trajectory τgt\tau_{\mathrm{gt}}. Training runs for 500 optimiser steps at lr=5⋅10−5\mathrm{lr}=5\cdot10^{-5} and wd=10−3\mathrm{wd}=10^{-3} on a pool of 772 pairs from the four training ODDs, and takes 2.7 minutes of wall-clock time on one consumer GPU. At deployment, the trained hypernetwork is conditioned on the unit vector of the centroid of the target-region map, and its output is applied to the LayerNorm affine parameters.

Results before the probe. Table 6 reports a fleet mean of 5.74 m for the best single seed (6.27 ±\pm 0.59 over three seeds). Reducing the hidden width (64 →\to 16) raises the fleet mean to 11.0 m, which rules out a trivial lookup.

Table 6: Lateral offset of hypernetwork-conditioned LayerNorm before the diagnostic probe of Table 7.

RecipeKnowledge HubIshiodaiMorikoroFleet mean
Shared module only14.2614.267.727.7246.3046.3022.7622.76
Static default (ODD-Nagoya)4.514.514.824.8231.8831.8813.7413.74
Joint replay (single checkpoint)2.242.242.772.777.787.784.264.26
HyperLN, h=64h=64, no jitter (best single seed)11.1911.191.341.344.684.685.745.74
HyperLN, h=64h=64, no jitter, 3-seed mean12.17±1.1812.17 \pm1.181.39±0.201.39 \pm0.205.26±0.395.26 \pm0.396.27±0.596.27 \pm0.59
HyperLN, h=16h=16, jitter 0.1∘0.1^\circ (capacity ablation)15.4215.421.951.9515.7115.7111.0211.02

Table 6.

Diagnostic probe. The probe shows that the hypernetwork recipe produces nearly stationary trajectories. We measure forward progress ∥x(T)−x(0)∥\lVert x(T)-x(0)\rVert, mean speed ∥x(T)−x(0)∥/T\lVert x(T)-x(0)\rVert/T at T=8T=8 s, and the cross-scene pairwise L2L_2 between trajectories, each centred at its own starting frame. Table 7 shows that the hypernetwork recipe produces 12 m of forward progress at 1.5 m/s (walking speed).

Its low lateral offset is the trivial offset of a nearly stationary trajectory, so the apparent gains in Table 6 are artefacts.

Status of the hypernetwork recipe. We retract the hypernetwork-LN recipe as a constructive mechanism. The three constructive mechanisms reported in the main text are the vMF mixture (§ 5.1), shared-adapter repair (§ 5.2), and joint replay (§ 5.3). We include the hypernetwork-LN recipe as a documented failure mode, not as a deployable recipe, and it should not be cited as a constructive mechanism in later work.

Derivation and Weights of the vMF Mixture

Bayesian interpretation of the mixing weights. The mixing weights of the vMF mixture can be read as a Bayesian posterior over the training ODDs. Each weight is a softmax over the negative great-circle (Haversine) distance between the deployment location ℓ\ell and the geographic centre μd\mu_d of training ODD dd:

αd(ℓ)=exp⁡(−dgeo(ℓ,μd)/τ)∑j=1Kexp⁡(−dgeo(ℓ,μj)/τ)\alpha_d(\ell)=\frac{\exp(-d_{\mathrm{geo}}(\ell,\mu_d)/\tau)}{\sum_{j=1}^{K}\exp(-d_{\mathrm{geo}}(\ell,\mu_j)/\tau)}

where the temperature τ\tau is in kilometres. Let D∈{1,…,K}D \in\{1,\ldots,K\} be the unobserved index of the training ODD, with a uniform prior, and let the deployment location have the likelihood p(ℓ∣D=d)∝exp⁡(−dgeo(ℓ,μd)/τ)p(\ell\mid D=d) \propto\exp(-d_{\mathrm{geo}}(\ell,\mu_d)/\tau) on the sphere, which decays exponentially with distance from μd\mu_d. The normalising constant of this likelihood is invariant under rotations of the sphere, so it does not depend on dd, and Bayes’ rule gives p(D=d∣ℓ)=αd(ℓ)p(D=d \mid\ell)=\alpha_d(\ell) exactly. In the limit τ→0\tau\to0 the weights select the nearest ODD, which is the static default on our three maps; in the limit τ→∞\tau\to\infty they become uniform; intermediate values of τ\tau lie between these two cases. We keep the name vMF mixture because each ODD contributes a kernel on the sphere centred at its location. A von Mises–Fisher likelihood exp⁡(κμdTℓ)\exp(\kappa\mu_d^\mathsf{T}\ell), however, decays with the squared distance at small separations, so it defines a different weighting from the one we evaluate. Under quadratic loss, the Bayes-optimal trajectory given the scene and location (x,ℓ)(x,\ell) is the posterior mean

y^⋆(x,ℓ)=∑d=1Kαd(ℓ)fd(x)\hat{y}^{\star}(x,\ell)=\sum_{d=1}^{K}\alpha_d(\ell)f_d(x)

where fd(x)f_d(x) is the expert of training ODD dd. Our weight mixture W~(ℓ)=∑dαd(ℓ)Wd\widetilde{W}(\ell)=\sum_d\alpha_d(\ell)W_d averages the expert weights rather than their outputs, so it matches this rule only to first order in the differences between the expert weights. Table 8 lists the resulting weights.

τ\tauα\alpha (Hongo, Kashiwa, Shalun, Nagoya)Knowledge HubIshiodaiMorikoro
→0\rightarrow0 (hard MAP = ODD-Nagoya)(0, 0, 0, 1)4.514.8231.9
200 km (soft mix, headline)(0.20, 0.18, 0.00, 0.62)4.024.6338.9
→∞\rightarrow\infty (uniform soup)(0.25, 0.25, 0.25, 0.25)———

Table 8. vMF mixture weights α\alpha and per-map lateral offset (m) across τ\tau.

Choice of distance metric. At our geographic scales, the mixing weights do not depend on the choice of distance metric. Table 9 reports the weights of the vMF mixture for Morikoro at τ=200\tau=200 km under four distance metrics: Haversine, the ECEF chord, an equirectangular flat-Earth approximation and a local tangent plane (UTM). The four weight vectors agree to four decimal places (largest L1L_1 deviation 7×10−57\times10^{-5}).

Distance metricαHongo\alpha_{\mathrm{Hongo}}αKashiwa\alpha_{\mathrm{Kashiwa}}αShalun\alpha_{\mathrm{Shalun}}αNagoya\alpha_{\mathrm{Nagoya}}
Haversine (great-circle)0.19810.17740.00000.6245
ECEF chord on S2S^20.19820.17740.00000.6244
Equirectangular flat-Earth0.19810.17740.00000.6245
Local-tangent-plane (UTM)0.19810.17740.00000.6245

Table 9. Mixing weights α\alpha of the vMF mixture for Morikoro at τ=200\tau=200 km under four distance metrics.

Table 10 reports the lateral offset of the vMF mixture, with the posterior weights derived above, at four temperatures.

Weight-Averaging Baselines: Learned Coefficients, Model Soups and TIES-Merging

Learned mixing coefficients. Learning the mixing coefficients on target-region scenes does not beat the static default either. We replace the vMF weights with a learnable 4-vector α\alpha,

Wmix=Wbase+∑dsoftmax⁡(α)d⋅θdwithθd=Wd−Wbase,W_{\mathrm{mix}} = W_{\mathrm{base}} + \sum_d \operatorname{softmax}(\alpha)_d \cdot\theta_d \quad\text{with} \quad\theta_d = W_d - W_{\mathrm{base}},

and train α\alpha for 200 Adam steps at lr=10−210^{-2} on 20 target-region scenes under the 10-term reward (§ 3), with the base planner frozen. The learned weights concentrate on one expert that is not the geographically nearest (α=(0.06,0.12,0.70,0.12)\alpha=(0.06, 0.12, 0.70, 0.12), entropy 1.34 bits). On the seed-7 evaluation pool, the resulting fleet mean is 22.82 m (Knowledge Hub 8.74, Ishiodai 31.72, Morikoro 28.00), worse than the static default on the same pool (17.86 m, Table 11). No α\alpha that we tried within the convex hull of the four experts beats the static default; the larger gains in this paper come from shared-module repair (§ 5.2) and joint replay (§ 5.3).

Table 11: Greedy soup of the four per-ODD experts on the seed-7 disjoint target-region evaluation pool (CRC32 split, Appendix § 21). The experts are ranked by fleet mean (lowest first), the soup is initialised with the best one, and each subsequent expert is added only if the uniformly averaged soup improves on the evaluation pool. In the trial rows, A, B, C and D denote ODD-Hongo, ODD-Kashiwa, ODD-Shalun and ODD-Nagoya. Reference rows give the uniform soup over all four experts and the vMF mixture at τ=200\tau=200 km (GPS soft mix); the latter is copied from Table 10, was measured on Pool A, and is not comparable with the other rows.

ConfigurationKnowledge HubIshiodaiMorikoroFleet mean
ODD-Hongo (ODD-Hongo) alone5.9939.0655.5933.55
ODD-Kashiwa (ODD-Kashiwa) alone5.9831.5222.9020.13
ODD-Shalun (ODD-Shalun) alone13.631.5330.6325.25
ODD-Nagoya (ODD-Nagoya) alone4.5131.5817.4817.86
Soup {D, B} (trial)4.6231.8019.9318.78
Soup {D, C} (trial)4.7929.9022.3019.00
Soup {D, A} (trial)3.7934.1231.0923.00
Uniform soup over all four4.9332.9127.6021.81
Greedy soup final (single expert ODD-Nagoya)4.5131.5817.4817.86
GPS soft mix τ=200\tau=200 km (reference, Table 10)4.024.6338.9—

Table 11.

Greedy soup. Greedy soup [13] over the four per-ODD experts ends with ODD-Nagoya alone (Table 11). We use the seed-7 disjoint target-region pool for validation. Starting from the best single expert, ODD-Nagoya, the procedure rejects every candidate addition. The uniform soup over all four experts (21.81 m) is worse than ODD-Nagoya alone (17.86 m).

Interpolation advantage of uniform soups. Uniform soups usually beat the average of their endpoints but not the best endpoint. We adapt the interpolation-advantage metric of Wortsman et al. [13] to errors, where lower is better:

ΔI(W1,W2)≜12(err⁡(W1)+err⁡(W2))−err⁡(12W1+12W2).\Delta_{\mathrm{I}}(W_1,W_2) \triangleq\frac{1}{2}\bigl(\operatorname{err}(W_1)+\operatorname{err}(W_2)\bigr)-\operatorname{err}\left(\frac{1}{2}W_1+\frac{1}{2}W_2\right).

ΔI\Delta_{\mathrm{I}} is positive if and only if the soup beats the arithmetic mean of its endpoints, which indicates a bonus from linear mode connectivity [31]. For the soup to also beat the best endpoint (the strict soup effect of Wortsman et al.), ΔI\Delta_{\mathrm{I}} must exceed the inter-task gap, defined as the mean endpoint error minus the best endpoint error. Equivalently, the gap to the best endpoint, Δgap\Delta_{\mathrm{gap}}, must be negative. ΔI\Delta_{\mathrm{I}} is positive in nearly every cell of Table 12, but in fleet mean the inter-task gap is 1.4 to 5.4 times larger. The soup therefore loses to the best single expert except in two cells (visualised in Figure 5).

Two-dimensional slices of the training-loss, target-region-error and Morikoro-error landscapes

Figure 5. Two-dimensional slice of the loss/error landscape spanned by two per-ODD experts, drawn in the style of Figure 2 of Wortsman et al. [13]. The anchors are θ0\theta_0 (shared module only; fleet mean 20.11 m, Morikoro 39.67 m), θ1\theta_1 (ODD-Nagoya; 19.41, 34.94), θ2\theta_2 (ODD-Kashiwa; 22.96, 41.16) and θsoup=12(θ1+θ2)\theta_{\mathrm{soup}}=\frac{1}{2}(\theta_1+\theta_2) (20.70, 37.64). Only these four points are evaluated; the surface is a thin-plate-spline interpolation through them.

Table 12: Interpolation advantage ΔI\Delta_{\mathrm{I}} (mean endpoint error minus soup error) for each two-expert and four-expert uniform soup on the seed-7 CRC32-disjoint target-region evaluation pool (Appendix § 21). Positive values indicate that the soup beats the arithmetic mean of its endpoints, a bonus from linear mode connectivity. Table 13 reports Δgap\Delta_{\mathrm{gap}} for the same rows.

SoupKnowledge HubIshiodaiMorikoroFleet
{ODD-Nagoya, ODD-Kashiwa}+0.63−0.26+0.26+0.21
{ODD-Nagoya, ODD-Shalun}+4.27+1.66+1.76+2.56
{ODD-Nagoya, ODD-Hongo}+1.46+1.20+5.45+2.70
Uniform {D, B, C, A}+2.60+0.51+4.06+2.39

Table 12.

SoupKnowledge HubIshiodaiMorikoroFleet
{ODD-Nagoya, ODD-Kashiwa}+0.10+0.29+2.45+0.93
{ODD-Nagoya, ODD-Shalun}+0.28−1.63+4.82+1.14
{ODD-Nagoya, ODD-Hongo}−0.72+2.54+13.61+5.14
Uniform {D, B, C, A}+0.41+1.39+10.11+3.95

Table 13. Gap to the best endpoint, Δgap\Delta_{\mathrm{gap}} (soup error minus the error of the best single endpoint; positive values mean the soup is worse), for the same soups as Table 12 on the seed-7 CRC32-disjoint target-region evaluation pool (App. § 21). Bold cells have negative Δgap\Delta_{\mathrm{gap}}: the soup beats the best single expert, the strict soup effect of Wortsman et al.

TIES-Merging. Sign-aware merging does not close the inter-task gap either (Table 14). TIES-Merging [14] reduces interference between task vectors in three steps: within each layer, each Δi\Delta_i is trimmed to its top-k%k\% entries by magnitude; for each entry, the elected sign is that of the magnitude-weighted majority; and the merged Δ\Delta averages only the entries whose trimmed sign matches the elected sign. We use keep-densities of 20%, the standard setting of Yadav et al. (“canonical Yadav” in the table), and 50% as an ablation. Across all expert pairs and adapter layers, the mean absolute off-diagonal cosine similarity between task vectors is ∣cos⁡∣=0.065\lvert\cos\rvert=0.065. The task vectors are therefore nearly orthogonal, so TIES has few sign conflicts to resolve. TIES is statistically indistinguishable from the uniform soup (22.4–22.5 m versus 21.8–22.3 m, with ∼0.5\sim0.5 m of cuDNN re-evaluation noise) and loses to the best single expert (17.86 m).

ConfigurationKnowledge HubIshiodaiMorikoroFleet mean
Best single (ODD-Nagoya, Table 11)4.5131.5817.4817.86
Uniform soup all 4 (Table 11)4.9332.9127.6021.81
TIES-Merging, keep-density 20% (canonical Yadav)5.8335.5626.1422.51
TIES-Merging, keep-density 50% (ablation)5.1935.0526.8822.37
Uniform soup all 4 (TIES re-eval, cuDNN noise)6.0732.3028.5122.29
Joint-replay from-scratch (the rank-allocation sweep) – reference1.946.006.814.92

Table 14. TIES-Merging [14] of the four per-ODD experts at two keep-densities, evaluated on the seed-7 CRC32-disjoint target-region evaluation pool (App. § 21). Reference rows are taken from Table 11 and from the joint-replay frontier of § 5.3.

Shared-Adapter Repair: Per-Expert Results and Perturbation Ablation

ConfigurationKnowledge HubIshiodaiMorikoro
Static default (ODD-Nagoya) (original shared)4.51±0.794.51 \pm0.794.82±0.844.82 \pm0.8431.88±32.0531.88 \pm32.05
shared module only, original14.3±4.114.3 \pm4.17.7±4.67.7 \pm4.646.3±35.346.3 \pm35.3
shared module only, repaired6.0±2.26.0 \pm2.26.1±1.66.1 \pm1.621.4±26.021.4 \pm26.0
ODD-Hongo + repaired-shared24.5±13.224.5 \pm13.217.6±6.417.6 \pm6.450.3±43.250.3 \pm43.2
ODD-Kashiwa + repaired-shared7.9±0.57.9 \pm0.57.8±0.57.8 \pm0.511.1±10.511.1 \pm10.5
ODD-Shalun + repaired-shared6.0±2.16.0 \pm2.15.8±1.55.8 \pm1.518.3±24.918.3 \pm24.9
ODD-Nagoya + repaired-shared11.0±3.611.0 \pm3.69.5±2.69.5 \pm2.612.2±8.212.2 \pm8.2

Table 15. Per-expert lateral offset (m) on the three held-out maps before and after fine-tuning the shared module on procedurally perturbed training-ODD scenes.

Ablation of the perturbation components. The perturbation used for shared-module repair has three components: a per-lanelet SE(2) rotation drawn uniformly from ±45∘\pm45^\circ, a cubic Bezier curvature warp with amplitude ±3\pm3 m on each lane, and a random boundary drop that removes one of the two lane boundaries with probability 0.5. Table 16 disables each component in turn, repeats the 500-step fine-tune of the shared module under the same 10-term reward, and reports the resulting lateral offset, including per-seed values on Morikoro, the open-park map.

ConfigurationKnowledge Hub (seeds)Ishiodai (seeds)Morikoro (seeds)Morikoro per-seed
Baseline: rot + bezier + drop5.99±2.235.99 \pm2.236.05±1.636.05 \pm1.6321.4±26.021.4 \pm26.0single seed
− SE(2) rotation6.05±3.376.05 \pm3.377.12±3.617.12 \pm3.6133.13±7.2433.13 \pm7.24[41.4, 28.0, 29.9]
− Bezier curvature warp7.01±2.997.01 \pm2.997.53±2.697.53 \pm2.6926.28±4.7026.28 \pm4.70[31.5, 22.4, 24.9]
− Boundary drop6.95±2.506.95 \pm2.507.56±2.197.56 \pm2.1928.12±13.9628.12 \pm13.96[44.1, 22.0, 18.3]

Table 16. Ablation of the perturbation components used for shared-module repair, with three independent seeds per ablation row; the baseline row is a single seed. Each ablation row repeats the same 500-step fine-tune of the shared module with one perturbation component disabled.

SE(2) rotation contributes the most; the Bezier warp and the boundary drop contribute less, and by similar amounts. An earlier single-seed run suggested that disabling the boundary drop costs nothing. We retract that claim: the seed-to-seed standard deviation of 13.96 m on Morikoro without the boundary drop shows that the finding was driven by noise.

Distilled Regional Adapter

Regional Adapter via Distillation

Table 17 reports the distilled regional adapter under the protocol of § 3. The student is a rank-4 LoRA on the frozen base planner, and the teacher is a soft mixture of the experts at τ=200\tau=200 km. The student is trained on 56 scenes from the seed-42 training pool and evaluated on the disjoint seed-7 lanelet pool.

The distilled student follows the coarse route geometry (forward progress of 138+ m) but beats the static default only on Ishiodai and is worse on Knowledge Hub and Morikoro (Table 17). The Lipschitz argument below explains this result at rank 4.

MapMax lateral (m)Forward progress (m)Static default (m)Change
Knowledge Hub18.63±6.1918.63 \pm6.19156.80±2.34156.80 \pm2.344.514.51+313%+313\%
Ishiodai19.32±30.5319.32 \pm30.53149.61±25.40149.61 \pm25.4031.5831.58−39%-39\%
Morikoro37.83±20.6937.83 \pm20.69151.00±14.18151.00 \pm14.1817.4817.48+116%+116\%

Table 17. Distilled regional adapter on the three held-out maps, with training and evaluation scenes drawn from disjoint lanelets (§ 3). Each cell gives the mean and standard deviation over the seed-7 evaluation pool of road lanelets. The adapter is a single 78K-parameter rank-4 LoRA on the base planner, with no per-ODD modules.

Lipschitz capacity of the student and its empirical limit. The disjoint-evaluation result follows from the function class of the student. A rank-rr LoRA student on a frozen base planner has a Lipschitz constant bounded by the product of per-layer operator norms plus a rank-dependent perturbation term. Let fT:X→Rdf_T:\mathcal{X}\to\mathbb{R}^d denote the teacher (the α\alpha-blended merged-expert dictionary) and fSf_S the rank-rr student. Each LoRA layer perturbs the base linear map W0∈Rdout×dinW_0 \in\mathbb{R}^{d_{\mathrm{out}}\times d_{\mathrm{in}}} by BABA, with A∈Rr×dinA \in\mathbb{R}^{r\times d_{\mathrm{in}}} and B∈Rdout×rB \in\mathbb{R}^{d_{\mathrm{out}}\times r}. With the standard initialisation and the weight-decay-bounded training that we use, ∥BA∥2≤βr\lVert BA\rVert_2 \le\beta\sqrt{r} for a layer-wise constant β\beta, so the global Lipschitz upper bound across LL MLP layers is

Lip⁡(fS)≤∏ℓ=1L(∥W0(ℓ)∥2+βℓr).\operatorname{Lip}(f_S) \le\prod_{\ell=1}^{L}\left(\lVert W_0^{(\ell)}\rVert_2+\beta_{\ell}\sqrt{r}\right).

The per-layer perturbation rank of the teacher is Kre=32K_{r_e}=32 (four experts ×\times rank 8). Its Lipschitz upper bound is the same product with r\sqrt{r} replaced by 32\sqrt{32}, which is roughly 8\sqrt{8} larger at every layer. Structurally, the student is a low-pass version of the teacher.

The rank-128 Skyline of §I.1 (32× larger) still does not match the per-expert baseline, so the bottleneck is the supervision signal (trajectory MSE to the teacher) rather than rr. Replacing this signal with the joint-replay recipe of § 5.3 (single checkpoint) gives 2.24/2.77/7.78 m on Knowledge Hub / Ishiodai / Morikoro with a budget of 20 target-region scenes, on the same evaluation pool.

Joint-Replay Recipe and Frontier

The Joint-Replay Frontier

The methods of § 5.1–§F.1 keep the experts frozen. They cause no forgetting by construction, but their target-region accuracy is limited to the disjoint-evaluation results of Table 17. Here we remove the freeze and measure what a small, targeted relaxation gains.

Recipe. Joint replay unfreezes the full adapter stack (parameter inventory in App. § 21) and trains it to maximise the original ODD-conditioned reward of § 3. The training pool combines 200 training-ODD scenes (50 from each of the four training ODDs) with a small target-region pool from the seed-42 disjoint training set, at a fixed ratio of 10:1 in favour of training-ODD scenes. We use AdamW with lr=5×10−5\mathrm{lr}=5 \times10^{-5} and a gradient accumulation factor of 4, and stop after 500 optimiser steps (∼5\sim5 minutes of wall-clock time on one consumer GPU). We call the resulting set of weights the joint-replay frontier, because a single setting, the target-region pool size ntarget−regionn_{\mathrm{target-region}}, moves it between the frozen adapter stack and full retraining.

Trajectory metrics beyond lateral offset. Table 32 (App. § 25) reports lateral offset, 95th-percentile jerk magnitude, 95th-percentile lateral acceleration, the fraction of trajectories that leave the ±3\pm3 m corridor, and forward progress over 8 seconds on Pool A, the 24-scene routing pool. These are open-loop proxies from a single rollout, not closed-loop safety measurements. The absolute jerk values (700–1300 m/s3^3) are large because we report raw third-order finite differences, without the Savitzky–Golay smoothing that the V3 comfort proxy of §O applies before its ISO 2631 threshold check. Only relative comparisons between configurations are meaningful.

configurationlateral offset (m)jerk-p95lat-acc-p95exit-%progress (m)
shared module only (no expert)24.89132344.3195.8164.3
static default (ODD-Nagoya)16.0497054.40100.0163.7
joint-replay (inherit-shared)6.9571952.25100.0186.9
joint-replay (from-scratch r=4)4.3584823.4750.0178.1

Table 32. Trajectory diagnostics on the 24-scene held-out target-region pool. The quantities are computed in open loop from a single deterministic DPM-Solver++ rollout per scene; they are proxies for comfort and corridor compliance, not closed-loop safety measurements. Jerk and lateral acceleration are unsmoothed finite differences of the raw 10 Hz plan, so only comparisons between models are meaningful; exit-% is the share of rollouts that leave a straight ±3 m band along the start lanelet. Of the 10 Ishiodai scenes, 7 are in the training set of both joint-replay checkpoints (§ 4).

Data budget and shared-module initialisation. The joint-replay frontier is a family with two settings, (ntarget−regionn_{\mathrm{target-region}}, shared init). The pool size ntarget−regionn_{\mathrm{target-region}} trades data budget for held-out accuracy. The initialisation of the shared module, either inherited from the pretrained model or trained from scratch, trades forgetting on the training ODDs for target-region accuracy. The distilled regional adapter (§F.1) lies off this frontier, on the axis with no target data: it causes no forgetting by construction and reaches a fleet mean of 25.26 m. With the inherited shared module (inherit-shared), ntarget−region=20n_{\mathrm{target-region}}=20 gives 15.43 m with ∑Δroute−dev=0.04\sum\Delta_{\mathrm{route-dev}}=0.04 m. With the shared module trained from scratch, the same nn falls in the 5–9 m range but costs a +11–16 m regression on the training ODDs. These numbers come from the rank sweep and use the evaluation slice with 30 training scenes per map, which is harder than the per-seed slices of § 5.3. They can be compared with each other but not with the numbers in the main text (see the footnote in App. § 17).

Pareto view of target-region offset against forgetting for the weight-space baselines and the joint-replay configurations

Figure 6. Pareto view of target-region offset against forgetting for the weight-space baselines and the joint-replay configurations. Horizontal axis: regression on the training ODDs, measured as the increase in route deviation summed over the four training ODDs (Δ\Delta=0 is the frozen adapter stack). Vertical axis: target-region fleet-mean lateral offset on the CRC32-disjoint seed-7 pool. Step line: empirical Pareto frontier. Star: the from-scratch rr=4 checkpoint at (+13.30, 7.35), which has not been deployed on the vehicle.

Sample Complexity over Training Seeds

Joint-Replay Sample Complexity

Table 18 varies the target-region pool size ntarget−region∈{5,10,20,40,80}n_{\mathrm{target-region}} \in\{5, 10, 20, 40, 80\} for joint replay with the inherited shared module, with the training-ODD pool fixed at 200 scenes and training fixed at 500 optimiser steps. Target-region training scenes are drawn from the seed-42 disjoint training pool of 144 candidate scenes. The evaluation set is the corresponding seed-7 pool of 24 disjoint target-region scenes, built from the remaining lanelets.2

ntarget−regionn_{\mathrm{target-region}}fleet (seed-42, m)fleet (3-seed mean±\pmstd, m)Training-ODD ∑Δroute dev\sum\Delta_{\mathrm{route\ dev}} (m)Training-ODD ∑Δprogress\sum\Delta_{\mathrm{progress}} (m)Train wall-clock
Pre (shared module only; ntrainn_{\mathrm{train}}=80 eval slice)17.48————
56.769.79 ±\pm 5.14+5.00+25.864.5 min
107.5410.14 ±\pm 6.62−0.33+3.294.5 min
205.516.17 ±\pm 1.23+2.43+21.374.5 min
405.105.67 ±\pm 1.06+0.54+4.694.4 min
80†4.44— (†)+0.23−0.564.3 min

Table 18. Sample complexity of joint replay with the inherited shared module (inherit-shared) on CRC32-disjoint seed-7 target-region evaluation slices (24 scenes per training seed, drawn from the lanelets left after that seed’s training selection; see App. § 21). Each row is a separate joint-replay training run with the given target-region pool size, a training-ODD to target-region ratio of 10:1, and 500 optimiser steps. Column 2: fleet mean for a single seed (seed-42). Column 3: fleet mean over seeds {42, 43, 44}, each scored on its own evaluation slice; the nn=80 row has a single seed and is marked †. The training-ODD columns sum over the four training ODDs.

Seed variance at small nn. At small nn, the best result varies strongly across seeds. The three-seed std falls by 4.2×\times from nn=5 (5.14 m) to nn=20 (1.23 m) (Figure 4), and by a factor of five from nn=10 (6.62 m) to nn=20. Over the same sweep, summed training-ODD forgetting stays within a cross-seed std of 0.94–1.23 m at every nn. We therefore give ntarget−region≥20n_{\mathrm{target-region}} \ge20 as the budget at which results are stable in practice. The single-seed minimum at n=5n=5 (seed-42; 6.76 m, −61%) is optimistic, since its three-seed mean is 9.79 m (−44%). At n=40n=40 the mean (5.67 ± 1.06 m) is still above the single-seed n=80n=80 reference (4.44 m).

Capacity Test with a High-Rank LoRA

Capacity under Reward Supervision

A LoRA with thirty-two times more parameters, trained by reward backpropagation, does not close the gap to the small adapter distilled with an MSE loss. This configuration, Skyline, attaches a rank-128 LoRA to every decoder MLP layer (≈ 2.5 M trainable parameters, ∼ 32× the distilled adapter), freezes the base planner, and overfits it to the held-out scenes by direct reward backpropagation for 2000 steps. Table 19 compares its lateral offset with that of the distilled adapter and the static default. The bottleneck is thus the supervision signal rather than capacity. Matching the teacher under an MSE loss is a low-curvature target that the Lipschitz-bounded student (§F.1) can track, whereas reward backpropagation admits reward maxima with large lateral offsets, which the high-capacity Skyline reaches first.

ConfigurationKnowledge HubIshiodaiMorikoro
Static default (no adaptation)4.514.8231.88
Distilled regional adapter (78 K params, 1.5 min)6.104.0518.88
Skyline rank-128 LoRA (2.5 M params, ≈ 15 min)24.09 ± 0.0224.28 ± 0.0924.35 ± 0.12

Table 19. Skyline, an upper bound overfit to the held-out scenes, versus the deployable distilled adapter. Skyline: 2.5 M-parameter rank-128 LoRA trained for 2000 optimiser steps; distilled adapter: 78 K-parameter rank-4 LoRA, 300 optimiser steps, 1.5 min.

nuPlan Leave-One-City-Out Evaluation

Cross-City Evaluation on a Public Benchmark

We repeat the cross-city evaluation on the public nuPlan dataset with a leave-one-city-out protocol over four cities: Boston, Pittsburgh and Las Vegas (right-hand traffic, ≈58 K scenes) and Singapore (sg-one-north, left-hand traffic, ≈9 K scenes). Singapore is the only left-hand-traffic city in nuPlan.

Planner variant and input/output changes. The nuPlan checkpoint is incompatible with our Autoware stack (740 missing keys under strict loading). We therefore use the nuPlan-compatible variant of the diffusion planner and reproduce our fine-tuning setup in it. A rank-4 shared LoRA is attached to every nn.Linear layer of the decoder outside multi-head attention (89,472 trainable parameters) and trained for 500 steps with the official diffusion training loss (marginal-probability noise schedule and score MSE) on the three training cities (Boston, Pittsburgh and Las Vegas when Singapore is held out). No data from the held-out city is used. We make two input/output changes. The agent-future tensor of each scene is stored as (x,y,θ)(x,y,\theta) and is converted to (x,y,cos⁡θ,sin⁡θ)(x,y,\cos\theta,\sin\theta) before the loss, and the 32 neighbour-future tracks are truncated to predicted_neighbor_num=10. The training loss decreases monotonically from 10.37 to 3.38 on the three-city pool.

Three-seed 4×4 leave-one-city-out evaluation. For each held-out city, we fine-tune on the other three cities with three seeds {42, 43, 44} and evaluate on a fixed pool of 50 scenes per city. Table 20 reports the mean ± std over seeds; the std is below 1 m for every entry. Every held-out diagonal entry improves on the base planner in its column, and every entry for a training city also improves on the base, which shows that performance on the cities seen in training is preserved.

ConfigurationBoston evalPittsburgh evalLas Vegas evalSingapore eval
Base (single seed)2.174.511.868.64
Boston held-out (3 seeds)1.63 ±\pm 0.163.15 ±\pm 0.241.25 ±\pm 0.205.10 ±\pm 0.30
Pittsburgh held-out (3 seeds)1.71 ±\pm 0.213.40 ±\pm 0.371.37 ±\pm 0.275.61 ±\pm 0.66
Las Vegas held-out (3 seeds)1.71 ±\pm 0.183.27 ±\pm 0.211.34 ±\pm 0.185.44 ±\pm 0.46
Singapore held-out (3 seeds, LHT)1.71 ±\pm 0.253.49 ±\pm 0.441.42 ±\pm 0.275.60 ±\pm 0.78

Table 20. nuPlan 4×44 \times4 leave-one-city-out transfer matrix over three seeds. For each held-out city (row), a 3-city LoRA is trained on the other three cities with three independent seeds; each cell gives the mean ±\pm std over seeds on one of the four cities (columns). Held-out diagonal entries are in bold. The base row (single seed) is the nuPlan BC checkpoint evaluated on the same fixed pool.

Distance from the training cities. Singapore (≈1.3∘\approx1.3^\circ N, left-hand traffic) lies 5,000–15,000 km from the three training cities. The held-out maps of the target region lie 11–17 km from ODD-Nagoya, but for Singapore a static default has no nearby ODD to fall back on. Even so, the Singapore-held-out row of Table 20 reduces the lateral offset on Singapore from 8.64 to 5.60 ±\pm 0.78 m (−35%-35\%) without any Singapore data. Because no data from the held-out city is used, this experiment does not test joint replay; it shows that the fine-tuned planner transfers to a distant city in open loop.

Single-seed 4×44 \times4 transfer matrix. To check whether the Singapore result is an artefact specific to that city, we also report the full 4×44 \times4 transfer matrix for a single seed (Table 21). Held-out diagonal entries are within 80%–99% of the entries for cities seen during training. This is consistent with the fine-tuning transferring almost without loss across the three right-hand-traffic North American cities and partially to left-hand-traffic Singapore.

LoRA training setBostonPittsburghLas VegasSingapore
None (base BC)2.14 ±\pm 6.684.58 ±\pm 8.921.80 ±\pm 3.958.55 ±\pm 10.09
3-city, holdout Boston[1.71 ±\pm 4.55]3.03 ±\pm 5.941.36 ±\pm 2.505.40 ±\pm 6.53
3-city, holdout Pittsburgh1.71 ±\pm 4.24[3.50 ±\pm 6.42]1.34 ±\pm 2.215.41 ±\pm 6.51
3-city, holdout Las Vegas1.62 ±\pm 4.283.36 ±\pm 6.48[1.25 ±\pm 2.31]5.30 ±\pm 6.46
3-city, holdout Singapore2.05 ±\pm 4.423.69 ±\pm 6.371.86 ±\pm 2.77[5.93 ±\pm 6.68]

Table 21. nuPlan 4×44 \times4 cross-city transfer matrix. Each row is a LoRA trained on three cities and evaluated on all four; the held-out city is shown in [brackets]. Maximum lateral offset (m), 50 scenes per city.

Routing Feature Ablations

This section reports the three routing and feature experiments referenced in § 4. (i) We extend the hand-crafted scene feature from 8 to 38 dimensions by adding histograms of traffic lights, line types and speed limits. The extended feature attains 1.000 validation accuracy on the four-ODD training pool, but oracle routing accuracy drops from 0.375 at 8 dimensions to 0.250 (chance) at 38 dimensions, and the resulting fleet mean rises from 31.0 to 36.9 m. (ii) We measure how much information a feature carries about the per-scene oracle expert with a summed mutual-information statistic: we sum per-coordinate KSG estimates [27] over the feature dimensions. The sum is not the joint mutual information, which cannot exceed log⁡4≈1.39\log4 \approx1.39 nats for a four-valued label, and it counts redundant information more than once. We therefore use it only as a test statistic against a permutation null. For the 256-d planner-encoder embedding, the statistic drops from 60.3 on the in-distribution training-ODD pool to 15.4 on the held-out pool, against a permutation-null mean of 9.5 (p=0.088p=0.088). For the 3-d GPS position, it drops from 4.25 to 0.00 (p=1.000p=1.000), because GPS coordinates vary little within the target region compared with the variation between training ODDs on which GPS was discriminative. (iii) The reward-as-scorer Selector picks arg⁡max⁡ϵR(τϵ)\arg\max_{\epsilon} R(\tau_{\epsilon}) at inference time, using the planner’s own training reward. It picks ODD-Shalun on 20/24 held-out scenes, which gives a routing accuracy of 0.125 (half that of random choice) and an offset of 29.8 m (mean over scenes; 26.6 m when averaged over maps as in Table 2). The advantage of the static default comes from a constant marginal prior (always use the expert of the nearest training ODD), not from per-scene discrimination, regardless of whether the routing feature is based on perception or on geography.

Hyperparameters and Training Recipes

Table 22 lists all training recipes; each runs on a single consumer GPU. All recipes use AdamW (weight decay 0.01 unless noted otherwise), gradient-norm clipping at 1.0 and gradient accumulation of 4 (effective batch of 4 scenes), without mixed precision. The DPM-Solver++ sampler runs N=10N=10 second-order denoising steps with logSNR-spaced timesteps. It is deterministic and differentiable end to end, which enables reward back-propagation [1, 2]. No hyperparameter is tuned on the held-out maps; all values are inherited from the base Diffusion-Planner recipe or set by in-distribution validation.

Table 22: Hyperparameters of the training recipes: optimisation budget. The budgets exclude the training of the underlying base planner, which is not part of this paper’s contribution. The loss and training data of each recipe are given in Table 23.

RecipeLossTrain data
Shared-module repair (§5.2)ODD reward4×504 \times50 training-ODD npz, perturbed in-place
Rank-8 shared replication (App. E)ODD rewardsame as above
Regional-adapter distillation (§F.1)MSE to teacher trajectory60 seed-42 target-region train scenes
Joint replay (§7)ODD reward200 prod npz + 20 target-region seed-42
Joint-replay sample-complexity (§H.1)ODD reward200 prod + {5, 10, 20, 40, 80} target-region
Skyline rank-128 (§I.1)ODD reward24 target-region eval scenes (overfit)
VD-GRPO (c=50) (variance-decoupled GRPO study)VD-GRPO advantage · noise-MSE log-pi200 prod + perturbations
nuPlan 3-city LoRA (§J.1, per LOO row)diffusion noise-MSE3000 npz per non-held-out city
nuPlan Singapore distillationMSE to teacher trajectory100 Singapore teacher rollouts

Table 23.

Table 23: Hyperparameters of the training recipes: loss and training data (companion to Table 22). In the training-data column, “npz” denotes scene files and “prod” denotes the training ODDs.

RecipeTrainable paramsLRStepsWall-clock
Shared-module repair (§5.2)78,3685×10−55 \times10^{-5}5003.9 min
Rank-8 shared replication (App. E)156,7365×10−55 \times10^{-5}5004.0 min
Regional-adapter distillation (§F.1)78,3681×10−41 \times10^{-4}3001.5 min
Joint replay (§7)862,0485×10−55 \times10^{-5}5005.0 min
Joint-replay sample-complexity (§H.1)862,0485×10−55 \times10^{-5}5004.4–5.7 min each
Skyline rank-128 (§I.1)∼2.5×106\sim2.5 \times10^{6}5×10−55 \times10^{-5}200015 min
VD-GRPO (c=50) (variance-decoupled GRPO study)78,3685×10−55 \times10^{-5}50013 min
nuPlan 3-city LoRA (§J.1, per LOO row)89,4725×10−55 \times10^{-5}5001 min per row
nuPlan Singapore distillation89,4721×10−41 \times10^{-4}2001 min

Table 22.

Reward function (per-ODD weights). The ODD-conditioned reward is a linear combination of 10 terms that depend only on the trajectory, with separate weights for each ODD (§ 3). The per-ODD weights are taken from the underlying Diffusion-Planner training run and are not tuned in this paper. As an example, the default weights are progress 2.0, route deviation 2.0, curvature 3.0, comfort 0.5, heading error 1.0, stop bias 1.0, lateral acceleration 1.0, collision 4.0, RSS obstacle 1.5 and RSS route 0.5. The progress term is clamped at 200 m so that the reward does not diverge on long-horizon predictions. At convergence, the reward typically lies in the O(300O(300–500)500) range.

Disjoint training and evaluation split. The training pool (seed 42) and the evaluation pool (seed 7) of road lanelets are produced by the deterministic helper function disjoint_scene_split in our release. For each held-out map, the helper (i) extracts all road lanelets, (ii) shuffles them with seed 42 plus a per-map salt and takes the first ntrainn_{\mathrm{train}} as training lanelets, and (iii) shuffles the remaining lanelets with seed 7 and takes the first nevaln_{\mathrm{eval}} as evaluation lanelets. Knowledge Hub has only four road lanelets, so all four are reserved for evaluation and the map contributes no training scenes. The helper is unit-tested to guarantee zero overlap between the two index sets.

Parameter-count breakdown of the base planner and adapter stack. Table 24 lists the parameters of the base planner, its DiT decoder and the adapter stack. LoRA wraps only the MLP nn.Linear layers of the DiT decoder, a subset of 4.05 M parameters. The remaining ∼3.04\sim3.04 M DiT parameters (self-attention, cross-attention, LayerNorm and adaLN modulation) are frozen without LoRA modulation. They are not wrapped because the forward pass of PyTorch’s nn.MultiheadAttention accesses out_proj.weight through a fused-attention fast path, which fails on a wrapped LoRALinear child (see § 3).

ComponentParametersRole
Base Diffusion-Planner (vanilla, no LoRA)
encoder (frozen)7,419,264frozen
decoder (frozen)7,083,929frozen
of which DiT total7,082,564frozen
DiT.preproj (fc1 + fc2)297,728LoRA target
DiT.blocks (×3)5,922,816mixed
DiT.final layer (proj[1] + proj[4])729,924LoRA target
of which decoder wrapper/glue1,365frozen
Full model total14,503,193frozen
Per DiT block (×3, identical structure)
self-attention263,168frozen, no LoRA
cross-attention263,168frozen, no LoRA
mlp1 (fc1 + fc2)525,568LoRA target
mlp2 (fc1 + fc2)525,568LoRA target
adaLN_modulation394,752frozen, no LoRA
norm×42,048frozen, no LoRA
LoRA-wrapped frozen subset (the ”modulated” base)
sum over LoRA-target nn.Linear layers4,046,404frozen base, modulated by LoRA
adapter trainable modules (joint-replay configuration, § 5.3)
shared LoRA (rank 4)78,368trainable
expert LoRA ×4 (rank 8 each)626,944trainable
adapter trainable total705,312trainable
Full model with adapter15,208,50595.4% frozen, 4.6% trainable

Table 24. Parameter counts of the Diffusion-Planner base planner and of the adapter stack applied on top of it. Only the linear layers of the DiT MLPs are LoRA-wrapped; the attention and normalisation blocks stay frozen and are not modulated.

Details of the Routing Schemes

This section gives the per-scheme details summarised in § 4. Unless stated otherwise, all results are on Pool A.

Scene-conditioned MLP. The MLP reaches 1.000 validation accuracy on the four-ODD training pool. On the held-out maps, however, it routes nine of ten Ishiodai scenes and five of ten Morikoro scenes to ODD-Hongo rather than to the geographically nearest expert, ODD-Nagoya. This doubles the static default’s offset on Ishiodai and on Morikoro.

Self-consistency. Both variants, with and without magnitude normalisation, effectively select the shared module alone, because the consistency metric systematically favours small-magnitude outputs.

Denoising loss. The pooled Kendall-τ\tau correlation between the denoising loss and the realised offset of each expert is 0.172, below the preregistered threshold of 0.2.

Conformal corridor. At T=5T=5 m, the corridor abstains on every scene. At T=15T=15 m, it reduces to the vMF mixture (§ 5.1) and adds no triage signal of its own.

Reward-supervised gate. The gate is trained directly on realised offset. Across 50 seeds, it converges to a solution that places 0.967 of its weight on ODD-Nagoya, and it matches the static default on Morikoro (32.26 ±\pm 0.56 m).

Reward-as-scorer. Selecting arg max⁡eR(τe)\operatorname{arg\,max}_{e} R(\tau_e) at inference time routes 20 of 24 scenes to ODD-Shalun. Its routing accuracy against the oracle is 0.125, below the 0.25 of random choice.

Oracle headroom and classifiers. The oracle improves the mean offset over the 24 scenes from 16.04 to 15.15 m (p=0.012p=0.012). This is a mean over scenes; Table 2 instead reports fleet means (13.74 m for the same default). On a 104-scene pool built from the same maps with the same protocol but new start lanelets, the gain is 1.34 m (bootstrap CI [0.7, 2.2]), and on Pool B it is 1.1 ±\pm 0.5 m. For comparison, joint replay improves the mean over the 24 scenes from 16.04 to 6.95 m (p=0.0005p=0.0005; 19 of 24 scenes improve). Leave-one-out classifiers (logistic regression, kk-NN and SVM) using the 8 hand-crafted features or the 256-d encoder embedding reach exactly the majority-class accuracy: 0.667 on the 24 scenes and 0.625 on the 104 scenes.

Conformal Calibration Details

Table 25 reports the split-conformal calibration of each expert. For reproducibility, the last column also gives the in-sample residual quantile used in an earlier draft, which has no coverage interpretation.

Expertntrainn_{\mathrm{train}}ncaln_{\mathrm{cal}}meanstdsplit-conformalin-sample
ODD-Hongo1081220.520.067.983.5
ODD-Kashiwa1081217.411.034.253.9
ODD-Shalun1081211.44.617.115.5
ODD-Nagoya1081232.620.461.433.4

Table 25. Split-conformal calibration of each expert. For calibration, 40% of each expert’s own-ODD scenes are held out (n=12n=12), and the split-conformal qeq_e uses the finite-sample order statistic ⌈(1−α)(n+1)⌉/n\lceil(1-\alpha)(n+1)\rceil/n at α=0.1\alpha=0.1. The last column reports the in-sample residual quantile, which has no coverage interpretation.

Exchangeability permutation test. The calibration residuals on the training ODDs and the residuals on the target region fail a pooled exchangeability test. For each expert, we draw B=10000B=10000 permutations of the labels that mark each residual as a training-ODD calibration residual or a target-region residual, recompute the difference in means under each permutation, and report the two-sided pp-value as the fraction of permutations whose absolute difference is at least the observed value. The pooled test, with 48 training-ODD and 96 target-region residuals, gives an observed difference of +18.15+18.15 m and p=0.0035p=0.0035. Per-expert tests at α=0.05\alpha=0.05 reject for ODD-Hongo (p=0.045p=0.045) and ODD-Shalun (p=0.0001p=0.0001), but not for ODD-Kashiwa (p=0.70p=0.70) or ODD-Nagoya (p=0.094p=0.094). The residuals, the permutation-test results and a summary of the null distribution are in results/routing-pool/conformal_exchangeability.json of the released repository.

Real-Vehicle Runs and a Separate DPO Adapter Study

This appendix reports a separate, deployment-oriented study on the same base planner and per-ODD experts. It is not part of the evaluation of joint replay or the other adaptation methods in the main text. The study fine-tunes a LoRA with a loss that combines Direct Preference Optimisation (DPO) [32] with an L2 imitation anchor, and trains it inside an outer loop of Sharpness-Aware Minimisation (SAM) [33]. Every output trajectory is scored with a three-layer proxy for the JAMA preventability framework, whose layers cover hard safety, careful-and-competent driving, and comfort; the tables call this proxy V3. The resulting configuration is compared with a production DPO LoRA that has been validated on the real vehicle in ODD-Kashiwa, and with the reward-back-prop family of reward-trained adapters, whose regression in comfort motivated the study.

JAMA-Inspired Preventability Proxy

The proxy is a per-trajectory scorer. It reports three layers separately and assigns each scenario to one of the buckets {cold_start, curve, straight, route_following, object_interaction}. It is not a full implementation of JAMA Ver. 4.0 §6, which requires a brake-delay simulator and a judge of Responder and Initiator roles; we build neither. A layer flags a trajectory if any of its criteria is triggered.

The strict_safety layer covers hard constraints with five criteria. These are a collision proxy (0.50.5 m; this threshold is our own, since JAMA does not specify an absolute distance), a minimum time-to-collision (2.02.0 s, taken from JAMA Ver. 4.0 §6.3.1 fig:108, which cites UNR ECE/TRANS/WP.29/1091), departure from the route corridor (1.751.75 m, derived from the 0.3750.375 m wobble allowance in JAMA fig:102 plus a half-lane buffer), extreme deceleration (9.819.81 m/s2^2, the physical ceiling of 11 G; the JAMA cap for a careful and competent driver is much tighter at 0.7740.774 G), and extreme lateral acceleration (6.06.0 m/s2^2, roughly 0.60.6 G). The c_and_c_driverlike layer covers behaviour that a careful and competent driver would not produce, with six criteria: a burst of acceleration from a cold start, driver-like limits on lateral acceleration, deceleration and acceleration, inconsistency between heading and velocity, and a check for a stuck planner. The comfort layer covers degraded ride quality rather than safety, with three criteria: jerk above 55 m/s3^3 (ISO 2631), lateral acceleration above 22 m/s2^2, and a speed-change rate above 33 m/s2^2.

Kinematics are computed from raw positions after a Savitzky–Golay filter (window 11, polynomial order 3, mode='interp'). The filter removes the finite-difference noise floor of ∼250\sim250 m/s3^3 in raw 10 Hz position data. An earlier version of the proxy (v1) used mode='nearest' at the trajectory boundaries. This choice alone added a 3232 m/s3^3 artefact on linear motion and made the jerk criterion over-trigger on the recorded human baseline. We therefore switched to mode='interp', which extrapolates the boundary samples with the fitted polynomial.

Scene-level split of training and validation data. Training and validation data are split at the level of scenes rather than preference pairs. This fixes a problem found by an audit of an earlier iteration of this study (v2): the in-loop evaluator drew from all ODD-Kashiwa scenes, whether or not a scene also appeared in a training preference pair. With seed 2026, the 3722 ODD-Kashiwa scenes are split into 2977 training and 745 validation scenes, and an assertion checks that the two pools are disjoint. Tables 26 and 28 report results on the validation pool only, so no scene used for evaluation appears in a preference pair seen during training.

Hybrid DPO + L2 Imitation Loss and SAM Outer Loop

Preference pairs are built from ODD-Kashiwa training scenes. The chosen trajectory is the recorded ego trajectory (the ego_agent_future field of the scene file). The rejected trajectory is sampled from a reward-back-prop LoRA. We use three samplers, Reward-back-prop (joint-replay), Reward-back-prop, and Reward-LoRA soup (12-variant), and generate ∼3000\sim3000 candidates with each. A pair is accepted if and only if the chosen trajectory passes the c_and_c_driverlike layer of V3 and the rejected trajectory violates at least one criterion. This gives 9553 accepted pairs out of 11166 attempts (85.6%) on 3722 ODD-Kashiwa scenes. Pairs from the 745 validation scenes are not used for training (see the scene-level split above).

The hybrid loss interpolates between standard DPO and an imitation loss, the mean squared error to the chosen trajectory:

L=(1−wimit)LDPO+wimitLimit,Limit=∥τ^θ−τchosen∥22.(5)\mathcal{L} = (1-w_{\mathrm{imit}})\mathcal{L}_{\mathrm{DPO}} + w_{\mathrm{imit}}\mathcal{L}_{\mathrm{imit}}, \qquad\mathcal{L}_{\mathrm{imit}} = \lVert\hat{\tau}_{\theta} - \tau_{\mathrm{chosen}} \rVert_2^2. \tag*{(5)}

Setting wimit=0w_{\mathrm{imit}}=0 recovers vanilla DPO, and we show below that this configuration collapses. Setting wimit=1w_{\mathrm{imit}}=1 recovers behaviour cloning with the L2 loss only. The DPO trust-region parameter β\beta controls how far the policy may drift from the reference distribution; a lower β\beta trusts the reference less and produces better-calibrated generations. The SAM outer loop perturbs the weights by ρ∇θL/∥∇θL∥\rho\nabla_{\theta}\mathcal{L}/\lVert\nabla_{\theta}\mathcal{L}\rVert and re-evaluates the gradient at the perturbed point. This encourages convergence to a flat minimum, at ∼1.9×\sim1.9\times the wall-clock cost.

Sweep results. We swept 29 configurations in the second stage of the study (Phase 2). SAM is the most effective single regulariser. Any non-zero anchor weight in [0.3,0.9][0.3, 0.9] is stable, whereas pure DPO collapses (§O.5). LoRA ranks 4 and 8 work best; rank 2 collapses and ranks ≥16\ge16 degrade. For DPO, β=0.01>0.1>1.0\beta=0.01 > 0.1 > 1.0. The source of the rejected trajectories affects the outcome substantially: Reward-back-prop alone gives a 3.3% violation rate, against 40% for Reward-back-prop (joint-replay). Across seeds, comfort varies by up to 30 pp.

Selected configuration. The best of all 29 trials, denoted DPO+L2+SAM, uses a shared module of rank 4 and an expert of rank 8 (α=32\alpha=32), expert index 1 (ODD-Kashiwa), the hybrid loss with wimit=0.5w_{\mathrm{imit}}=0.5 and βDPO=0.1\beta_{\mathrm{DPO}}=0.1, AdamW (lr =3⋅10−5=3\cdot10^{-5}, wd =10−4=10^{-4}) with SAM (ρ=0.05\rho=0.05), a constant learning-rate schedule, 10 epochs with early stopping on the in-loop evaluation over the disjoint validation scenes, and 1500 pairs.

Final Comparison (Phase 4) on 500 Validation Scenes

The comfort column is the one that separates the models. The reward-back-prop family (Reward-back-prop, Reward-back-prop (joint-replay), Reward-LoRA soup (12-variant)) has comfort-violation rates of 79–88%, whereas DPO+L2+SAM, with the same LoRA architecture, reaches 0%. This isolates the fault to the fine-tuning method. As a further check, DPO+L2+SAM (block-restricted), with LoRA only on the block bodies and not on perproj or final_layer, also reaches 0%, which is consistent with the per-layer ablation in §O.4. The longer run of the third stage (Phase 3; 25 epochs, 3000 pairs) rises to 5.20%, which reflects overfitting rather than checkpoint noise.

Per-Layer Ablation and a Training-Free Fix

When a reward-back-prop LoRA is already deployed on a vehicle and full retraining is not affordable, a per-layer ablation offers a cheaper alternative. We zero each of the 16 LoRA-adapted DiT layers of Reward-back-prop in turn and measure comfort on a held-out pool. A single layer stands out: decoder.dit.preproj.fc1 accounts for a −74 pp swing on its own, while every other layer contributes 7 pp or less. preproj.fc1 is the first projection of the noisy input xtx_t at the entry to the denoising chain. At this layer, the reward-back-prop gradient accumulates over all 80 sampling steps and pulls the weights off the diffusion manifold. Zeroing only the LoRA update of this layer at inference, which takes three lines of code, lowers the comfort-violation rate of Reward-back-prop from 81.4% to 7.4% on the n=500n=500 validation pool. This recovers about 90% of the gap to the base model:

Bar chart of strict-safety and comfort-violation rates

Figure 7. Strict-safety and comfort-violation rates in the final comparison (Phase 4) on n=500n=500 ODD-Kashiwa validation scenes, disjoint from the training scenes, under V3 (§O.1). The comfort layer combines the jerk, lat_acc and speed_change criteria. Rows match the model rows of Table 26; only the last model has strict-safety violations.

for name, module in model.named_modules():
    if isinstance(module, adapterLinear) and ’preproj.fc1’ in name:
        module.shared_scale = 0.0
        module.expert_scale = 0.0

The resulting design rule is to keep the input and output projections of the DiT out of the LoRA target set and to place the rank budget on the block bodies.

Per-layer ablation of the Reward-back-prop LoRA

Figure 8. Per-layer ablation of the Reward-back-prop LoRA. Each of the 16 LoRA-adapted DiT layers is zeroed in turn, and the comfort-violation rate is measured on n=30n=30 held-out scenes.

Bagnnstrict %drv %cmf %Note
rep1 baseline271540.12.137.7human driver
rep1 (ODD-Kashiwa adapter)142750.85.247.7adapter, autonomous
rep2 (ODD-Kashiwa adapter)157550.00.00.0crept 72 m, then stopped

Table 27. V3 scores of ego trajectories recorded on the real vehicle. rep1 baseline: a human driver drives a loop of the ODD-Kashiwa course. rep1 (ODD-Kashiwa adapter): the planner, with the reward-trained shared-plus-expert adapter and the ODD-Kashiwa expert, drives the same course autonomously on the same day. rep2 (ODD-Kashiwa adapter): a second autonomous run on the same day, in which the vehicle crept 72 m and then stopped without recovering.

Collapse of DPO Without the L2 Anchor

Without the imitation anchor, DPO collapses. Setting wimit=0w_{\mathrm{imit}}=0 reduces the hybrid loss to pure DPO. This configuration triggers 100% on every V3 layer in every scenario bucket on n=500n=500. Its median sampled jerk is 3627 m/s3^3, against 0.8 for the base planner, and its mean predicted speed is 46.6 m/s (167 km/h), against 4 m/s for the base planner. The collapse is not an artefact of the jerk computation: it appears under the Savitzky–Golay-filtered jerk of V3 on n=500n=500 and reproduces across the seeds we tried. Any non-zero anchor weight prevents the collapse. With wimit=0.1w_{\mathrm{imit}}=0.1 alone, the comfort-violation rate drops to 53.3%, which is still poor but no longer catastrophic. With wimit≥0.5w_{\mathrm{imit}}\ge0.5, it lies between 0% and 13%, depending on the rest of the configuration.

Greedy Weight Soup over the Sweep Variants

A greedy soup over the 12 variants from the sweep (Phase 2), with the strict-accept criterion of [13], reduces to DPO+L2+SAM alone. No other candidate strictly improves on its 0% comfort-violation rate, so the greedy-soup row (marked degenerate) in Table 26 is identical to DPO+L2+SAM. The metric is saturated at n=500n=500.

Table 26: Final comparison (Phase 4) on n=500n=500 ODD-Kashiwa validation scenes, disjoint from the training scenes, scored with the V3 proxy (§O.1). Each entry is the percentage of the 500 scenes in which at least one criterion of the layer is triggered (any-triggered). strict: hard-constraint layer; drv: careful-and-competent driver layer; cmf: comfort layer.

RankModelstrict %drv %cmf %
1DPO+L2+SAM (this work, headline)0.00100.00.00
1DPO+L2+SAM (block-restricted, LoRA on blocks.0..2 only)0.0099.80.00
1greedy soup (degenerate; →\to sam alone)0.00100.00.00
4Base (no LoRA, Plan-R1 base planner)0.0097.20.80
5DPO+L2 (wimit=0.9w_{\mathrm{imit}}=0.9)0.00100.03.80
6DPO+L2 (βDPO=0.01\beta_{\mathrm{DPO}}=0.01)0.00100.05.00
7DPO+L2+SAM (25 ep, final ckpt; 25 ep ×\times 3000 pairs)0.0099.85.20
8Reward-LoRA (surgical zero, decoder.dit.preproj.fc1)0.0098.27.40
9DPO+L2+SAM (25 ep, best ckpt; early checkpoint)0.0098.810.60
10DPO+L2 (α=64\alpha=64)0.00100.028.80
11Reward-back-prop (joint-replay)0.0099.279.80
12Reward-back-prop (ODD-Kashiwa expert)0.0099.081.40
13Reward-LoRA soup (12-variant Wortsman soup of reward-LoRAs)0.0099.288.00
14DPO only (wimit=0w_{\mathrm{imit}}=0; vanilla DPO, no anchor)100.0100.0100.0

Table 26.

Test Vehicle

The real-vehicle runs in § 6 use a PIX Moving Pixkit 3.0, an electric drive-by-wire chassis with an Autoware-compatible CAN interface (Figure 9). On this vehicle, the base planner has been run with either a reward-trained shared-plus-expert adapter or the production DPO LoRA. The joint-replay weights have not been run on the vehicle.

The test vehicle and its chassis specifications

Figure 9. The test vehicle and its chassis specifications, as listed by the manufacturer.

ModelOriginstrict %cmf %Real vehicle
DPO+L2+SAM (proposed)this work0.000.00simulation only
DPO+L2+SAM (block-restricted)this work0.000.00simulation only
Production DPO (human labels)production, 3 months0.000.40validated (April)
Base (no LoRA)Plan-R1 base planner0.000.80simulation only
Reward-back-propreward-back-prop0.0081.40failed (rep2)
Reward-LoRA (surgical zero, §O.4)this work, training-free0.007.40not tested

Table 28. Comparison with the production DPO LoRA. DPO+L2+SAM (this work) is trained on explicit (chosen, rejected) preference pairs that are assembled automatically from the outputs of reward-back-prop samplers, without human labels. Production DPO (human labels) is the 3-month production DPO LoRA, trained on human-labelled preference pairs and validated on the real vehicle in 2026-04.

Scoring Real-Vehicle Recordings with V3

Comfort in simulation and on the vehicle. On the same course and day, the human driver has a comfort-violation rate of 37.7% and the adapter-controlled run 47.7%. The deployed adapter is therefore 10 pp worse than the human driver it replaces. This matches the comfort regression of reward-back-prop training in simulation and motivated the switch to DPO+L2+SAM. In simulation, the planner’s trajectories score below the human baseline (DPO+L2+SAM 0%, Base (no LoRA) 0.8%), because the output of the diffusion planner is smoother than raw human positions recorded at 10 Hz.

Stalled second run (rep2). Row 3 reads 0.0% because the vehicle never exceeded 0.23 m/s (15755 frames in the cold_start bucket). We therefore add a progress check over the whole recording (vˉ<0.5\bar{v} < 0.5 m/s, ≥95%\ge95\% stationary frames, n≥300n \ge300). This check flags such a run as a deployment failure and complements V3. With the same adapter, on the same course and day, rep1 was reasonable (47.7%, 107 m driven), whereas in rep2 the vehicle crept 72 m and then stopped.

Comparison with the Production DPO LoRA

The proposed configuration matches the production DPO LoRA on hard safety (0%) and is slightly better on comfort (0.00% vs. 0.40%), without human preference labels, because its preference pairs are assembled automatically. Deployment requires a LoRA delta of about 78 K parameters. When a deployed adapter cannot be retrained, the training-free surgical fix v5_surgical (§O.4) can be used instead.

This comparison holds in simulation only. Two reference points from the real vehicle, the production DPO LoRA (0.40% in simulation) and the adapter-controlled rep1 run (47.7% vs. 37.7% for the human driver), place the comfort gap between simulation and vehicle on ODD-Kashiwa within 0–10 pp.

Adversarial Scenarios from AWSIM-Script

In the natural ODD-Kashiwa data, 400/400 sampled neighbor_agents_past tensors contain no active neighbours. We therefore synthesise dangerous interactions from the AWSIM-Script library [34], which provides 42 cut-in, 8 cut-out and 4 deceleration scripts. Each script is parameterised by (Ve,Vo,Vy,dx0)(V_e,V_o,V_y,d x_0): the ego speed, the NPC speed, the lateral speed of the NPC and the initial longitudinal gap. For each ODD-Kashiwa scene, we insert one synthetic NPC into slot 0 of neighbor_agents_past, with a three-second history at constant speed VoV_o and a lane offset of ±3.5\pm3.5 m for cut-in and cut-out, or y=0y=0 for deceleration. We set the ego speed at t=0t=0 to VeV_e and score the planned trajectory against the analytically projected NPC future. The evaluation uses n=200n=200 scenes per scenario and 4 models, for 43,200 inferences in total.

Mean collision percentage over the full AWSIM-Script library

Figure 10. Mean collision % over the full AWSIM-Script library of 54 scenarios (n=200n=200 ODD-Kashiwa scenes per scenario, 43,200 inferences), aggregated by family (cut-in: 42 variants; cut-out: 8; deceleration: 4).

Collision rate heatmap for each scenario and model

Figure 11. Collision % for each scenario of the AWSIM-Script library (54 scripts, n=200n=200 scenes per scenario). Rows are models; columns are the 54 scripts, grouped by family and ego speed (number of scripts in parentheses). Darker cells have higher collision rates.

In the adversarial scenarios, the strict-safety layer (strict_safety) separates the models. On cut-in, aggregated over 42 scripts, Reward-back-prop has a collision rate of 39.8%, compared with 17.0% for the base planner (+22.8 pp). Reward-LoRA (surgical zero) reduces this to 27.4% without retraining, and DPO+L2+SAM stays close to the base planner at 18.5%. On deceleration, the collision rate is uniformly high for all models (48–67%). This reflects a lack of training data, since the ODD-Kashiwa pool contains no emergency-braking examples; §O.11 addresses this.

Time-to-collision heatmap. Figure 12 reports TTCp25TTC_{p25} over a 7×6 (dx0dx_0, VoV_o) grid (dx0∈[5,25]dx_0 \in[5,25] m, Vo∈[10,60]V_o \in[10,60] km/h, Ve=1.5VoV_e=1.5V_o, Vy=1.6V_y=1.6 m/s, n=15n=15 scenes per cell). The heatmap is markedly darker, that is, more dangerous, for Reward-back-prop than for DPO+L2+SAM, with Reward-LoRA (surgical zero) in between.

Time-to-collision heatmaps for four models

Figure 12. Heatmap of TTCp25TTC_{p25} in the cut-in scenarios on a 7 (dx0dx_0, m) × 6 (VoV_o, km/h) grid, with Vy=1.6V_y=1.6 m/s, Ve=1.5VoV_e=1.5V_o and n=15n=15 ODD-Kashiwa scenes per cell. Cell labels report TTC p25 in seconds (5+ means at least 5 s); darker cells are more dangerous.

Limitations. The evaluation modifies one slot of the planner input and projects the NPC future analytically. It skips the perception and behaviour stages of AWSIM-Labs and the AW-Checker. Collisions are detected with a proxy based on a 0.5 m circular footprint. The values in Table 29 should therefore be read as relative comparisons, not as absolute rates.

Table 29: Collision rates in the AWSIM-Script adversarial scenarios, aggregated over the full 54-script library, with n=200n=200 ODD-Kashiwa scenes per scenario. Cut-in aggregates 42 scripts spanning Ve∈[20,50]V_e \in[20,50] km/h, Vo∈[10,40]V_o \in[10,40] km/h, Vy∈[0.6,1.6]V_y \in[0.6,1.6] m/s and dx0∈[5,17]d x_0 \in[5,17] m; cut-out aggregates 8 scripts; deceleration aggregates 4 scripts, in which the NPC brakes at 1 G from Vo∈{20,30,40,50}V_o \in\{20,30,40,50\} km/h. Entries are the mean collision % across the scripts of each family. Table 30 gives the results for the five canonical scripts.

Modelcutin (42)cutout (8)decel (4)
Base (no LoRA)17.00.248.0
Reward-back-prop (reward-LoRA)39.84.567.0
Reward-LoRA (surgical zero) (§O.4)27.40.759.1
DPO+L2+SAM (ours)18.51.053.5

Table 29.

Table 30: Per-script results on the five canonical scripts from the original AW-Runtime-Verification publication, with n=200n=200 ODD-Kashiwa scenes per script, for comparison with the earlier pilot with n=50n=50. The models are those of Table 29.

Modelci30–10–6ci40–20–3ci20–10–1co50–1decel20
Base (no LoRA)35.017.041.00.073.5
Reward-back-prop (reward-LoRA)63.039.065.50.081.5
Reward-LoRA (surgical zero) (§O.4)50.530.054.00.078.5
DPO+L2+SAM (ours)40.017.542.50.082.0

Table 30.

Training with AWSIM-Script Adversarial Pairs

The deceleration failures in Table 29 (every model at 48–67%) reflect a lack of training data. ODD-Kashiwa contains no scenarios in which a leading vehicle stops, so no fine-tuned model has seen reactive braking. We therefore generate adversarial preference pairs from the AWSIM-Script library and add them to the natural-data pool.

The pairs use the same NPC insertion as §O.10. For each AWSIM-Script script, we take 12 ODD-Kashiwa training scenes, insert the NPC, and pair each modified scene with two trajectories. The rejected trajectory is sampled from DPO+L2+SAM itself. The pair is kept only if this sampled trajectory collides or has a TTC below 2 s, which removes scripts on which DPO+L2+SAM is already safe and keeps only the hard cases. The chosen trajectory is constructed analytically. For cut-in, the ego brakes from VeV_e to VoV_o at a comfort-capped 4 m/s2^2. For deceleration, it brakes at the rate required to stop with a 5 m safety gap behind the NPC’s stopping position. For cut-out, it continues at VeV_e, because the NPC moves out of the ego’s path. The filter accepts 162 adversarial pairs out of 648 attempts across the 54 scripts. Together with 1500 natural ODD-Kashiwa pairs, they form a training pool of 1662 pairs (∼\sim10% adversarial).

Training uses the headline configuration of §O.2 (lr =3⋅10−5= 3 \cdot10^{-5}, wimit=0.5w_{\mathrm{imit}}=0.5, weight decay 10−410^{-4}, SAM, constant schedule, 8 epochs). It is initialised from the DPO+L2+SAM checkpoint rather than from the base planner, so that training starts from the existing 0% comfort-violation rate on natural data.

Comfort on natural data. Comfort on natural data is preserved at the end of training. During the eight training epochs, the in-loop comfort-violation rate on n=30n=30 disjoint validation scenes is 23.3% at epoch 2, immediately after the adversarial pool enters the gradient. It falls to 0.0% at epoch 6 and stays at 0.0% through epoch 8, with a median jerk of 1.3 m/s3^3. The final checkpoint, DPO+L2+SAM+Adv, therefore matches DPO+L2+SAM on natural-data comfort (both 0%, Table 26), while its LoRA delta also covers the adversarial pool.

Family (# scripts)DPO+L2+SAM+Adv (162 pairs)+Adv (500 pairs)Δ\Delta (500 vs. base)
cutin (42)18.51%19.57%17.07%−1.44 pp
cutout ( 8)1.00%0.06%0.00%−1.00 pp
decel ( 4)53.50%54.75%51.12%−2.38 pp
peak decel p95 (m/s2^2)1.202.204.04+2.84
# scripts improved vs. base—13/5431/54—
natural-data comfort (n=500)0.00%0.00%0.00%±\pm0.00

Table 31. Training with adversarial pairs from the AWSIM-Script library, for two sizes of the adversarial pool. Evaluation uses n=200n=200 validation scenes per scenario that are disjoint from training (10,800 inferences per model). DPO+L2+SAM+Adv starts from DPO+L2+SAM and adds 162 adversarial pairs to the 1500 natural pairs (∼\sim 10% adversarial). DPO+L2+SAM+Adv (scaled) uses 500 adversarial pairs (∼\sim 25% adversarial). In the last column and in the row of improved scripts, base denotes this starting model, not the base planner.

Effect of the adversarial pool. With 500 adversarial pairs (DPO+L2+SAM+Adv (scaled), ∼\sim 25% of the mixture), 31/54 scripts improve. Cut-in collisions fall to 17.07% from 18.51% for DPO+L2+SAM, cut-out collisions fall to 0%, and the peak ego deceleration rises to 4.04 m/s2^2 (3.4×\times the natural-data baseline). The deceleration family remains at 51.12%, because the chosen trajectory brakes at no more than 4 m/s2^2 for comfort, which is too weak for an NPC braking at 1 G. An ablation that instead generates the chosen trajectory with an IDM lookahead [35] (amax⁡=1.5a_{\max}=1.5 m/s2^2, Thw=1.5T_{\mathrm{hw}}=1.5 s, s0=2s_0=2 m, 483 pairs) performs worse on every family (cut-in 22.02%, peak deceleration 2.87 m/s2^2), which indicates that the generator of chosen trajectories is not the bottleneck.

Effect of training with adversarial pairs

Figure 13. Effect of training with adversarial pairs (n=200n=200 disjoint validation scenes per scenario, 10,800 inferences per model). Left: collision % by family for DPO+L2+SAM, DPO+L2+SAM+Adv (162 pairs) and DPO+L2+SAM+Adv (scaled, 500 pairs). Right: per-scenario difference between DPO+L2+SAM+Adv (scaled) and DPO+L2+SAM for all 54 scripts, sorted by family.

Relation to the Main Text

The V3 study and the adaptation methods of the main text share the base planner (adapter stack with shared rank 4 and expert rank 8, α=32\alpha=32) and the ODD-Kashiwa site, but they address different questions. The main-text methods (§ 4–§ 5.3) optimise an L2 loss on target-region lanelets for transfer to new regions. The V3 study optimises the hybrid DPO+L2 loss on ODD-Kashiwa to close the comfort regression.

Trajectory Diagnostics on the Target-Region Pool

The diagnostics in this section are proxies for comfort and corridor compliance, not closed-loop safety measurements. They are computed in open loop from a single deterministic DPM-Solver++ rollout per scene on the 24-scene pool. Time-to-collision and collision rates are undefined on these scenes, because they contain no neighbouring agents.

Real-world topologies of the three held-out target-region maps

Figure 14. Real-world topologies of the three held-out target-region maps. Every training ODD has paired opposing lanes. This structure is preserved on Knowledge Hub (research campus) and Ishiodai (suburban district) but absent on Morikoro (open park), which is the geometric source of the 31.9 m lateral offset of the static default analysed in § 4.

Held-Out Target-Region Topologies

Regions Where the Nearest Expert Is Not ODD-Nagoya

On the three held-out maps of the main study, the geographically nearest training ODD is ODD-Nagoya, which is also the best fixed expert, so proximity and expert quality cannot be separated there. Table 33 therefore reports two further regions in which the static default selects a different expert. In both regions, the nearest expert is not the best fixed expert. The first region is a suburban bus-route map adjacent to ODD-Kashiwa. We exclude scenes whose start lanelet falls inside the bounding box of the ODD-Kashiwa training map (398 lanelets), which leaves 30 scenes. Here the nearest expert (ODD-Kashiwa) is worse than ODD-Nagoya by 1.37 m (paired Wilcoxon p=0.001p=0.001). The second region is a dense urban area nearest ODD-Hongo (10 scenes). Data from this area were used to train the shared module, because it is the ODD of a fifth expert that is not part of the four-expert adapter stack. This region therefore tests expert selection only, not adaptation to held-out data. Here the nearest expert (ODD-Hongo) is the weakest of the four and is 30.0 m worse than the best fixed expert (ODD-Kashiwa); with 10 scenes, this difference is not significant (p=0.084p=0.084).

RegionnnHongoKashiwaShalunNagoyaShared onlyNearestBest
Suburb near ODD-Kashiwa3019.7012.7015.9011.3315.59KashiwaNagoya
Urban area nearest ODD-Hongo†1038.628.6113.978.6514.60HongoKashiwa

Table 33. Mean maximum lateral offset (m) of each fixed expert in two regions where the static default does not select ODD-Nagoya. Bold: best fixed expert. The static default selects the nearest expert. †Data from this area were used to train the shared module.

References

  1. [1]A. Z. Ren, J. Lidard, L. L. Ankile, A. Simeonov, P. Agrawal, A. Majumdar, B. Burchfiel, H. Dai, and M. Simchowitz. Diffusion Policy Policy Optimization. In The Thirteenth International Conference on Learning Representations, 4 Oct. 2024. URL https://openreview.net/forum?id=mEpqHvbD2h.arxiv.org/abs/2409.00588
  2. [2]Y. Zheng, R. Liang, K. Zheng, J. Zheng, L. Mao, J. Li, W. Gu, R. Ai, S. E. Li, X. Zhan, and J. Liu. Diffusion-Based Planning for Autonomous Driving with Flexible Guidance. In The Thirteenth International Conference on Learning Representations, 4 Oct. 2024. URL https://openreview.net/forum?id=wM2sfVgMDH.arxiv.org/abs/2501.15564
  3. [3]The Autoware Foundation. Autoware: Introducing Open-Source End-to-End Autonomous Driving. Technical report, The Autoware Foundation, 2025. Technical Report. Available at https://autoware.org/wp-content/uploads/2025/10/Autoware-E2E-Report_Release.pdf.
  4. [4]J. Lekefouack, A. N. Angelopoulos, A. Bajcsy, M. I. Jordan, and J. Malik. Conformal decision theory: Safe autonomous decisions from imperfect predictions. In 2024 IEEE International Conference on Robotics and Automation (ICRA), volume 34, pages 11668–11675. IEEE, 13 May 2024. doi:10.1109/icra57147.2024.10610041. URL http://dx.doi.org/10.1109/ICRA57147.2024.10610041.
  5. [5]L. Lindemann, X. Qin, J. V. Deshmukh, and G. J. Pappas. Conformal Prediction for STL Runtime Verification. In Proceedings of the ACM/IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2023), pages 142–153, New York, NY, USA, 9 May 2023. ACM. doi:10.1145/3576841.3585927. URL http://dx.doi.org/10.1145/3576841.3585927.
  6. [6]W. Ryu, S. Yu, S. Moon, H. Choi, J. Park, J. Kim, and H. Shim. SUPER-AD: Semantic uncertainty-aware planning for End-to-End robust autonomous driving. arXiv [cs.RO], 28 Nov. 2025. doi:10.48550/arXiv.2511.22865. URL http://arxiv.org/abs/2511.22865.
  7. [7]Y. Xu, W. Guo, and Z. Wei. Selective Conformal Risk Control. arXiv [cs.LG], 14 Dec. 2025. doi:10.48550/arXiv.2512.12844. URL http://arxiv.org/abs/2512.12844.
  8. [8]R. Zhu, P. Huang, E. Ohn-Bar, and V. Saligrama. Learning to Drive Anywhere. In 7th Annual Conference on Robot Learning, 30 Aug. 2023. URL https://openreview.net/forum?id=6a4sECAMCA.arxiv.org/abs/2309.12295
  9. [9]T.-H. Wang, A. Maalouf, W. Xiao, Y. Ban, A. Amini, G. Rosman, S. Karaman, and D. Rus. Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Models. In First Workshop on Out-of-Distribution Generalization in Robotics at CoRL 2023, 5 Nov. 2023. URL https://openreview.net/forum?id=ZmB2AC3ZCa.arxiv.org/abs/2310.17642
  10. [10]A. Tong, A. Sharma, S. Veer, M. Pavone, and H. Yang. Online aggregation of trajectory predictors. In 2025 IEEE International Conference on Robotics and Automation (ICRA), pages 3437–3444. IEEE, 19 May 2025. doi:10.1109/icra55743.2025.11127597. URL http://dx.doi.org/10.1109/ICRA55743.2025.11127597.
  11. [11]M. Reuss, J. Pari, P. Agrawal, and R. Lioutikov. Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning. In The Thirteenth International Conference on Learning Representations, 4 Oct. 2024. URL https://openreview.net/forum?id=nDmwloEl3N.arxiv.org/abs/2412.12953
  12. [12]R. Qorbani, G. Villani, T. Panagiotakopoulos, M. B. Colomer, L. Härenstam-Nielsen, M. Segu, P. L. Dovesi, J. Karlgren, D. Cremers, F. Tombari, and M. Poggi. Semantic Library Adaptation: LoRA Retrieval and Fusion for Open-Vocabulary Semantic Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9804–9815, 2025. URL https://openaccess.thecvf.com/content/CVPR2025/html/Qorbani_Semantic_Library_Adaptation_LoRA_Retrieval_and_Fusion_for_Open-Vocabulary_Semantic_CVPR_2025_paper.html.arxiv.org/abs/2503.21780
  13. [13]M. Wortsman, G. Ilharco, S. Y. Gadre, R. Roelofs, R. Gontijo-Lopes, A. S. Marcos, H. Namkoong, A. Farhadi, Y. Carmon, S. Kornblith, and L. Schmidt. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. In Proceedings of the 39th International Conference on Machine Learning, 10 Mar. 2022. doi: 10.48550/arXiv.2203.05482. URL http://dx.doi.org/10.48550/arXiv.2203.05482.
  14. [14]P. Yadav, D. Tam, L. Choshen, C. Raffel, and M. Bansal. TIES-Merging: Resolving Interference When Merging Models. In Thirty-seventh Conference on Neural Information Processing Systems, 2 Nov. 2023. URL https://openreview.net/forum?id=xtaX3WyCj1.arxiv.org/abs/2306.01708
  15. [15]R. Caruana. Multitask learning. Mach. Learn., 28(1):41–75, July 1997. doi:10.1023/a:1007379606734. URL http://dx.doi.org/10.1023/A:1007379606734.
  16. [16]Y. Bengio, A. Courville, and P. Vincent. Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell., 35(8):1798–1828, Aug. 2013. doi: 10.1109/TPAMI.2013.50. URL http://dx.doi.org/10.1109/TPAMI.2013.50.
  17. [17]Y. Yao, S. Yan, D. Goehring, W. Burgard, and J. Reichardt. Improving out-of-distribution generalization of trajectory prediction for autonomous driving via polynomial representations. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 488–495. IEEE, 14 Oct. 2024. doi:10.1109/iros58592.2024.10801535. URL http://dx.doi.org/10.1109/IROS58592.2024.10801535.
  18. [18]Y. Li, S. Z. Zhao, C. Xu, C. Tang, C. Li, M. Ding, M. Tomizuka, and W. Zhan. Pre-training on synthetic driving data for trajectory prediction. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 5910–5917. IEEE, 14 Oct. 2024. doi:10.1109/iros58592.2024.10802492. URL http://dx.doi.org/10.1109/IROS58592.2024.10802492.
  19. [19]X. Yang, L. Wen, T. Wei, Y. Ma, J. Mei, X. Li, W. Lei, D. Fu, P. Cai, M. Dou, L. He, Y. Liu, B. Shi, and Y. Qiao. DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 26933–26943, 2025. URL https://openaccess.thecvf.com/content/ICCV2025/html/Yang_DriveArena_A_Closed-loop_Generative_Simulation_Platform_for_Autonomous_Driving_ICCV_2025_paper.html.arxiv.org/abs/2408.00415
  20. [20]X. Ren, Y. Lu, T. Cao, R. Gao, S. Huang, A. Sabour, T. Shen, T. Pfaff, J. Z. Wu, R. Chen, S. W. Kim, J. Gao, L. Leal-Taixé, M. Chen, S. Fidler, and H. Ling. Cosmos-drive-dreams: Scalable synthetic driving data generation with world foundation models. arXiv [cs.CV], 10 June 2025. doi:10.48550/arXiv.2506.09042. URL http://arxiv.org/abs/2506.09042.
  21. [21]A. Robins. Catastrophic forgetting, rehearsal and pseudorehearsal. Connection Science, 7(2):123–146, 1995.DOI
  22. [22]D. Rolnick, A. Ahuja, J. Schwarz, T. P. Lillicrap, and G. Wayne. Experience replay for continual learning. In Advances in Neural Information Processing Systems, volume 32, 2019.
  23. [23]D. Wang, E. Shelhamer, S. Liu, B. Olshausen, and T. Darrell. Tent: Fully Test-Time Adaptation by Entropy Minimization. In International Conference on Learning Representations, 2 Oct. 2020. URL https://openreview.net/forum?id=uXl3bZLkr3c.arxiv.org/abs/2006.10726
  24. [24]S. Niu, J. Wu, Y. Zhang, Z. Wen, Y. Chen, P. Zhao, and M. Tan. Towards Stable Test-time Adaptation in Dynamic Wild World. In The Eleventh International Conference on Learning Representations, 29 Sept. 2022. URL https://openreview.net/forum?id=g2YraF75Tj.arxiv.org/abs/2302.12400
  25. [25]E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen. LoRA: Low-rank adaptation of large language models. In International Conference on Learning Representations, 2022.arxiv.org/abs/2106.09685
  26. [26]S.-W. Lee, X. Kang, and Y.-L. Kuo. Diff-dagger: Uncertainty estimation with diffusion policy for robotic manipulation. In 2025 IEEE International Conference on Robotics and Automation (ICRA), pages 4845–4852. IEEE, 19 May 2025. doi:10.1109/icra55743.2025.11127730. URL http://dx.doi.org/10.1109/ICRA55743.2025.11127730.
  27. [27]A. Kraskov, H. Stögbauer, and P. Grassberger. Estimating mutual information. Physical Review E, 69(6):066138, 2004.pubmed.ncbi.nlm.nih.gov/15244698
  28. [28]X. Li, Y. Grandvalet, and F. Davoine. Explicit inductive bias for transfer learning with convolutional networks. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 2825–2834, 2018.arxiv.org/abs/1802.01483
  29. [29]J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabskа-Barwinska, D. Hassabis, C. Clopath, D. Kumaran, and R. Hadsell. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, 114(13):3521–3526, 2017.
  30. [30]D. Park, J. Jeong, S.-H. Yoon, J. Jeong, and K.-J. Yoon. T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15065–15076, 2024. URL https://openaccess.thecvf.com/content/CVPR2024/html/Park_T4P_Test-Time_Training_of_Trajectory_Prediction_via_Masked_Autoencoder_and_CVPR_2024_paper.html.arxiv.org/abs/2403.10052
  31. [31]J. Frankle, G. K. Dziugaite, D. Roy, and M. Carbin. Linear Mode Connectivity and the Lottery Ticket Hypothesis. In International Conference on Machine Learning, pages 3259–3269. PMLR, 21 Nov. 2020. URL https://proceedings.mlr.press/v119/frankle20a.html.arxiv.org/abs/1912.05671
  32. [32]R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. In Thirty-seventh Conference on Neural Information Processing Systems, 2 Nov. 2023. URL https://openreview.net/pdf?id=HPuSIXJaa9.arxiv.org/abs/2305.18290
  33. [33]P. Foret, A. Kleiner, H. Mobahi, and B. Neyshabur. Sharpness-aware Minimization for Efficiently Improving Generalization. In International Conference on Learning Representations, 2 Oct. 2020. URL https://openreview.net/forum?id=6Tm1mposlrM.arxiv.org/abs/2010.01412
  34. [34]D. D. Tran, T. Tomita, and T. Aoki. Safety analysis of autonomous driving systems: A simulation-based runtime verification approach. IEEE Trans. Reliab., 74(4):4574–4588, Dec. 2025. ISSN 0018-9529,1558-1721. doi:10.1109/tr.2025.3561455. URL http://dx.doi.org/10.1109/tr.2025.3561455.
  35. [35]M. Treiber, A. Hennecke, and D. Helbing. Congested traffic states in empirical observations and microscopic simulations. Phys. Rev. E Stat. Phys. Plasmas Fluids Relat. Interdiscip. Topics, 62(2 Pt A):1805–1824, 1 Aug. 2000. ISSN 1063-651X,1095-3787. doi:10.1103/physreve.62.1805. URL http://dx.doi.org/10.1103/PhysRevE.62.1805.

Paper details

vlnc:W_g3cgfhws
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 9

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

Not recorded for this paper · View statement →

Looking for related papers…
Contents