betaFeedback

WorksComputer Science

Online Reinforcement Learning in the Met Office Unified Model through Distributed Model-Agent Coupling

Abstract

Machine-learnt corrections can complement numerical weather prediction provided that they operate stably within an evolving numerical model. In this study, we couple the Met Office (UKMO) Unified Model (UM) with distributed reinforcement-learning agents through rank-local tensors. A column-aware deep deterministic policy gradient (DDPG) actor uses local vertical structure together with full-column context to apply bounded corrections to potential temperature and horizontal wind. During training, we perform ten nudged 6-hr 12-min forecasts, with nudging towards the UKMO operational analysis providing an immediate counterfactual target from which the policy learns. The resulting actor is then frozen and applied to a non-nudged forecast without access to analysis inputs or further weight updates. Relative to a matched non-nudged native forecast at +6 h, the corrected forecast reduces global latitude-weighted MAE by 2.85% for Z500Z_{500}, 2.16% for MSLP, 5.16% for T500T_{500} and 2.27% for T1.5mT_{1.5\textrm{m}}, with an observed 3.57% wall-time overhead compared to native execution. Even though training and inference share the same initialisation, this single-case experiment demonstrates significant promise and feasibility, laying the groundwork for RL-based bias correction and parametrisations within operational systems.

Paper details

vlnc:W_q6h5zqjh
Version
v2 · latest
Published
Added
License
CC-BY-NC-SA-4.0
Usage

views · 6

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Codex, GPT-5.6 Sol (bare), GPT-6-astra

View statement
Looking for related papers…