betaFeedback

WorksMathematics

A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization

Abstract

We propose a new reinforcement learning (RL) framework for the continuous-time mean-variance portfolio optimization with unknown market parameters. To better reflect the impact of improved information of the unknown drift on the degree of exploration, we consider a novel randomization based on continuous-time stochastic filtering. Specifically, we construct a continuous-time analog to Thompson Sampling by treating the unknown drift as a random draw from a generalized sampling distribution parameterized by the filter's posterior mean and variance. The new learning objective measures the tradeoff between the wealth performance and the weighted KL divergence between the policy and the true Bayesian posterior, which transforms the classical feedback control into an information guided stochastic policy. As a result, the degree of exploration endogenously depends on the Reward-Biased Maximum Likelihood Estimation that decays with the shrinking filter's variance. This allows us to devise an efficient model-based learning algorithm in the mean-variance portfolio optimization with theoretical guarantee and superior learning performance.

Introduction

Mean–variance portfolio selection provides an intuitive way to balance the expected terminal wealth against risk, which has been widely used in practice since the seminal work of Markowitz [34] and its dynamic extensions in Li and Ng [33] for multi-period model and in Zhou and Li [51] for the continuous-time model. The endogenous linear-quadratic structure brings the favorable tractability in the dynamic control problem, however, relying crucially on the precise information of model parameters. In practice, the asset drift is unobservable and particularly difficult to estimate using the history data [35], leaving possibly large errors in implementing the theoretical optimal solution using the inaccurate drift [4]. A common response in the literature is to adopt the identify-then-optimize procedure used in adaptive control [5, 31, 18]. Once the resulting estimates are treated as the true parameters, the remaining parameter uncertainty is hidden. Consequently, when the estimated model is substituted directly into the complete-information feedback policy, estimation errors might be further amplified [4, 30].

These limitations motivate the development of reinforcement learning (RL) approach that allows the agent to learn the optimal decision via the trial-and-error interactions with unknown environment. For continuous-time diffusion models, Wang et al. (2020) propose the exploratory formulation of stochastic policies via the entropy regularization. Within this framework, Wang and Zhou [45] study the precommitted mean–variance problem and show that the optimal stochastic policy is Gaussian, which leads to a structured and implementable learning method. Along this direction, there is a fast growth in the development of entropy regularized reinforcement learning for continuous-time stochastic control problems and financial applications, see among Jia and Zhou [26], Jia and Zhou [27], Guo et al. [22], Jia and Zhou [28], Dai et al. [11], Szpruch et al. [43], Wu and Li [49], Gierich et al. (2024), Wei et al. [48], Bo et al. (2025), Wei and Yu [47], Dai et al. [12], Frikha et al. [19], Jia et al. [29], Huang et al. [23], Gao et al. [20], Bo et al. (2026), Huang et al. [24], and references therein.

In all aforementioned studies, although the entropy regularization provides a tractable way for the policy randomization, its induced exogenous noise in the randomized policy cannot reflect the agent’s improving uncertainty on unknown model parameters along the learning. Intuitively, when the agent continues to learn, he would gain more information of the unknown environment and employ less randomness for the purpose of exploration. In addition, how to choose the temperature parameter in the standard entropy regularization to balance the tradeoff between exploration and exploitation in RL algorithms is still an open problem. On the other hand, Bayesian filtering quantifies that reduced unknownness through a posterior updated from observed prices, providing a statistical basis for calibrating exploration. The use of posterior beliefs to inform investment decisions is well established in portfolio optimization with partial information [14, 50]. Lakner [32] derives optimal investment and consumption decisions when only prices are observed, while Sass and Haussmann [41] use a filter for a hidden Markov-chain drift to characterize the terminal-wealth optimizer. Bismuth et al. [6] extend Bayesian learning to portfolio-choice, liquidation, and transition problems with unknown expected returns. In these models, the filter carries information of both the estimated parameter and its remaining uncertainty along the investment horizon. The economic relevance of retaining that uncertainty is illustrated by Rogers [39], which reveals that the welfare cost can exceed the cost of infrequent portfolio review.

Some recent studies simply combine this approach with the standard entropy-regularization in continuous-time RL. In a regime-switching market, Wu and Li [49] incorporate the filtered regime belief into an actor–critic algorithm in the classical exploratory formulation. For an unknown constant drift, Au [1] combines Bayesian filtering with action-space entropy regularization and shows that the mean allocation remains the deterministic Bayesian feedback, while entropy changes the allocation variance. In these formulations, the randomness in the stochastic policy still comes exogenously from the entropy regularization. The filtered belief can affect the optimal allocation variance, but a positive entropy weight can sustain the randomization in the stochastic policy even when parameter uncertainty vanishes, as illustrated by the known-drift limit in Au [1]. For a small investor whose trades do not affect market prices, randomized policy does not change the return observations available to the filter and therefore does not provide additional information to improve the knowledge of the unknown drift. Such randomization can generate different wealth outcomes for policy evaluation, but it also incurs the cost of trying unnecessary suboptimal policies [43].

This work aims to provide a new perspective to address the issue of over-randomization in standard entropy regularization as well as a proper choice of temperature parameter during the learning procedure when the agent gets more information on the unknown parameters by filtering. We contribute a novel continuous-time RL formulation that uses the posterior to guide the exploration search over candidate Sharpe ratios based on the classical mean–variance feedback form. At each time, the agent selects a sampling density qtq_t, and each sampled ratio generates a portfolio allocation through that feedback rule. The Bayesian filter supplies the current Gaussian posterior ptp_t as a reference distribution. A Kullback–Leibler (KL) penalty on deviations of the sampling density from the posterior connects the parameter search to the information accumulated from returns. As the posterior variance decreases, it provides a shrinking effect for exploration. This construction is related to posterior sampling in Bayesian RL [42], with the sampling law also allowed to respond to investment performance. Following the principle of reward-biased maximum likelihood estimation [36], reward feedback can shift probability toward candidate parameters whose allocations yield better outcomes.

Our new formulation is built on the balance between the weighted posterior-relative KL penalty and the current policy value. This value scaling yields a multiplicative effect and preserves the quadratic structure inherited from the mean–variance objective, facilitating the explicit characterization of the optimal stochastic policy. For the algorithm aspect, the randomized allocations generate wealth outcomes for evaluating and improving portfolio policies. The Bayesian posterior continues to be updated from exogenous market returns independently of the investor’s position, so randomization does not accelerate posterior contraction. In deriving the exploratory dynamics, we retain the common return innovation shared by wealth and the posterior mean. Figure 1 summarizes the flow chart of how the posterior, parameter search, portfolio allocation, and reward feedback are implemented.

Posterior-guided reward-biased exploration

Figure 1. Posterior-guided reward-biased exploration.

The main contributions of the present paper are summarized as follows:

  • First, we formulate a posterior-guided and reward-biased exploratory control framework, new to the literature, to learn the optimal policy in the context of mean-variance portfolio optimization. Its main novelty is a multiplicative criterion in which the posterior-relative KL divergence is weighted by both the exploration coefficient and the current policy value. This value scaling preserves the quadratic homogeneity inherited from the mean–variance objective.

  • Second, we solve this exploratory control problem analytically. Notably, one state variable is an evolving probability density and the associated equation is nonlinear. However, by strategically choosing the temperature parameter in a proper form, we can still exploit the mean–variance structure and Gaussian posterior to reduce the optimizer to a unique Gaussian law and derive closed-form expressions for the value function and the stochastic policy, including the exceptional case in which the general solution is not directly applicable. The solution explicitly separates the role of posterior uncertainty in controlling the exploration scale from that of reward feedback, and shows that the degree of exploration declines automatically as the filtering information accumulates.

  • Third, we turn the analytical result into an implementable learning method and establish some learning performance guarantees. To overcome the unknown oracle term in the closed-form policy and the instability caused by vanishing exploration variance, we develop a structure-preserving episodic actor–critic algorithm with specially normalized and centered martingale updates. We rigorously prove convergence of the filter, actor, sampling policy as well as Lagrange multiplier without requiring the critic proxy itself to identify the true Sharpe ratio. We further show that first-order policy errors cancel at the limiting optimum, leading to a nearly inverse-linear last-iterate performance rate in the stationary market.

  • Fourth, to illustrate the learning performance of the proposed algorithm, we conduct both simulation experiments and empirical study by comparing benchmarks from the rolling maximum likelihood and entropy-regularized Bayesian-filtering. The results complement the theoretical findings and showcase the improved risk-adjusted performance and greater stability of learning.

The remainder of the paper is organized as follows. Section 2 introduces the classical benchmark, the Bayesian filter, and the exploratory state dynamics. Section 3 formulates the posterior-guided KL objective and derives the explicit characterization of optimal Gaussian stochastic policy. Section 4 presents the actor–critic model-based RL algorithm and establishes its convergence analysis. Sections 5 and 6 report the simulation experiments and empirical studies of the RL algorithm, respectively. The concluding section summarizes the findings, and the Appendix collects the proofs and auxiliary results.

Bayesian Oriented Exploratory Formulation

In this section, we first identify the dependence of the mean-variance feedback control on the market Sharpe ratio, and then introduce a filtering state and derive exploratory dynamics that preserve the common return innovation between wealth and beliefs.

Classical Benchmark

Let T>0T > 0 be the finite horizon, and let {Wt,0≤t≤T}\{W_t, 0 \le t \le T\} be a standard one-dimensional Brownian motion defined on a filtered probability space (Ω,F,{Ft}0≤t≤T,P)(\Omega,\mathcal{F},\{\mathcal{F}_t\}_{0 \le t \le T},\mathbb{P}) that satisfies the usual conditions. The price process of the risky asset is a geometric Brownian motion governed by

dSt=St(μdt+σdWt),0≤t≤T,(1)\mathrm{d}S_t = S_t \left(\mu\mathrm{d}t + \sigma\mathrm{d}W_t\right), \qquad0 \le t \le T, \tag*{(1)}

with S0=s0>0S_0 = s_0 > 0 being the initial price, and μ∈R\mu\in\mathbb{R}, σ>0\sigma> 0 being the mean and volatility parameters, respectively. The riskless asset has a constant interest rate r>0r > 0. The Sharpe ratio of the risky asset is defined by

ρ=μ−rσ.(2)\rho= \frac{\mu-r}{\sigma}. \tag*{(2)}

Denote by {Xtu,0≤t≤T}\{X_t^u, 0 \le t \le T\} the discounted wealth process under the portfolio strategy u={ut,0≤t≤T}u=\{u_t, 0 \le t \le T\}. Here, utu_t is the discounted dollar value allocated in the risky asset at time tt, which satisfies the standard self-financing assumption and admissibility conditions that will be given later. It follows from (1) that the discounted wealth process satisfies

dXtu=σut(ρdt+dWt),0≤t≤T,(3)dX_t^u=\sigma u_t(\rho dt+dW_t),\qquad0\le t\le T, \tag*{(3)}

with initial wealth X0u=x0∈RX_0^u=x_0\in\mathbb{R}.

When the parameter θ∗:=(μ∗,σ∗)\theta^*:=(\mu^*,\sigma^*) is known, the classical continuous-time Mean-Variance (MV) model aims to solve the optimization problem [45]:

Vcl(s,y;w):=min⁡u∈Acl(s,y)E[(XTu−w)2∣Xsu=y]−(w−z)2,(4)V^{\mathrm{cl}}(s,y;w):=\min_{u\in\mathcal{A}^{\mathrm{cl}}(s,y)}\mathbb{E}\left[(X_T^u-w)^2\mid X_s^u=y\right]-(w-z)^2, \tag*{(4)}

for (s,y)∈[0,T)×R(s,y)\in[0,T)\times\mathbb{R}, where w∈Rw\in\mathbb{R} is a fixed Lagrange multiplier. Once this problem is solved, ww can be determined by the constraint E[XT∗]=z\mathbb{E}[X_T^*]=z, with {Xt∗}t∈[0,T]\{X_t^*\}_{t\in[0,T]} being the optimal wealth process under optimal portfolio u∗u^*.

In this case, it is well known that the optimal control u∗u^* of (4) is given in a feedback form by

u∗=ψ(t,Xt∗,w;θ∗)=−ρ∗σ∗(Xt∗−w),(5)u^*=\psi(t,X_t^*,w;\theta^*)=-\frac{\rho^*}{\sigma^*}(X_t^*-w), \tag*{(5)}

and the resulting optimal wealth process is the unique strong solution to the SDE

dXt∗=−(ρ∗)2(Xt∗−w)dt−ρ∗(Xt∗−w)dWt,X0∗=x0.(6)dX_t^*=-(\rho^*)^2(X_t^*-w)dt-\rho^*(X_t^*-w)dW_t,\qquad X_0^*=x_0. \tag*{(6)}

If the parameter θ∗\theta^* is unknown to the agent, the agent searches for the optimal control to solve the MV model while learning the system, i.e., the parameter θ∗\theta^*. However, if the agent is a small investor, the current portfolio selection problem has a distinct feature: the instantaneous returns of the risky and risk-free assets can be observed directly from the market, therefore, the information used for learning is unaffected by the portfolio strategies the agent applies. That said, the agent is always able to use an estimate θ^\hat{\theta} (by observing market’s time evolution) to solve the optimization problem while disregarding the modeling error, and use the resulting controller ψ(θ)\psi(\theta) on the true system with θ∗\theta^*. That is, at time t>0t>0, by observing {Ss}s∈[0,t]\{S_s\}_{s\in[0,t]}, a maximum likelihood estimator (MLE) can be derived from maximizing log-likelihood: θ^t\hat{\theta}_t. Then, a feedback control ψ(⋅;w,θ^t)\psi(\cdot;w,\hat{\theta}_t) is exercised, and the state process evolves according to the dynamics (3) controlled by policy ψ(⋅;w,θ^t)\psi(\cdot;w,\hat{\theta}_t):

dXt=σ∗ψ(t,Xt;w,θ^t)(ρ∗dt+dWt),0≤t≤T,(7)dX_t=\sigma^*\psi(t,X_t;w,\hat{\theta}_t)(\rho^*dt+dW_t),\qquad0\le t\le T, \tag*{(7)}

The agent then inherits the sampling error of θ^t\hat{\theta}_t. Because these parameters are estimated from random samples, they are themselves random and introduce modeling errors that may propagate into undesirable behaviors over long time horizons. To address this, the next subsection retains the estimation uncertainty as an explicit state variable rather than treating the estimate as exact.

Filtering and Exploratory Dynamics

When σ∗\sigma^* is known, the stochastic filtering theory characterizes the conditional distribution process {ρt:t≥0}\{\rho_t:t\ge0\} of ρ∗\rho^* given StS_t, where StS_t is the (completed) σ\sigma-algebra generated by the observation (stock price process {Ss}s∈[0,t]\{S_s\}_{s\in[0,t]}) up to time tt. We recall that in this setting, the conditional distribution ρt\rho_t of ρ∗\rho^* given StS_t is a normal distribution, and hence completely characterized by its mean mt=E[ρ∗∣St]m_t=\mathbb{E}[\rho^*|S_t] and the variance Rt=E[(ρ∗−mt)2∣St]R_t=\mathbb{E}[(\rho^*-m_t)^2|S_t], which satisfy the following equation

dmt=Rtσ∗(dStSt−ρdt−σ∗mtdt)=Rt((ρ∗−mt)dt+dWt),(8)dm_t=\frac{R_t}{\sigma^*}\left(\frac{dS_t}{S_t}-\rho dt-\sigma^*m_tdt\right)=R_t((\rho^*-m_t)dt+dW_t), \tag*{(8)}
dRt=−Rt2dt,(9)dR_t=-R_t^2dt, \tag*{(9)}

with the prior distribution of ρ∗\rho^* given by N(m0,R0)\mathcal{N}(m_0,R_0) at time 0. It follows that posterior variance RtR_t is deterministic and has closed-form: Rt=R0/(1+R0t)R_t=R_0/(1+R_0t), which means the uncertainty decays at rate O(1/t)O(1/t) regardless of the observations or policy. In addition, mtm_t is a St\mathcal{S}_t-martingale, converges to ρ∗\rho^* a.s. When σ∗\sigma^* is unknown, we estimate it from observed returns and substitute the estimate into the filtering equations, obtaining a plug-in filtering state (mt,Rt)(m_t, R_t). Although this procedure provides an estimate of the unknown Sharpe ratio, uncertainty about that parameter remains and carries over to the portfolio allocation determined by the classical feedback rule. We therefore use the filtering state to guide a stochastic portfolio policy, denoted by πt\pi_t, retaining parameter uncertainty in the policy construction rather than relying solely on a point estimate.

Recall that the classical optimal feedback control, u∗=ψ(⋅;θ)u^* = \psi(\cdot;\theta) as given by (5), is explicitly determined by the true parameter. To construct the exploratory policy, we treat ρ\rho as a random variable drawn from a sampling distribution qt(ρ∣mt,Rt)q_t(\rho\mid m_t, R_t). This mapping naturally transforms the classical feedback control into a stochastic continuous-time policy πt(u∣mt,Rt)\pi_t(u \mid m_t, R_t). Crucially, qtq_t need not be the exact Bayesian posterior ptp_t. While this approach serves as a continuous-time analog of Thompson Sampling [40], relaxing the strict Bayesian assumption leaves mathematical room to integrate robust, generalized learning frameworks, such as the Reward-Biased Maximum Likelihood Estimation (RBMLE) approach which will be introduced in § 3.

References

  1. [1]A. Au. Entropy regularization under Bayesian drift uncertainty. arXiv preprint arXiv:2602.16862, 2026.
  2. [2]D. Banholzer, J. Fliege, and R. Werner. On rates of convergence for sample average approximations in the almost sure sense and in mean. Mathematical Programming, 191(1):307–345, 2022. 10.1007/s10107-019-01400-4.
  3. [3]O. E. Barndorff-Nielsen and N. Shephard. Econometric analysis of realized volatility and its use in estimating stochastic volatility models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64(2):253–280, 2002. 10.1111/1467-9868.00336.
  4. [4]M. J. Best and R. R. Grauer. On the sensitivity of mean-variance-efficient portfolios to changes in asset means: some analytical and computational results. The Review of Financial Studies, 4(2):315–342, 1991.DOI
  5. [5]T. R. Bielecki, T. Chen, I. Cialenco, A. Cousin, and M. Jeanblanc. Adaptive robust control under model uncertainty. SIAM Journal on Control and Optimization, 57(2):925–946, 2019.arxiv.org/abs/1706.02227
  6. [6]A. Bismuth, O. Guéant, and J. Pu. Portfolio choice, portfolio liquidation, and portfolio transition under drift uncertainty. Mathematics and Financial Economics, 13(4):661–719, 2019.arxiv.org/abs/1611.07843
  7. [9]P. Briand, B. Delyon, Y. Hu, E. Pardoux, and L. Stoica. Lᵖ solutions of backward stochastic differential equations. Stochastic Processes and their Applications, 108(1):109–129, 2003.DOI
  8. [10]J. Y. Campbell, A. W. Lo, and A. C. MacKinlay. The Econometrics of Financial Markets. Princeton University Press, Princeton, NJ, 1997.
  9. [11]M. Dai, Y. Dong, and Y. Jia. Learning equilibrium mean-variance strategy. Mathematical Finance, 33(4):1166–1212, 2023.
  10. [12]M. Dai, Y. Dong, Y. Jia, and X. Y. Zhou. Data-driven merton’s strategies via policy randomization, 2025. arXiv: 2312.11797.arxiv.org/abs/2312.11797
  11. [13]M. Dai, Y. Dong, Y. Jia, and X. Y. Zhou. Merton’s problem with recursive perturbed utility. arXiv preprint arXiv:2602.13544, 2026.arxiv.org/abs/2602.13544
  12. [14]C. De Franco, J. Nicolle, and H. Pham. Bayesian learning for the Markowitz portfolio selection problem. International Journal of Theoretical and Applied Finance, 22(07):1950037, 2019.arxiv.org/abs/1811.06893
  13. [16]M. D. Donsker and S. R. S. Varadhan. Asymptotic evaluation of certain Markov process expectations for large time, I. Communications on Pure and Applied Mathematics, 28(1):1–47, 1975. 10.1002/cpa.3160280102.DOI
  14. [17]N. El Karoui, D. H. Nguyen, and M. Jeanblanc-Picqué. Compactification methods in the control of degenerate diffusions: Existence of an optimal control. Stochastics, 20(3):169–219, 1987. 10.1080/17442508708833443.DOI
  15. [18]M. K. S. Faradonbeh, A. Tewari, and G. Michailidis. On adaptive linear–quadratic regulators. Automatica, 117:108982, 2020.arxiv.org/abs/1806.10749
  16. [19]N. Frikha, M. Germain, M. Laurière, H. Pham, and X. Song. Actor-critic learning for mean-field control in continuous time. Journal of Machine Learning Research, 26:1–42, 2025.
  17. [20]X. Gao, L. Li, and X. Y. Zhou. Reinforcement learning for jump-diffusions, with financial applications. Mathematical Finance, forthcoming, 2026.arxiv.org/abs/2405.16449
  18. [22]X. Guo, R. Xu, and T. Zariphopoulou. Entropy regularization for mean field games with learning. Mathematics of Operations Research, 47(4):3239–3260, 2022.
  19. [23]Y. Huang, Y. Jia, and X. Y. Zhou. Mean–variance portfolio selection by continuous-time reinforcement learning: Algorithms, regret analysis, and empirical study. arXiv preprint arXiv:2412.16175v3, 2026a.arxiv.org/abs/2412.16175
  20. [24]Y.-J. Huang, X. Yu, and K. Zhang. Policy iteration achieves regularized equilibrium under time inconsistency. Preprint, arXiv:2603.06145, 2026b.arxiv.org/abs/2603.06145
  21. [25]J. M. Hutchinson, A. W. Lo, and T. Poggio. A nonparametric approach to pricing and hedging derivative securities via learning networks. The Journal of Finance, 49(3):851–889, 1994.
  22. [26]Y. Jia and X. Y. Zhou. Policy gradient and actor-critic learning in continuous time and space: Theory and algorithms. Journal of Machine Learning Research, 23(275):1–50, 2022a.arxiv.org/abs/2111.11232
  23. [27]Y. Jia and X. Y. Zhou. Policy evaluation and temporal-difference learning in continuous time and space: A martingale approach. Journal of Machine Learning Research, 23(154):1–55, 2022b.arxiv.org/abs/2108.06655
  24. [28]Y. Jia and X. Y. Zhou. q-learning in continuous-time. Journal of Machine Learning Research, 24(161):1–61, 2023.arxiv.org/abs/2207.00713
  25. [29]Y. Jia, D. Ouyang, and Y. Zhang. Accuracy of discretely sampled stochastic policies in continuous-time reinforcement learning. SIAM Journal on Control and Optimization, 64(3):1889–1929, 2026.arxiv.org/abs/2503.09981
  26. [30]R. Kan and G. Zhou. Optimal portfolio choice with parameter uncertainty. Journal of Financial and Quantitative Analysis, 42(3):621–656, 2007.DOI
  27. [31]P. R. Kumar and P. Varaiya. Stochastic systems: Estimation, identification, and adaptive control. SIAM, 2015.
  28. [32]P. Lakner. Utility maximization with partial information. Stochastic Processes and their Applications, 56(2):247–273, 1995.DOI
  29. [33]D. Li and W.-L. Ng. Optimal dynamic portfolio selection: Multiperiod mean-variance formulation. Mathematical Finance, 10(3):387–406, 2000.
  30. [34]H. Markowitz. Portfolio selection. The Journal of Finance, 7(1):77–91, 1952.
  31. [35]R. C. Merton. On estimating the expected return on the market: An exploratory investigation. Journal of Financial Economics, 8(4):323–361, 1980.DOI
  32. [36]A. Mete, R. Singh, X. Liu, and P. R. Kumar. Reward biased maximum likelihood estimation for reinforcement learning. In Learning for Dynamics and Control, pages 815–827. PMLR, 2021.arxiv.org/abs/2011.07738
  33. [38]H. Robbins and D. Siegmund. A convergence theorem for non negative almost supermartingales and some applications. In J. S. Rustagi, editor, Optimizing Methods in Statistics, pages 233–257. Academic Press, 1971.
  34. [39]L. C. G. Rogers. The relaxed investor and parameter uncertainty. Finance and Stochastics, 5(2):131–154, 2001.DOI
  35. [40]D. J. Russo, B. Van Roy, A. Kazerouni, I. Osband, and Z. Wen. A tutorial on Thompson sampling. Foundations and Trends in Machine Learning, 11(1):1–96, 2018. 10.1561/2200000070.
  36. [41]J. Sass and U. G. Haussmann. Optimizing the terminal wealth under partial information: The drift process as a continuous time Markov chain. Finance and Stochastics, 8(4):553–577, 2004.DOI
  37. [42]M. J. A. Strens. A Bayesian framework for reinforcement learning. In P. Langley, editor, Proceedings of the Seventeenth International Conference on Machine Learning, pages 943–950. Morgan Kaufmann, 2000.
  38. [43]L. Szpruch, T. Treetanthiploet, and Y. Zhang. Optimal scheduling of entropy regularizer for continuous-time linear-quadratic reinforcement learning. SIAM Journal on Control and Optimization, 62(1):135–166, 2024.DOI
  39. [44]G. Teschl. Ordinary Differential Equations and Dynamical Systems, volume 140 of Graduate Studies in Mathematics. American Mathematical Society, Providence, RI, 2012. 10.1090/gsm/140.DOI
  40. [45]H. Wang and X. Y. Zhou. Continuous-time mean–variance portfolio selection: A reinforcement learning framework. Mathematical Finance, 30(4):1273–1308, 2020.
  41. [47]X. Wei and X. Yu. Continuous-time q-learning for mean-field control problems. Applied Mathematics & Optimization, 91(1):10, 2025.arxiv.org/abs/2306.16208
  42. [48]X. Wei, X. Yu, and F. Yuan. Unified continuous-time q-learning for mean-field game and mean-field control problems. Preprint, arXiv:2407.04521, 2024.arxiv.org/abs/2407.04521
  43. [49]B. Wu and L. Li. Reinforcement learning for continuous-time mean-variance portfolio selection in a regime-switching market. Journal of Economic Dynamics and Control, 158:104787, 2024.
  44. [50]J. Xiong and X. Y. Zhou. Mean-variance portfolio selection under partial information. SIAM Journal on Control and Optimization, 46(1):156–175, 2007.DOI
  45. [51]X. Y. Zhou and D. Li. Continuous-time mean-variance portfolio selection: A stochastic LQ framework. Applied Mathematics & Optimization, 42(1):19–33, 2000.DOI

Paper details

vlnc:W_g9ymag55
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

Not recorded for this paper

View statement
Looking for related papers…
Contents