betaFeedback

WorksEconomics, Econometrics and Finance

Predicting Liquidity-Aware Bond Yields using Causal GANs and Deep Reinforcement Learning with LLM Evaluation

Abstract

Financial bond yield forecasting is challenging due to data scarcity, nonlinear macroeconomic dependencies, and evolving market conditions. In this paper, we propose a novel framework that leverages Causal Generative Adversarial Networks (CausalGANs) and Soft Actor-Critic (SAC) reinforcement learning (RL) to generate high-fidelity synthetic bond yield data for four major bond categories (AAA, BAA, US10Y, Junk). By incorporating 12 key macroeconomic variables, we ensure statistical fidelity by preserving essential market properties. To transform this market dependent synthetic data into actionable insights, we employ a finetuned Large Language Model (LLM) Qwen2.5-7B that generates trading signals (BUY/HOLD/SELL), risk assessments, and volatility projections. We use automated, human and LLM evaluations, all of which demonstrate that our framework improves forecasting performance over existing methods, with statistical validation via predictive accuracy, MAE evaluation(0.103%), profit/loss evaluation (60% profit rate), LLM evaluation (3.37/5) and expert assessments scoring 4.67 out of 5. The reinforcement learning-enhanced synthetic data generation achieves the least Mean Absolute Error of 0.103, demonstrating its effectiveness in replicating real-world bond market dynamics. We not only enhance data-driven trading strategies but also provides a scalable, high-fidelity synthetic financial data pipeline for risk & volatility management and investment decision-making. This work establishes a bridge between synthetic data generation, LLM driven financial forecasting, and language model evaluation, contributing to AI-driven financial decision-making.

Introduction

Forecasting bond yields is a foundational challenge in financial markets, with significant implications for investment strategies, risk management, and monetary policy. The task is complicated by the nonlinear relationships between bond yields and macroeconomic variables, as well as data scarcity in less liquid categories such as high-yield junk bonds. Traditional models, including Nelson-Siegel(Yu and Zivot 2011) and autoregressive[3] frameworks, often fail to capture these complexities, particularly during periods of market anomalies like inverted yield curves observed in the post-COVID era[9]. To address these challenges, we propose a novel framework that integrates Causal Generative Adversarial Networks (Causal GANs) with Soft Actor-Critic (SAC) reinforcement learning to generate high-fidelity synthetic bond yield data. By incorporating 12 key macroeconomic indicators, our approach ensures statistical fidelity while addressing data limitations and improving predictive accuracy.(Haarnoja et al. 2018)[26]

The practical utility of accurate bond yield forecasting extends beyond theoretical interest. Investors and portfolio managers rely on yield predictions to implement strategies such as duration management, yield curve positioning, and credit risk analysis[2]. For example, strategies like the barbell approach—pairing short-term and long-term bonds—require a nuanced understanding of yield dynamics across maturities to optimize returns while mitigating risks[30]. Moreover, advanced techniques like roll-down strategies or sector rotations depend on precise forecasts to exploit changes in yields over time. Recognizing these needs, our research not only enhances predictive accuracy but also provides actionable trading signals (BUY/HOLD/SELL), risk assessments, and volatility projections through a fine-tuned Large Language Model (LLM), Qwen2.5-7B[39]

This research contributes to financial AI literature by developing: (1) the first application of RL & Causal GANs for multi-class bond data synthesis, (2) an LLM architecture specifically optimized for fixed-income strategy formulation with integrated risk and volatility analytics, and (3) a unified evaluation protocol bridging statistical validation and economic rationality checks. Figure 1 illustrates the complete pipeline of our approach, which visually encapsulates the sequential process from data ingestion to final prediction. In the diagram, historical bond data for the 4 bonds are passed into our synthetic data generation module that employs a Causal GAN and parallelly to the RL module. The generated synthetic data (from both modules), alongside real data, are subsequently fed into our fine-tuned LLM for predictive analytics. Our experimental results demonstrate significant results in terms of profitability (where we demonstrate over a 60% profit rate) and forecasting evaluated by an LLM (with a maximum score of 3.37/5 for RL) and human evaluation (with a max score of 4.67 for RL) both of which are higher than the prediction scores of the actual, non-generated data, which proves the efficacy of our method.

Figure 1. Overall pipeline of the training and evaluation stages of our proposed methodology.

GANs in Financial Data Generation

Generative Adversarial Networks (GANs) have emerged as a versatile tool to overcome data scarcity and to create realistic synthetic datasets for financial applications. Early work by [5] demonstrated the feasibility of synthesizing artificial financial datasets from American Express data, paving the way for using GANs in benchmarking and research. Building on this, [33] introduced Quant GANs, which leverage temporal convolutional networks to capture long-range dependencies—such as volatility clusters and leverage effects—in financial time series. Other researchers have focused on modeling market microstructure. For instance, (Li et al. 2020) proposed a Stock-GAN that generates realistic stock market order streams by incorporating a conditional Wasserstein GAN and components mimicking the auction mechanism. In a related effort, [24] extended GAN-based methods to generate synthetic financial scenarios, addressing multivariate properties including price, market capitalization, and even ESG scores. Recent advances have also added control and context to the generative process. [35] introduced Market-GAN, which integrates semantic context—such as market dynamics and stock tickers—to condition the generation of financial data. In parallel, attention mechanisms have been incorporated into GANs for time series simulation; (Fu, Hirsa, and Osterrieder 2022) employed attention to improve the reproduction of stylized facts like autocorrelation, while [32] applied GANs to simulate equity option markets for deep hedging applications.

Reinforcement Learning in Finance

Recent years have witnessed a surge of interest in applying reinforcement learning (RL) techniques to financial problems. Early work such as [43] introduced deep RL frameworks for trading by directly mapping market states to trading actions, demonstrating that end-to-end learned policies can outperform classical time series momentum strategies. In parallel, [25] focused on market making, where an RL agent is trained to optimally set bid–ask quotes, balancing the tradeoff between capturing the spread and managing inventory risk. Another strand of research frames trading itself as a game. For example, [13] models financial trading as an interactive game and employs a deep recurrent Q-network to capture the dynamic and stochastic nature of market environments. Extending these ideas to portfolio optimization, (Yu et al. 2019) proposes a model-based RL approach that integrates prediction and control for dynamic asset allocation under transaction costs and risk considerations. Building on these foundations, [18] introduces the FinRL-Pordacer framework, which emphasizes both high performance and scalability, thereby facilitating continuous training and integration into practical trading systems. Complementing these works, [29] details an application of deep RL for algorithmic trading that incorporates novel reward functions to directly target risk-adjusted returns. Finally, survey work such as [23] synthesizes the rapidly growing literature by critically evaluating 167 publications on RL applications in finance. Recent contributions ([14, 12]) further extend these ideas by addressing emerging challenges such as sample efficiency and risk-sensitive reward design in multi-agent settings.

LLMs in Financial Prediction and Evaluation

Recent studies have demonstrated that large language models (LLMs) are rapidly transforming the landscape of financial prediction and evaluation. For instance, [37] introduces PIXIU, a comprehensive framework that not only fine-tunes a base LLM for financial tasks using a large-scale instruction dataset but also establishes an evaluation benchmark covering multiple financial domains. This work underlines the importance of domain-specific instruction data and standardized benchmarks in pushing forward the state of open-source financial AI. Building on this foundation, [4] proposes an integration framework that combines traditional stock features with semantic representations derived from LLMs. Their Local-Global (LG) model, augmented by Self-Correlated Reinforcement Learning (SCRL), effectively aligns latent textual information with quantitative features, thereby enhancing stock return predictions. In a similar vein, [31] presents LLMFactor, which utilizes Sequential Knowledge-Guided Prompting (SKGP) to extract interpretable factors that drive stock movement predictions. This approach not only improves explain ability but also provides clear insights into the dynamics of market changes. The predictive capabilities of LLMs have also been investigated from the perspective of raw model output. [19] explores whether ChatGPT can forecast stock price movements based solely on news headlines, finding that its sentiment scores significantly predict out-of-sample returns—even outperforming traditional quantitative models in certain settings. Complementing this, [6] develops MarketSenseAI, a framework that leverages GPT-4’s advanced reasoning (through chain-of-thought and in-context learning) for stock selection, demonstrating notable excess alpha and cumulative returns in competitive market universes. Recent efforts have also focused on the fine-tuning and adaptation of LLMs to financial time-series data. For example, [10] compares encoder-only and decoder-only architectures in a fine-tuning setting using financial newsflow data, showing that token-level representations extracted from LLMs can serve as strong predictive signals for both long-only and long-short portfolio strategies. Moreover, [15] investigates the use of LLMs for financial statement analysis, revealing that models such as GPT-4 not only outperform human analysts in directional earnings prediction but also yield trading strategies with superior risk-adjusted returns. Finally, (Kirtac and Germano 2024) highlights the benefits of advanced sentiment analysis using LLMs.

Evaluation Frameworks in Financial AI

The recent surge in applying large language models (LLMs) and other generative AI techniques to finance has prompted the development of specialized evaluation frameworks that capture the unique challenges and nuances of financial tasks. These frameworks assess general performance while also measuring domain-specific capabilities such as risk management, compliance, financial reasoning, and market behavior prediction. Several evaluation benchmarks have emerged, each targeting different facets of financial applications. For instance, SuperCLUE-Fin (Xu et al. 2024) offers a graded, fine-grained analysis of Chinese financial LLMs by simulating real-life multi-turn financial conversations, evaluating models on logical reasoning, computational efficiency, and regulatory compliance. In another vein, frameworks like the one presented for generalist credit scoring [7] highlight the potential of LLMs as holistic evaluators in credit assessment, measuring not only accuracy but also biases and fairness in model predictions. Additional evaluation strategies focus on the relational and dynamic nature of financial data. For example, the framework for evaluating financial relational graphs [21] assesses models’ ability to explain historical financial phenomena by constructing and interpreting dynamic stock relationship graphs before integrating them into downstream predictive models. Complementing these approaches is FinBen [36], a benchmark covering over two dozen financial tasks such as information extraction, textual analysis, forecasting, and decision-making, which evaluates state-of-the-art models tailored for stock trading and risk management. Finally, the emergence of frameworks like LOB-Bench [20] underscores the importance of domain-specific metrics, particularly in financial markets, where the statistical nuances of order flows, price impacts, and market microstructure play a critical role. Collectively, these evaluation frameworks illustrate a trend toward increasingly sophisticated and nuanced assessments in financial AI, emphasizing the need for metrics that go beyond traditional accuracy to incorporate aspects such as fairness, interpretability, and robustness in high-stakes financial environments.

Methodology

This section outlines the methodology employed in this study, which integrates Generative Adversarial Networks (GANs), Reinforcement Learning (RL), and Large Language Models (LLMs) to generate synthetic bond yield data and provide actionable trading insights. The workflow consists of three main components: data preprocessing, synthetic data generation using GANs and RL, and predictive modeling with LLMs.

Data Description

The dataset used in this study comprises 10 years of monthly bond yield data (2013–2023) for four bond categories: AAA-rated corporate bonds, BAA-rated corporate bonds, US 10-year Treasury notes (US10Y), and high-yield junk bonds. Each bond’s yield is influenced by 12 macroeconomic variables that reflect key economic and financial market dynamics. These variables influence bond yields through various economic mechanisms, including interest rate expectations, inflationary pressures, and investor sentiment.

The dataset is structured as follows:

X={(t,YAAA,YBAA,YUS10Y,YJunk,It,Gt,Ut,Ft,Mt,Ct,St,Ot,Gdt,Dt,Et,Vt)}t=1120(1)X = \left\{ \left(t, Y_{AAA}, Y_{BAA}, Y_{US10Y}, Y_{Junk}, I_t, G_t, U_t, F_t, M_t, C_t, S_t, O_t, Gd_t, D_t, E_t, V_t \right) \right\}_{t=1}^{120} \tag*{(1)}

where tt represents the month index over 10 years (120 months). The target variables are the bond yields YAAAY_{AAA}, YBAAY_{BAA}, YUS10YY_{US10Y}, and YJunkY_{Junk}, which respond dynamically to macroeconomic conditions.

Macroeconomic Variables and Their Effect on Bond Yields

Table 1 summarizes the expected impact of each macroeconomic variable on bond yields.

VariableEffect on Bond Yields
Inflation Rate (ItI_t)Higher inflation generally leads to higher bond yields as investors demand greater compensation for inflation risk.
GDP Growth (GtG_t)Strong economic growth can increase bond yields due to higher demand for capital and expectations of tighter monetary policy.
Unemployment Rate (UtU_t)Higher unemployment tends to lower bond yields as it signals economic weakness, leading to dovish monetary policy.
Fed Funds Rate (FtF_t)An increase in the Fed Funds Rate raises short-term yields and influences longer-term bond yields through expectations of future rate hikes.
Money Supply (MtM_t)A higher money supply can reduce bond yields by increasing liquidity and lowering interest rates.
Consumer Confidence Index (CtC_t)Higher consumer confidence can increase bond yields as investors anticipate stronger economic activity and higher interest rates.
S&P 500 Index (StS_t)Rising equity markets can lead to higher bond yields as investors shift from bonds to riskier assets, reducing bond prices.
Crude Oil Prices (OtO_t)Higher oil prices can lead to higher bond yields due to inflationary pressures and expectations of tighter monetary policy.
Gold Prices (GdtGd_t)Rising gold prices may indicate economic uncertainty, potentially leading to lower bond yields as investors seek safe-haven assets.
US Dollar Index (DtD_t)A stronger US dollar can put downward pressure on inflation and bond yields by reducing import costs.
INR/USD Exchange Rate (EtE_t)A depreciating INR (relative to USD) may increase bond yields due to inflationary pressures and capital outflows.
Volatility Index (VIX, VtV_t)Higher market volatility often leads to lower bond yields as investors move toward safer assets like government bonds.

Table 1. Effect of Macroeconomic Variables on Bond Yields

Synthetic Data Generation

To address data scarcity and augment the training dataset for predictive modeling, we employ two complementary approaches: GANs and RL. These methods encapsulate the dependencies of the 12 macroeconomic variables on the four bond yields.

Causal GAN for Time-Series Data We utilize a Causal GAN architecture (Yoon, Jarrett, and van der Schaar [40]) to generate synthetic time-series data that preserve temporal dependencies and causal relationships between variables. The Causal GAN consists of a generator GG, a discriminator DD, and an embedding network EE. The generator models the conditional distribution of bond yields given the macroeconomic variables:

G(z∣X)=P(Y∣It,Gt,Ut,Ft,Mt,Ct,St,Ot,Gdt,Dt,Et,Vt)(2)G(z \mid X) = \mathbb{P}\left(Y \mid I_t, G_t, U_t, F_t, M_t, C_t, S_t, O_t, Gd_t, D_t, E_t, V_t\right) \tag*{(2)}

where z∼N(0,1)z \sim\mathcal{N}(0,1) is a latent noise vector. The discriminator is tasked with distinguishing between real and synthetic data:

D(X)=P(Real∣X)(3)D(X) = \mathbb{P}(\mathrm{Real} \mid X) \tag*{(3)}

The training objective minimizes the Wasserstein distance with gradient penalty to stabilize learning:

min⁡Gmax⁡DEXreal[D(Xreal)]−EXfake[D(Xfake)]+λEX^[(∥∇X^D(X^)∥2−1)2](4)\min_G \max_D \mathbb{E}_{X_{\mathrm{real}}}\left[D(X_{\mathrm{real}})\right] - \mathbb{E}_{X_{\mathrm{fake}}}\left[D(X_{\mathrm{fake}})\right] + \lambda\mathbb{E}_{\hat{X}}\left[\left(\left\lVert\nabla_{\hat{X}}D(\hat{X})\right\rVert_2 - 1\right)^2\right] \tag*{(4)}

Here, X^\hat{X} denotes a linear interpolation between real and synthetic samples, and λ\lambda is a hyperparameter controlling the gradient penalty. This formulation ensures that the generated data maintain realistic statistical properties, including volatility clustering and autocorrelation.

Reinforcement Learning with Soft Actor-Critic (SAC) To further refine synthetic data generation and capture complex interdependencies, we employ Soft Actor-Critic (SAC) (Haarnoja et al. 2018), an off-policy RL algorithm grounded in maximum entropy reinforcement learning. SAC optimizes a stochastic policy πθ(a∣s)\pi_\theta(a \mid s) to maximize both expected reward and the entropy of the policy:

J(π)=∑t=1TE(s,a)∼π[r(s,a)+αH(π(⋅∣s))](5)J(\pi) = \sum_{t=1}^{T} \mathbb{E}_{(s,a)\sim\pi}\left[r(s,a) + \alpha\mathcal{H}(\pi(\cdot\mid s))\right] \tag*{(5)}

In this expression, r(s,a)r(s,a) is a reward function that quantifies the realism of the synthetic data (e.g., via the mean squared error between real and generated bond yields), and α\alpha is a temperature parameter controlling the trade-off between exploration and exploitation. The SAC framework comprises three components:

Overall architecture of the models in our pipeline for Causal GANs and Deep Reinforcement Learning with Soft actor Critic as its algorithm.

Figure 2. Overall architecture of the models in our pipeline for Causal GANs and Deep Reinforcement Learning with Soft actor Critic as its algorithm.

  • Actor Network: Generates actions aa, which correspond to adjustments in the synthetic data.

  • Critic Network: Evaluates state-action pairs (s,a)(s,a) through Q-values.

  • Entropy Regularization: Promotes exploration by maximizing the entropy H\mathcal{H}.

The overall SAC loss is formulated as:

LSAC=JQ+Jπ+Jα(6)L_{\mathrm{SAC}} = J_Q + J_\pi+ J_\alpha \tag*{(6)}

where JQJ_Q, JπJ_\pi, and JαJ_\alpha represent the losses for the critic network, actor network, and the entropy coefficient, respectively. This approach allows the RL agent to interact iteratively with the GAN generator to improve the quality of the synthetic data. Figure 3 indicates the reward curves plotted over time for all four bond yield types.

Real-time reward curves for Reinforcement Learning Model

Figure 3. Real-time reward curves for Reinforcement Learning Model

Predictive Modeling with LLMs

Once synthetic datasets are generated by the GAN and RL models, they are merged with real data and used to train a Large Language Model (LLM) for predictive analytics. Specifically, we employ Qwen2.5-7B [39] as our predictive model, fine-tuned on both real and synthetic bond data. The LLM takes as input the monthly bond yields (YAAA,YBAA,YUS10Y,YJunk)(Y_{AAA}, Y_{BAA}, Y_{US10Y}, Y_{Junk}) along with the temporal index (month) and outputs three key predictions:

  1. Trading Signals: BUY/HOLD/SELL recommendations with confidence intervals.

  2. Risk Analysis: Modified Value-at-Risk (VaR) estimates.

  3. Volatility Projections: Conditional variance estimates inspired by GARCH-type models.

The input sequence is defined as:

S=(Montht,YAAA,t,YBAA,t,YUS10Y,t,YJunk,t)t=1120(7)S = \left(\mathrm{Month}_t, Y_{AAA,t}, Y_{BAA,t}, Y_{US10Y,t}, Y_{Junk,t}\right)_{t=1}^{120} \tag*{(7)}

The LLM has been fine-tuned using a masked language modeling (MLM) objective:

LMLM=−∑i=1Nlog⁡P(si∣s<i;θ)(8)L_{\mathrm{MLM}}=-\sum_{i=1}^{N}\log P(s_i|s_{<i};\theta) \tag*{(8)}

By integrating Qwen2.5-7B into our predictive modeling pipeline, we enhance decision-making capabilities, leveraging its contextual understanding to generate interpretable and robust financial forecasts.

Evaluation Framework

To assess the performance and reliability of our integrated methodology, we employ four evaluation metrics:

  1. LLM-as-Judge: We employ a seperate LLM, DeepSeek-R1-Distil[1] which evaluates the coherence and decision logic of the trading recommendations on a score of 1-5.

  2. Profit/Loss Analysis: Measures prediction based on accuracy on simulated trading outcomes (1-profit; 0-loss).

  3. Mean Absolute Error (MAE): Quantifies the deviation between predicted and actual bond yields.

  4. Expert Evaluation: Financial experts qualitatively assess the usefulness of these outputs for practical viability.

This comprehensive evaluation framework ensures that our synthetic data generation and predictive modeling techniques are both quantitatively rigorous and qualitatively sound.

Experiments and Results

This section details the experimental setup, presents the results from our synthetic data generation and predictive modeling, and analyzes the performance of our integrated framework using a 4-step evaluation pipeline with automated, human and LLM evaluation. We also compare the utilized frameworks with an ablation study to assess the contribution of individual components.

ModelSize
CausalGAN134K
RL6.3M
LLMEval[28]7B
LLMJudge[27]32B

Table 2. Model Sizes

Experimental Setup

Our experiments were conducted on a workstation equipped with one NVIDIA A100 (40GB) GPU, running Ubuntu 20.04. The deep learning frameworks used for implementation include PyTorch[22] for GAN and RL training and for running the LLM inferences we use HuggingFace-Transformers[34] and DeepEval 12

Training Hyperparameters:

  • Causal GAN: The generator and discriminator networks were trained using the Adam optimizer with a learning rate of ηGAN=2e−4\eta_{\mathrm{GAN}}=2e-4 and a batch size of 8.

  • Soft Actor-Critic (SAC): The RL agent used a learning rate of ηRL=1e−4\eta_{\mathrm{RL}}=1e-4, with an entropy temperature parameter α=0.2\alpha=0.2 and a discount factor γ=0.99\gamma=0.99. The actor and critic networks were updated using a replay buffer of size 10000 and the neural network architecture was defined as [1024,1024,1024][1024, 1024, 1024] with a batch size of 512 and τ=0.005\tau=0.005.

Predictive Performance

We evaluate the predictive performance of our LLM on both real and synthetic datasets. The LLM has a standardized json output which contains the trading signals (BUY/HOLD/SELL), risk analysis, and volatility projections. Performance is measured using standard metrics including accuracy, mean absolute error (MAE), and profit/loss ratios.

The MAE metric is computed as:

MAE=1N∑i=1N∣Yi−Y^i∣(9)\mathrm{MAE}=\frac{1}{N}\sum_{i=1}^{N}|Y_i-\hat{Y}_i| \tag*{(9)}

where YiY_i is the actual bond yield and Y^i\hat{Y}_i is the predicted yield.

Ablation Studies

Ablation studies were conducted to evaluate the contribution of individual components of our framework. Specifically, we compared:

The performance differences between using solely GAN-generated data, solely RL-refined synthetic data, and the actual data.

Table 3 shows the ablation studies on MAE against actual forecasted bond yields. The ablation results indicate that removing the RL component increases the MAE a value of 0.3 on US 10 year bond yields and 0.1 on Junk Bond Yields. Figure 5 shows a comparative analysis on the total number of months in which RL/GAN achieves a profit or a loss. Our models tend to overestimate actual yields due to the following factors:

MethodAvg. LLM Judge Score↑
RL3.37
GAN2.87
Actual2.58

Table 3. Average Evaluation Scores for Different Methods. Best score denoted by bold.

Plots for the Total Profit and Total Loss months between RL, GAN and Actual for each bond type.

Figure 5. Plots for the Total Profit and Total Loss months between RL, GAN and Actual for each bond type.

  1. Large Language Models (LLMs) have inherent limitations in accurately predicting future outcomes, particularly in dynamic and uncertain environments.

  2. While our forecasting approach projects higher potential profits, it does not fully account for the significant risk factors associated with market fluctuations and external uncertainties.

Evaluation Results

We evaluated our integrated methodology using four metrics:

LLM-as-Judge Evaluation: Figure 4 shows the scores given by the LLM as a Judge over a period of 30 months based on a lookback of 2 years. A separate LLM (DeepSeek-R1-Distil) was employed to assess the decision-making quality of the prediction LLM (QWEN2.5-7B) over the last 30 months of data. The judge LLM compares the predicted trading signals with the actual market outcomes in an iterative manner (starting from month 85 to month 120) and assigns scores on a scale of 1 to 5 on a static evaluation criteria. Table 3 shows that the RL method had the highest average evaluation score of 3.37.

Evaluation Scores Over 30 Months

Figure 4. Plot of the evaluation given by the LLM over the last 30 months for each method

Profit/Loss Evaluation: A custom evaluation script determined the profitability of the predictions, assigning a value of 1 for profitable predictions and 0 for losses. The overall profit/loss accuracy was computed as:

Profit/Loss Accuracy=1N∑i=1NI{Profiti}(10)\mathrm{Profit/Loss\ Accuracy} = \frac{1}{N}\sum_{i=1}^{N} \mathbb{I}\{\mathrm{Profit}_i\} \tag*{(10)}

On comparing the number of profit months between RL-/Gan and the actual bond yields, the RL- based approach achieves the most number of profit months which was 60% for AAA and 54% for BAA Bonds.

Mean Absolute Error (MAE): The MAE of the predicted bond yields, weighted by their economic impact, was computed using (3). Our analysis shows an average MAE of 0.2 on all bond yields for our proposed framework. Table 4 shows the MAE for both RL and GAN against the actual forecasted values.

MethodBond TypeMAE ↓
GANUS_10Y_Yield0.437
GANAAA_Bond_Yield0.343
GANBAA_Bond_Yield0.372
GANJunk_Bond_Yield0.594
RLUS_10Y_Yield0.103
RLAAA_Bond_Yield0.124
RLBAA_Bond_Yield0.174
RLJunk_Bond_Yield0.458

Table 4. Mean Absolute Error for Different Bond Yields. Best score denoted by bold.

Expert Evaluation: Three financial experts conducted a qualitative assessment of the model outputs, focusing on the realism of synthetic data and the validity of the trading signals. Their insights and recommendations were summarized into an overall expert evaluation score of 4.67 for RL and 3.67 for GANs. Table 5 summarises the scores of the expert evaluators.

MethodExpert 1Expert 2Expert 3Average↑
RL4.55.04.54.67
GAN4.04.04.54.17
Actual3.53.54.03.67

Table 5. Expert Evaluation Scores for Different Methods. Best score denoted by bold.

Collectively, these evaluations demonstrate that our integrated framework produces synthetic data that not only replicates the critical market dynamics but also supports predictive performance of forecasting methods.

Conclusion

In this paper, we presented an integrated framework for synthesizing financial bond yield data by leveraging a hybrid approach that combines causal Generative Adversarial Networks (GANs) and Soft Actor-Critic (SAC) reinforcement learning, followed by predictive analysis using a fine-tuned Large Language Model: Qwen2.5-7B. Our methodology was designed to encapsulate the intricate dependencies among 12 macroeconomic variables and four bond yields while preserving market-essential statistical properties.

Our extensive experimental results indicate that the synthetic data generated by the proposed framework encapsulates market dynamics of the 12 macroeconomic variables but also closely resembles real-world data, as evidenced by visual comparisons. The predictive performance of the LLM, when trained on the augmented dataset, demonstrated an LLM-as-Judge score of 3.4, and a mean absolute error (MAE) of 0.10 for RL. Additionally, ablation studies confirmed that the reinforcement learning component significantly enhances data quality—its removal increased the MAE by 0.103. We show that data points generated by both RL and Causal GANs show significantly better performance in recommendations than the forecasted values of the actual bond yields.

These results demonstrate the potential of our integrated approach in generating high-fidelity synthetic financial data and supporting predictive modeling for bond investment trading and risk management. Future work will focus on further refining the generative models, incorporating additional macroeconomic factors, and extending the framework to other financial instruments and market conditions.

Ethical Statement This work employs synthetic data generation techniques and advanced machine learning methods to enhance financial forecasting and trading decision support. While our approach mitigates issues of data scarcity and privacy concerns by generating data that closely mimics real-world financial indicators, we acknowledge several ethical considerations.

First, the use of synthetic data must be carefully managed to ensure that the process does not inadvertently propagate biases inherent in historical data. Misrepresentations or oversimplifications in synthetic datasets could lead to flawed financial predictions and decision-making, with potentially adverse economic and societal impacts. Second, although synthetic data help protect individual privacy by avoiding the direct use of sensitive real-world information, there remains a risk of indirect re-identification if the synthetic data are not sufficiently randomized or are combined with external datasets.

Furthermore, as with any AI-driven system, transparency in model development, validation, and deployment is essential. In this study, we incorporate human evaluation and expert assessments as key components of our evaluation framework to ensure the reliability and contextual soundness of our predictions. We are committed to documenting our methodologies and results comprehensively, thereby promoting reproducibility and enabling independent verification of our findings.

Overall, our research aims to contribute positively to financial decision-making processes while actively mitigating potential negative societal implications.

References

  1. [1]AI, D. 2024. DeepSeek R1: A Large Language Model for Robust Decision Evaluation. Preprint.
  2. [2]Bieri, D. S.; and Chincarini, L. B. 2005. Riding the yield curve: a variety of strategies. The Journal of fixed income, 15(2): 6–35.DOI
  3. [3]Carriero, A.; Kapetanios, G.; and Marcellino, M. 2012. Forecasting government bond yields with large Bayesian vector autoregressions. Journal of Banking & Finance, 36(7): 2026–2047.DOI
  4. [4]Ding, Y.; Jia, S.; Ma, T.; Mao, B.; Zhou, X.; Li, L.; and Han, D. 2023. Integrating Stock Features and Global Information via Large Language Models for Enhanced Stock Return Prediction. arXiv:2310.05627.arxiv.org/abs/2310.05627
  5. [5]Efimov, D.; Xu, D.; Kong, L.; Nefedov, A.; and Anandakrishnan, A. 2020. Using generative adversarial networks to synthesize artificial financial datasets. arXiv preprint arXiv:2002.02271.arxiv.org/abs/2002.02271
  6. [6]Fatouros, G.; Metaxas, K.; Soldatos, J.; and Kyriazis, D. 2024. Can Large Language Models beat wall street? Evaluating GPT-4’s impact on financial decision-making with MarketSenseAI. Neural Computing and Applications.
  7. [7]Feng, D.; Dai, Y.; Huang, J.; Zhang, Y.; Xie, Q.; Han, W.; Chen, Z.; Lopez-Lira, A.; and Wang, H. 2024. Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models. arXiv:2310.00566.arxiv.org/abs/2310.00566
  8. [9]Ghosh, I.; and Chaudhuri, T. D. 2021. FEB-stacking and FEB-DNN models for stock trend prediction: a performance analysis for pre and post covid-19 periods. Decision Making: Applications in Management and Engineering, 4(1): 51–84.DOI
  9. [10]Guo, T.; and Hauptmann, E. 2024. Fine-Tuning Large Language Models for Stock Return Prediction Using Newsflow. arXiv:2407.18103.arxiv.org/abs/2407.18103
  10. [12]Hambly, B.; Xu, R.; and Yang, H. 2023. Recent advances in reinforcement learning in finance. Mathematical Finance, 33(3): 437–503.
  11. [13]Huang, C. Y. 2018. Financial Trading as a Game: A Deep Reinforcement Learning Approach. arXiv preprint arXiv:1807.02787.arxiv.org/abs/1807.02787
  12. [14]Huang, G.; Zhou, X.; and Song, Q. 2022. Deep reinforcement learning for portfolio management. arXiv:2012.13773.
  13. [15]Kim, A.; Muhn, M.; and Nikolaev, V. 2024. Financial Statement Analysis with Large Language Models. arXiv:2407.17866.arxiv.org/abs/2407.17866
  14. [18]Li, Z.; Liu, X.-Y.; Zheng, J.; Wang, Z.; Walid, A.; and Guo, J. 2021. FinRL-Podracer: High Performance and Scalable Deep Reinforcement Learning for Quantitative Finance. arXiv preprint arXiv:2111.05188.DOI
  15. [19]Lopez-Lira, A.; and Tang, Y. 2024. Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models. arXiv:2304.07619.
  16. [20]Nagy, P.; Frey, S.; Li, K.; Sarkar, B.; Vyетrenko, S.; Zohren, S.; Calinescu, A.; and Foerster, J. 2025. LOB-Bench: Benchmarking Generative AI for Finance – an Application to Limit Order Book Data. arXiv:2502.09172.arxiv.org/abs/2502.09172
  17. [21]Niu, Y.; Lu, L.; Dolphin, R.; Poti, V.; and Dong, R. 2024. Evaluating Financial Relational Graphs: Interpretation Before Prediction. arXiv:2410.07216.arxiv.org/abs/2410.07216
  18. [22]Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; Desmaison, A.; Köpf, A.; Yang, E.; DeVito, Z.; Raison, M.; Tejani, A.; Chilamkurthy, S.; Steiner, B.; Fang, L.; Bai, J.; and Chintala, S. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. arXiv:1912.01703.arxiv.org/abs/1912.01703
  19. [23]Pippas, N.; Turkay, C.; and Ludvig, E. A. 2024. The Evolution of Reinforcement Learning in Quantitative Finance: A Survey. arXiv preprint arXiv:2408.10932.DOI
  20. [24]Rizzato, M.; Wallat, J.; Geissler, C.; Morizet, N.; and Boumlak, N. 2022. Generative Adversarial Networks Applied to Synthetic Financial Scenarios Generation. arXiv preprint arXiv:2209.03935.DOI
  21. [25]Selser, M.; Kreiner, J.; and Maurette, M. 2021. Optimal Market Making by Reinforcement Learning. arXiv preprint arXiv:2104.04036.arxiv.org/abs/2104.04036
  22. [26]Tamuly, A.; Bhutani, G.; et al. 2024. Portfolio Optimization using Deep Reinforcement Learning. In 2024 IEEE 5th India Council International Subsections Conference (INDIS-CON), 1–6. IEEE.DOI
  23. [27]Team, D. 2025a. deepseek-ai/DeepSeek-R1-Distill-Qwen-32B · Hugging Face. [Online; accessed 2025-02-24].
  24. [28]Team, Q. 2025b. Qwen/Qwen2.5-7B-Instruct-1M · Hugging Face. [Online; accessed 2025-02-24].
  25. [29]Théate, T.; and Ernst, D. 2020. An Application of Deep Reinforcement Learning to Algorithmic Trading. arXiv preprint arXiv:2004.06627.DOI
  26. [30]Trainor Jr, W. J.; and Brown, C. L. 2020. Using Barbells to Lift Risk-Adjusted Return. Journal of Investment Consulting, 20(1): 40–47.
  27. [31]Wang, M.; Izumi, K.; and Sakaji, H. 2024. LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Prediction. arXiv:2406.10811.arxiv.org/abs/2406.10811
  28. [32]Wiese, M.; Bai, L.; Wood, B.; and Buehler, H. 2019a. Deep Hedging: Learning to Simulate Equity Option Markets. arXiv preprint arXiv:1911.01700.arxiv.org/abs/1911.01700
  29. [33]Wiese, M.; Knobloch, R.; Korn, R.; and Kretschmer, P. 2019b. Quant GANs: Deep Generation of Financial Time Series. arXiv preprint arXiv:1907.06673.DOI
  30. [34]Wolf, T.; Debut, L.; Sanh, V.; Chaumond, J.; Delangue, C.; Moi, A.; Cistac, P.; Rault, T.; Louf, R.; Funtowicz, M.; Davison, J.; Shleifer, S.; von Platen, P.; Ma, C.; Jernite, Y.; Plu, J.; Xu, C.; Scao, T. L.; Gugger, S.; Drame, M.; Lhoest, Q.; and Rush, A. M. 2020. HuggingFace’s Transformers: State-of-the-art Natural Language Processing. arXiv:1910.03771.arxiv.org/abs/1910.03771
  31. [35]Xia, H.; Sun, S.; Wang, X.; and An, B. 2023. Market-GAN: Adding Control to Financial Market Data Generation with Semantic Context. arXiv preprint arXiv:2309.07708.arxiv.org/abs/2309.07708
  32. [36]Xie, Q.; Han, W.; Chen, Z.; Xiang, R.; Zhang, X.; He, Y.; Xiao, M.; Li, D.; Dai, Y.; Feng, D.; Xu, Y.; Kang, H.; Kuang, Z.; Yuan, C.; Yang, K.; Luo, Z.; Zhang, T.; Liu, Z.; Xiong, G.; Deng, Z.; Jiang, Y.; Yao, Z.; Li, H.; Yu, Y.; Hu, G.; Huang, J.; Liu, X.-Y.; Lopez-Lira, A.; Wang, B.; Lai, Y.; Wang, H.; Peng, M.; Ananiadou, S.; and Huang, J. 2024. FinBen: A Holistic Financial Benchmark for Large Language Models. arXiv:2402.12659.arxiv.org/abs/2402.12659
  33. [37]Xie, Q.; Han, W.; Zhang, X.; Lai, Y.; Peng, M.; Lopez-Lira, A.; and Huang, J. 2023. PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance. arXiv:2306.05443.arxiv.org/abs/2306.05443
  34. [39]Yang, A.; Yang, B.; Zhang, B.; Hui, B.; Zheng, B.; Yu, B.; Li, C.; Liu, D.; Huang, F.; Wei, H.; et al. 2024. Qwen2. 5 technical report. arXiv preprint arXiv:2412.15115.arxiv.org/abs/2412.15115
  35. [40]Yoon, J.; Jarrett, D.; and van der Schaar, M. 2019. Time-series Generative Adversarial Networks. arXiv preprint arXiv:1907.03107.
  36. [43]Zhang, Z.; Zohren, S.; and Roberts, S. 2019. Deep Reinforcement Learning for Trading. arXiv preprint arXiv:1911.10107.arxiv.org/abs/1911.10107

Paper details

vlnc:W_8hcrms84
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Economics, Econometrics and Finance

Not recorded for this paper

View statement
Looking for related papers…
Contents