betaFeedback

WorksComputer Science

Learning When to Think Aloud in Latent Reasoning

Abstract

Latent Chain-of-Thought (CoT) reasoning improves efficiency by shifting intermediate computation into continuous hidden states. However, fully latent methods often struggle on precision-critical tasks such as mathematical reasoning, while existing hybrid approaches retain substantial token-generation overhead. We introduce VITAL, an importance-guided hybrid reasoning framework that selectively verbalizes informative tokens as reasoning anchors while keeping most computation latent. A lightweight gating head dynamically selects between explicit token generation and direct hidden-state feedback. VITAL constructs hybrid trajectories from explicit CoT using token- importance estimation and trains the model through curriculum-based supervised training, followed by reinforcement learning with a reward that balances correctness and conciseness. Experiments show that VITAL consistently out- performs existing fully latent reasoning methods, achieving relative average accuracy gains of 9.6% on GPT-2 and 5.1% on Llama-3.2-1B at comparable reasoning lengths. Compared with hybrid baselines, VITAL achieves higher reasoning accuracy with substantially shorter reasoning trajectories on Qwen3-1.7B.

Introduction

Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities through Chain-of-Thought (CoT) prompting, which decomposes complex problems into step-by-step natural language rationales [25]. However, generating lengthy reasoning traces incurs substantial decoding costs. To improve efficiency, latent CoT methods perform intermediate computation in continuous representations rather than verbalizing every reasoning step. Coconut [8] introduces hidden-state feedback for continuous reasoning, while CODI [20] and CoLaR [23] explore compressing explicit CoT into latent representations. SIM-CoT [26] further applies step-level supervision to latent reasoning, while ACoT [17] reasons with discrete abstract tokens instead of continuous states. Recent hybrid approaches, such as Token Assorted [22], HRPO [29] and HybridCoT [19] combine latent and explicit representations to improve the overall reasoning performance.

Despite these advances, fully latent methods often underperform explicit CoT on precision-critical tasks like mathematical reasoning, where reliable multi-step computation requires a more accurate handling of intermediate quantities and operations. Wei et al. [26] show that increasing latent depth can destabilize training and reduce step-level semantic diversity. Zou et al. [31] introduce a notion of symbolic index to explain the fundamental trade-off between exploration and execution in the reasoning process. Meanwhile, hybrid reasoning methods incorporate explicit intermediate tokens to improve the reasoning accuracy, but generally incur a greater token overhead than fully latent methods. For example, Token Assorted compresses only the initial portion of the reasoning trajectory, whereas HRPO still generates a token at each reasoning step despite incorporating latent representations. Based on these observations, we ask: Can we selectively verbalize a small number of informative tokens as discrete reasoning anchors to preserve critical intermediate information while keeping most computation latent? For training, these tokens serve as explicit prediction targets; during inference, their embeddings are fed back into the model to support subsequent latent computation.

In this work, we propose VITAL, a hybrid reasoning framework that learns when to think aloud by Verbalizing Informative Tokens as reasoning Anchors for Latent reasoning. Rather than generating the full CoT, VITAL selectively externalizes key intermediate tokens while keeping less essential computation latent. As illustrated in Figure 1, VITAL augments a base language model with a lightweight gating head that dynamically decides whether to generate an explicit token or continue latent computation. In the former case, the model generates a token through standard autoregressive decoding and feeds its embedding back as the next input. In the latter case, the current hidden state is directly fed back for subsequent computation. This mechanism enables VITAL to interleave explicit reasoning anchors with continuous latent computation within a unified autoregressive trajectory.

Architecture of VITAL

Figure 1. Architecture of VITAL. A lightweight gating head dynamically selects between explicit token generation and latent computation at each reasoning step.

To train VITAL, we construct hybrid trajectories from explicit CoT demonstrations. Specifically, we employ LLMLingua-2 ([14]) to estimate token importance within each reasoning step, retaining high-importance tokens as explicit anchors while compressing the remaining spans into latent representation. We adopt curriculum-based supervised training that progressively transforms explicit CoT trajectories into hybrid trajectories, and further apply Reinforcement Learning (RL) post-training with a tailored reward that balances both correctness and conciseness.

We evaluate VITAL on mathematical and scientific reasoning benchmarks using GPT-2 ([16]), Llama-3.2-1B ([13]), and Qwen3-1.7B ([24]). Experimental results show that VITAL consistently outperforms existing fully latent reasoning baselines, achieving relative improvements in average accuracy of 9.6% on GPT-2 and 5.1% on Llama-3.2-1B at comparable reasoning lengths. Compared with hybrid methods Token Assorted and HRPO, VITAL achieves higher reasoning accuracy with substantially shorter reasoning trajectories. Ablation studies further show that selecting high-importance tokens achieves higher accuracy than random or low-importance tokens. These findings validate the effectiveness of importance-guided selective verbalization in improving the accuracy-length trade-off of latent reasoning.

Our contributions are threefold:

  • We propose VITAL, a hybrid reasoning framework that uses a lightweight gating head to interleave sparse explicit reasoning anchors with continuous latent computation.

  • We develop an importance-guided, step-wise trajectory construction strategy together with a two-stage training procedure to enable selective verbalization of informative tokens.

  • We evaluate VITAL against explicit, latent, and hybrid reasoning baselines across three backbones, demonstrating an improved accuracy-length trade-off and the importance of selecting informative reasoning anchors.

Related Work

Latent CoT Reasoning. Latent CoT methods seek to reduce explicit token generation by internalizing intermediate reasoning into continuous hidden states. Early work, such as iCoT ([3]), progressively internalizes explicit reasoning steps during training. Coconut ([8]) learns continuous reasoning through curriculum-based hidden-state feedback, while CODI ([20]) compresses explicit CoT through self-distillation. CoLaR ([23]) learns to predict compressed embeddings with adjustable compression factors. SIM-CoT Wei et al. [26] introduces step-level supervision through an auxiliary decoder that is removed at inference. Unlike these approaches, VITAL selectively verbalizes informative intermediate tokens as discrete reasoning anchors during inference. These tokens are then fed back into the model as embeddings to support subsequent latent computation.

Hybrid CoT Reasoning. Hybrid methods combine latent and explicit reasoning tokens. Token Assorted [22] replaces a prefix of the reasoning trace with discrete latent codes, and HRPO [29] uses RL to learn a gated blend of token embeddings and continuous representations while still sampling a token at every step. HybridCoT [19] generates each text block in full, compresses it into latent tokens, and keeps only LLM-annotated math spans in the context, reducing context length rather than decoding steps. In contrast, VITAL retains importance-selected tokens within every reasoning step as anchors and never decodes the remaining content as text, replacing it with latent computation. During inference, a lightweight gating head selects between explicit token generation and direct hidden-state feedback at each position. This design improves reasoning accuracy while keeping the decoding trajectory short.

Soft-Embedding Reasoning. Another line of work performs continuous reasoning by constructing soft embeddings from vocabulary distributions. Soft Thinking [30] replaces discrete token selection with a probability-weighted mixture of vocabulary embeddings. SwiReasoning [21] and SeLaR [6] dynamically switch between such soft embeddings and explicit token generation using confidence signals. These approaches operate at inference without additional training. In contrast, VITAL directly feeds back the current hidden state during latent computation, rather than constructing soft embeddings from vocabulary distributions, and learns its routing policy from hybrid trajectories constructed from explicit CoT demonstrations.

Preliminary

This section introduces the notation and the token importance estimation method used in the paper.

Notation

We denote the base causal language model by Mθ\mathcal{M}_{\theta}. For an input sequence y≤t=(y1,y2,⋯ ,yt)y_{\leq t} = (y_1, y_2, \cdots, y_t), let

Et=[e(y1),e(y2),⋯ ,e(yt)]E_t = [e(y_1), e(y_2), \cdots, e(y_t)]

be the sequence of input embeddings up to position tt, where e(⋅)e(\cdot) represents the token embedding function. We also use ete_t to represent the input embedding at position tt.

The model produces hidden states

Ht=Mθ(Et),ht=Ht[t,:],(1)H_t = \mathcal{M}_{\theta}(E_t), \qquad h_t = H_t[t,:], \tag*{(1)}

where Ht∈Rt×dH_t \in\mathbb{R}^{t \times d}, and ht∈Rdh_t \in\mathbb{R}^{d} is the hidden state at the last position. Standard next-token prediction is given by pθ(yt+1∣y≤t)=Softmax⁡(Wht)p_{\theta}(y_{t+1} \mid y_{\leq t}) = \operatorname{Softmax}(W h_t), with WW the language modeling head.

For explicit CoT output, we assume that each example consists of a question xx, a step-wise rationale c=(s1,…,sN)c = (s_1, \ldots, s_N), and a final response aa. Here sis_i is the ii-th reasoning step with tokens (si,1,si,2,⋯ ,si,Ni)(s_{i,1}, s_{i,2}, \cdots, s_{i,N_i}).

Token Importance

Not every token in the CoT output contributes the same to the response. Recently, Li et al. [11] measure the importance of output tokens using the semantic confidence of LLMs: −log⁡pϕ(yt∣y<t)-\log p_{\phi}(y_t \mid y_{<t}), where Mϕ\mathcal{M}_{\phi} is the LLM used to compute the confidence and {yi}i=1t\{y_i\}_{i=1}^{t} is the given tokens.

Despite its simplicity, Pan et al. [14] argue that there are two limitations. First, perplexity-based scores often assign lower importance to tokens near the end of a sentence. Second, causal language models rely on unidirectional attention and may fail to capture important contextual information. Authors then introduce LLMLingua-2 using a bidirectional BERT-like model [5] to estimate token importance. It utilizes GPT-4 to label whether a token is important, and trains the bidirectional model with a classification objective. The importance is measured by the predicted probability of each token: pϕ′(yi∣y≤t)p_{\phi'}(y_i \mid y_{\leq t}) with Mϕ′\mathcal{M}_{\phi'} the bidirectional model. We will treat LLMLingua-2 as a frozen scoring module and use the scores to decide which tokens serve as reasoning anchors.

VITAL: Learning When to Think Aloud

This section presents VITAL, a hybrid autoregressive reasoning framework that combines explicit symbolic reasoning and latent computation.

Overview

VITAL modifies a base language model with a lightweight gating module, enabling it to operate in a mixed symbolic-latent space. The model dynamically switches between generating explicit token in the language space or performing latent computation in the continuous hidden space.

Figure 2 illustrates the training process of VITAL. We construct hybrid trajectories from explicit rationales by identifying high-importance tokens as reasoning anchors. We train VITAL with a joint objective consisting of language modeling loss and token-wise gating loss, following a stage-wise curriculum-based procedure. Finally, we apply RL post-training to further improve the performance.

Curriculum-based supervised training for VITAL

Figure 2. Curriculum-based supervised training for VITAL. We construct hybrid reasoning trajectories from explicit CoT by identifying high-importance tokens as the anchors.

Hybrid Trajectory Construction

VITAL employs LLMLingua-2 ([14]) introduced in § 3.2 as an off-the-shelf token importance scoring model. Different from Xia et al. [27], we perform token selection individually within each reasoning step so that every step retains some symbolic anchors. This strategy helps preserve local symbolic structure. In contrast, selection over the entire CoT often results in a subset of tokens from merely one or a few reasoning steps, leading to degraded performance.

High-Importance Tokens. Concretely, for each step si={si,j}js_i = \{s_{i,j}\}_j, we use {qi,j}j\{q_{i,j}\}_j to denote corresponding importance scores. For our purpose, we pick the top-γ\gamma, γ∈(0,1)\gamma\in(0, 1) fraction of tokens in the reasoning step according to the importance score. That is, we rank the scores {qi,j}j\{q_{i,j}\}_j in a descending order, and denote by qi(γ)q_i(\gamma) the empirical γ\gamma-quantile of these importance values. Tokens with importance values greater than or equal to qi(γ)q_i(\gamma) are selected as anchor tokens:

Si={si,j∣qi,j≥qi(γ)}.(2)S_i = \{s_{i,j} \mid q_{i,j} \ge q_i(\gamma)\}. \tag*{(2)}

The rest tokens are considered to be processed through latent computation.

Hybrid Trajectory. Next, we convert each reasoning step into a mixed symbolic-latent form. In particular, consecutive “unimportant” tokens, i.e., tokens not in SiS_i, are compressed into a fixed number klatentk_{\mathrm{latent}} of special <latent> placeholders, regardless of the original length. The tokens in SiS_i are retained as ordinary tokens. This construction preserves important tokens as anchors, while less essential content is compressed into compact placeholder sequences that trigger latent computation. Figure 6 in Appendix § 10 presents an example hybrid trajectory with klatent=1k_{\mathrm{latent}} = 1.

Example of Hybrid Trajectory

Figure 6. An example of the constructed hybrid CoT.

We use s~i\tilde{s}_i to denote the symbolic-latent reasoning step. Then the hybrid trajectory is

c~=(s~1,s~2,⋯ ,s~N).(3)\tilde{c} = (\tilde{s}_1, \tilde{s}_2, \cdots, \tilde{s}_N). \tag*{(3)}

For ease of presentation, we also represent the hybrid trajectory in the form of concrete tokens, associated with binary labels whose entry indicates whether the corresponding token is explicit:

c~=(c~1,c~2,⋯ ,c~T),g~=(g~1,g~2,⋯ ,g~T),(4)\begin{aligned} \tilde{c} &= (\tilde{c}_1, \tilde{c}_2, \cdots, \tilde{c}_T),\\ \tilde{g} &= (\tilde{g}_1, \tilde{g}_2, \cdots, \tilde{g}_T), \tag*{(4)} \end{aligned}

where TT is the total number of latent placeholders and explicit tokens, and g~t=1\tilde{g}_t = 1 indicates that c~t\tilde{c}_t is the explicit token.

Model Architecture and Loss Function

We now introduce the model architecture and learning objective based on the hybrid trajectories.

Architecture. VITAL modifies the base language model by incorporating a lightweight gating head, to decide whether the subsequent token should be verbalized. Specifically, given the hidden state hth_t at the last position, we compute a gate probability with a two-layer MLP pgate(t)=σ(W2ReLU⁡(W1ht))p_{\mathrm{gate}}(t) = \sigma(W_2 \operatorname{ReLU}(W_1 h_t)), where σ(⋅)\sigma(\cdot) is the Sigmoid function. During inference, we obtain a binary routing decision zt=1[pgate(t)≥τ]z_t = 1[p_{\mathrm{gate}}(t) \ge\tau] with τ\tau a predefined threshold. zt=1z_t = 1 indicates that the next step is verbalized as an explicit token, while zt=0z_t = 0 indicates latent computation. Denote by c^t+1\hat{c}_{t+1} the generated token, which is explicit when zt=1z_t = 1.

The key mechanism of VITAL is that explicit and latent tokens correspond to different next-input representations. When zt=1z_t = 1, VITAL follows standard autoregressive decoding and feeds the embedding of the generated token c^t+1\hat{c}_{t+1}. When zt=0z_t = 0, it directly feeds back the current hidden state hth_t as the next-input embedding. Formally, the next-input embedding is given by

et+1={e(c^t+1),zt=1,ht,zt=0.(5)e_{t+1} = \begin{cases} e(\hat{c}_{t+1}), & z_t = 1, \\ h_t, & z_t = 0. \end{cases} \tag*{(5)}

This design can automatically decide when to verbalize intermediate states to steer the reasoning process. It distinguishes VITAL from prior latent reasoning methods such as Coconut, CODI, and CoLaR, where the number of latent thoughts is predetermined before generating a response.

Supervised Loss Function. We optimize a joint objective consisting of a language modeling loss and a gating loss. To facilitate the prediction of future reasoning, the anchor tokens and answer tokens are supervised, while latent placeholders are masked. Specifically, for a sequence of hybrid tokens c~={c~t}t=1T\tilde{c} = \{\tilde{c}_t\}_{t=1}^{T} and binary labels g~={g~t}t=1T\tilde{g} = \{\tilde{g}_t\}_{t=1}^{T} defined in Eq. (4), the language modeling loss is

LLM=−∑tg~tlog⁡pθ(c~t∣c~<t),(6)\mathcal{L}_{\mathrm{LM}} = - \sum_t \tilde{g}_t \log p_\theta(\tilde{c}_t \mid\tilde{c}_{<t}), \tag*{(6)}

where g~t=1\tilde{g}_t = 1 means that c~t\tilde{c}_t is the explicit anchor token while g~t=0\tilde{g}_t = 0 indicates a latent placeholder.

In addition, we supervise the routing behavior at each hybrid token, involving the gating probability pgate(t)p_{\mathrm{gate}}(t) and the binary label g~t\tilde{g}_t:

Lgate=∑tCrossEntropy⁡(g~t,pgate(t)).(7)\mathcal{L}_{\mathrm{gate}} = \sum_t \operatorname{CrossEntropy}(\tilde{g}_t, p_{\mathrm{gate}}(t)). \tag*{(7)}

The final objective is then given by

L=LLM+λLgate,(8)\mathcal{L} = \mathcal{L}_{\mathrm{LM}} + \lambda\mathcal{L}_{\mathrm{gate}}, \tag*{(8)}

where λ>0\lambda> 0 is a balancing hyper-parameter. This learning objective will be used in the following supervised training stage.

Training and Inference

We train VITAL in two phases: curriculum-based supervised training followed by RL training. During inference, VITAL performs gated autoregressive decoding in a mixed symbolic-latent space.

Curriculum-based Training. Inspired by the progressive curriculum strategy of Coconut [8], we adopt a stage-wise curriculum that gradually transitions from explicit CoT supervision to hybrid reasoning. Specifically, we construct a sequence of training trajectories with increasing degrees of hybridization. At stage kk, the first kk reasoning steps are converted into hybrid forms while remaining steps remain explicit:

c~(k)=(s~1,⋯ ,s~k,sk+1,⋯ ,sN).(9)\tilde{c}^{(k)} = (\tilde{s}_1, \cdots, \tilde{s}_k, s_{k+1}, \cdots, s_N). \tag*{(9)}

Thus, stage 0 corresponds to the original explicit CoT cc, while the final stage corresponds to the fully hybridized rationale c~\tilde{c}. At each stage, the model is trained on c~(k)\tilde{c}^{(k)} using the supervised objective in Eq. (8). The hybrid reasoning tokens are additionally enclosed by two special boundary markers, <start_hybrid> and <end_hybrid>, allowing the model to distinguish hybrid reasoning from the question prompt and the final answer.

RL Training. We can further improve VITAL’s performance using Group Relative Policy Optimization (GRPO), to explore trajectories that are correct and more concise. For each input question, we sample a group of GG hybrid reasoning trajectories and assign each trajectory a reward RiR_i combining response correctness and conciseness:

Ri=1[a^i=a][1+β(1−TiTmax⁡)],(10)R_i = 1[\hat{a}_i = a]\left[1 + \beta\left(1 - \frac{T_i}{T_{\max}}\right)\right], \tag*{(10)}

where a^i\hat{a}_i and TiT_i are the generated answer and length of the ii-th trajectory, respectively, aa is the true answer, β>0\beta> 0 is a hyper-parameter, and Tmax⁡T_{\max} is a predefined maximum length.

We normalize the rewards {Ri}i=1G\{R_i\}_{i=1}^{G} to obtain group-relative advantages. At each step, we compute the importance ratio over the sampled hybrid action. Unlike standard token-level policy ratios, here the ratio includes both the gating and token-generation probabilities for anchor actions, but only the gating probability for a latent-computation action. GRPO then updates the policy model with a clipped group-relative objective. Due to space limit, we provide the detailed formulation in Section A.

Inference Process. At inference, VITAL performs autoregressive generation in the hybrid space. The gating dynamically selects between generating an explicit anchor token or continuing latent computation. In the explicit mode, the model generates the next token via standard decoding; in the latent mode, it feeds the current hidden state back as the next input and records a <latent> marker. Once <end_hybrid> is produced, the model exits hybrid reasoning and generates the final answer. In this way, VITAL can dynamically allocate its reasoning budget within a unified autoregressive process.

Experiments

We evaluate the effectiveness of VITAL through experiments on mathematical reasoning tasks.

Experimental Setup

Training Dataset. Unless otherwise stated, we train models on GSM8K-Aug (Deng et al., [4]), a CoT augmented version of GSM8K (Cobbe et al., [2]) that provides explicit intermediate reasoning trajectories with final answers. Both supervised training and subsequent RL training are conducted on this dataset, without using additional data.

Evaluation Benchmarks. We report the experimental results on the GSM8K-Aug (Deng et al., [4]) test split, as our in-domain benchmark. To evaluate the generalized performance beyond training distribution, we also test on three out-of-domain benchmarks: (1) SVAMP (Patel et al., [15]), which evaluates robustness on arithmetic word problems with simple variations; (2) GSM8K-Hard (Gao et al., [7]), a harder GSM8K-style benchmark with increasing numerical magnitude and compositional difficulty; and (3) MultiArith (Roy and Roth, [18]), a subset of MAWPS (Koncel-Kedziorski et al., [10]) consisting of multi-step arithmetic word problems. See Section B for more dataset details.

Baselines. We consider the following baselines: (1) CoT-SFT: finetunes the model on full CoT data and performs explicit token-level reasoning at inference; (2) Coconut (Hao et al., [8]): gradually replaces explicit reasoning with latent reasoning through curriculum learning and performs reasoning via hidden-state feedback; (3) CODI (Shen et al., [20]): compresses explicit CoT into the continuous latent space through self-distillation; (4) CoLaR (Tan et al., [23]): compresses multiple reasoning tokens into latent variables and further improves latent reasoning with dynamic compression; (5) SIM-CoT (Wei et al., [26]): adds step-level supervision via an auxiliary decoder.

Implementation. For VITAL, we use the same hybrid trajectory construction throughout the paper: in each reasoning step we keep the top-γ\gamma fraction of tokens as explicit anchors and compress the remaining tokens into latent placeholders, with γ=0.2\gamma= 0.2 and klatent=1k_{\mathrm{latent}} = 1. Due to space limit, more implementation details and hyper-parameter settings are described in Appendix § 9.

Main Results

Table 1 reports the main results on GPT-2 small and Llama-3.2-1B. VITAL consistently outperforms prior fully latent baselines in terms of accuracy while maintaining comparable or improved efficiency, demonstrating the effectiveness of verbalizing high-importance tokens as reasoning anchors. The RL-trained variant, VITAL-RL, further improves performance and achieves the highest average accuracy among efficient reasoning methods.

MethodGSM8K Acc.(%)GSM8K #TokensGSM8K-Hard Acc.(%)GSM8K-Hard #TokensMulti-Arith Acc.(%)Multi-Arith #TokensSVAMP Acc.(%)SVAMP #TokensAverage Acc.(%)Average #Tokens
GPT-2
CoT-SFT42.727.69.039.185.019.641.617.645.225.9
Coconut34.18.06.98.080.78.032.08.038.48.0
CODI24.68.05.08.045.08.026.98.025.48.0
CoLaR26.812.96.316.579.48.431.36.735.911.2
SIM-CoT33.112.07.512.081.612.032.612.038.712.0
VITAL (Ours)37.211.88.614.385.06.236.36.142.19.6
VITAL-RL (Ours)38.811.48.413.585.66.836.76.142.49.4
Llama-3.2-1B
CoT-SFT49.428.311.634.397.718.452.616.252.824.3
Coconut33.28.07.08.063.38.043.78.036.88.0
CODI37.18.09.38.090.68.047.28.046.18.0
CoLaR40.112.99.014.091.37.446.56.246.710.1
SIM-CoT39.012.09.112.086.712.042.512.044.312.0
VITAL (Ours)44.211.59.712.291.67.048.35.848.59.1
VITAL-RL (Ours)46.011.49.512.292.27.048.75.949.19.1

Table 1. Main results on in-domain and out-of-domain benchmarks. Performance is measured by accuracy (Acc., %) and average reasoning length (# Tokens).

Compared with CoT-SFT, VITAL-RL attains comparable average accuracy with substantially shorter reasoning traces. It reduces the average reasoning length from 25.9 to 9.4 tokens on GPT-2 and from 24.3 to 9.1 tokens on Llama-3.2-1B. Notably, on MultiArith with GPT-2, VITAL-RL achieves an accuracy of 85.6% with only 6.8 average tokens.

Comparison with Hybrid Methods

We further evaluate VITAL against hybrid reasoning methods on more diverse and challenging benchmarks. Specifically, we train VITAL with Qwen3-1.7B on the training splits of GSM8K-Aug-NL (Deng et al., [4]; Shen et al., [20]) and MATH (Hendrycks et al., [9]), and evaluate it on their test splits, MATH-500 (Lightman et al., [12]), and ARC-C (Clark et al., [1]). These experiments extend our evaluation beyond equation-centric GSM8K-Aug setting to natural-language mathematical reasoning, more challenging mathematical problems, and science reasoning. We compare VITAL with CoT-SFT, HRPO (Yue et al., [29]), and Token Assorted (Su et al., [22]), reporting answer accuracy and total reasoning length, which includes explicit tokens and latent steps.

For VITAL-RL, we use a binary correctness reward Ri=1[a^i=a]R_i = \mathbb{1}[\hat{a}_i = a]. We omit the length penalty to avoid explicitly favoring shorter reasoning trajectories in this comparison, since these two hybrid methods generally have much longer reasoning trajectories than fully latent methods.

As shown in Table 2, VITAL produces the shortest trajectories, albeit with lower average accuracy than the baselines. RL training substantially improves accuracy across all four benchmarks, increasing average accuracy from 41.6% to 50.8%, with only 7.7% increase in average reasoning length (from 89.3 to 96.2). Compared with Token Assorted, VITAL-RL achieves higher accuracy with shorter trajectories on all four benchmarks. It also outperforms HRPO in terms of accuracy on three of the four benchmarks while maintaining shorter trajectories on all the benchmarks.

MethodGSM8K-NL Acc.(%)GSM8K-NL #TokensMATH Acc.(%)MATH #TokensMATH500 Acc.(%)MATH500 #TokensARC-C Acc.(%)ARC-C #TokensAverage Acc.(%)Average #Tokens
Qwen3-1.7B
CoT-SFT69.581.835.6321.135.0302.757.6541.749.4311.8
HRPO64.5110.227.6763.226.0765.153.7464.243.0525.7
Token Assorted60.173.926.9183.427.6253.466.088.345.2149.8
VITAL (Ours)53.532.523.4136.626.2120.163.267.841.689.3
VITAL-RL (Ours)62.537.734.4140.334.8136.571.670.350.896.2

Table 2. Results on Qwen3-1.7B. Acc.(%) denotes final-answer accuracy, and #Tokens denotes average reasoning length, including both explicit tokens and latent steps.

Analysis of Generated Tokens

To better understand what VITAL selectively verbalizes, we compare the token-category distributions of its explicit outputs on Qwen3-1.7B with those of full CoT. As shown in Figure 3, numerical tokens account for a substantially larger proportion

Figure 3. Token-category distributions of full CoT and VITAL on GSM8K-NL (Qwen3-1.7B).

of VITAL’s explicit outputs, while function words, punctuation, and other general textual content are less prevalent. This suggests that VITAL does not merely generate shortened natural language rationales, but instead prioritizes compact numerical and symbolic information in its explicit outputs.

Robustness to Error Accumulation

As discussed in Zou et al. [31], small errors can accumulate when the continuous states are repeat- @bibliography edly propagated in fully latent reasoning methods. In contrast, explicit CoT is more robust as it discretizes intermediate states into concrete tokens. To evaluate the robustness of VITAL against error accumulation, we use a similar setting from Zou et al. [31] and inject Gaussian noise into the hidden states during the reasoning process. Figure 4 reports the performance degradation under different noise intensity on Llama-3.2-1B. In comparison with the fully latent CoT method Coconut, emitting explicit tokens as reasoning anchors clearly improves the robustness to noises, validating the effectiveness of VITAL.

Figure 4. Performance degradation under noise injection. We inject Gaussian noise N(0,σ2Id)\mathcal{N}(0,\sigma^{2}I_d) to the hidden states during reasoning and report the accuracy result of GSM8K on Llama-3.2-1B.

Ablation Study

Anchor Selection. To further investigate the contribution of important tokens to the performance gains of VITAL, we compare three token-selection strategies using Qwen3-1.7B: highest-importance selection (used by VITAL); random selection, and lowest-importance selection.

Table 3 reports the accuracy results on GSM8K-Aug, GSM8K-Hard, MultiArith, and SVAMP. Highest-importance selection outperforms both alternatives on all four benchmarks. Random selection obtains smaller average gains over Coconut, whereas the performance of lowest-importance selection performs is close to Coconut. This result highlights the effectiveness of importance-guided anchor selection, suggesting that the choice of verbalized tokens matters more than merely introducing explicit tokens.

MethodGSM8K-AugGSM8K-HardMultiArithSVAMPAvg.
SFT69.136.598.977.571.3
Coconut60.225.397.265.462.0
Lowest59.225.197.866.162.1
Random62.828.297.867.864.1
VITAL64.130.198.369.265.4

Table 3. Accuracy (%) on four benchmarks. VITAL uses highest-importance tokens as reasoning anchors.

Top-γ\gamma Ratio. We study how the top-γ\gamma ratio in hybrid trajectory construction affects reasoning performance. Specifically, we vary γ\gamma in {0.2,0.4,0.6,\{0.2, 0.4, 0.6,

0.8,1.0}0.8, 1.0\}, where larger values retain more tokens as reasoning anchors and smaller values enable greater latent compression. As shown in Figure 5, increasing γ\gamma generally improves accuracy, as more information is preserved in explicit anchors. However, this also increases the reasoning length. Overall, γ=0.2\gamma= 0.2 appears to achieve the best trade-off, retaining sufficient anchors for stable reasoning while keeping most computation latent.

Figure 5. Ablation on the top-γ\gamma ratio. We vary the proportion of explicit anchors and evaluate its effect.

Concluding Remarks

We propose VITAL, a hybrid reasoning framework that learns when to think aloud and when to remain silent. VITAL selectively verbalizes informative tokens as anchors for latent reasoning. It introduces a lightweight gating head to the base language model. For training, we construct hybrid trajectories from explicit rationales, followed by a two-stage training process consisting of curriculum-based supervised training and RL training. Experiments show that VITAL consistently outperforms existing fully latent reasoning methods at comparable reasoning lengths. Compared with hybrid baselines, VITAL achieves higher reasoning accuracy with substantially shorter reasoning trajectories. These results validate the effectiveness of importance-guided selective verbalization in improving the accuracy-length trade-off of latent reasoning.

Limitations

In this paper, the largest model on which we conduct supervised training is Llama-3.2-3B-Instruct (see Appendix § 11). Due to limited GPU resources, we are not able to complete RL training at this scale, and our RL results are limited to smaller models. Another limitation is on the choice of reasoning anchors. The present work considers only the “important” tokens in the original explicit CoT trajectories, and the proposed method is effective in improving the accuracy-length trade-off for latent reasoning. Yet, we do not investigate other forms of reasoning anchors. Future work can explore suitable hidden embeddings or other supervision signals as the reasoning anchors.

Ethics Impact

The proposed method VITAL is designed to improve both reasoning performance and efficiency. Part of the reasoning process is performed in latent space, and the generated rationales may expose only a few explicit anchor tokens rather than the full internal reasoning trajectory. This may make model behavior less transparent than fully explicit CoT in some settings. Therefore, VITAL should be used with appropriate task-specific evaluation and safety checks before deployment in high-stakes applications. We will also release our code to facilitate future research on efficient and transparent LLM reasoning.

RL Training Details

Following the reward defined in Eq. (10), we estimate the advantage through group-relative reward normalization. The advantage of the ii-th trajectory is given by

Ai=Ri−mean⁡({Ri}i=1G)std⁡({Ri}i=1G)A_i = \frac{R_i-\operatorname{mean}(\{R_i\}_{i=1}^{G})}{\operatorname{std}(\{R_i\}_{i=1}^{G})}

At each step tt, we compute the importance ratio over the sampled hybrid action. Let zi,tz_{i,t} denote the binary decision of the gating function in the ii-th trajectory and c^i,t\hat{c}_{i,t} the explicit token with zi,t=1z_{i,t}=1. Then we define the hybrid action as:

yi,t={(zi,t,c^i,t),zi,t=1,zi,t,zi,t=0.y_{i,t} = \begin{cases} (z_{i,t},\hat{c}_{i,t}), & z_{i,t}=1,\\ z_{i,t}, & z_{i,t}=0. \end{cases}

The policy probability of a hybrid action depends on whether the action corresponds to explicit anchor generation or latent computation, which is

πθ(yi,t∣x,yi,<t)={pgate,θ(t)pθLM(c^i,t∣x,yi,<t),zi,t=1,1−pgate,θ(t),zi,t=0,\pi_{\theta}(y_{i,t}\mid x,y_{i,<t}) = \begin{cases} p_{\mathrm{gate},\theta}(t)p_{\theta}^{\mathrm{LM}}(\hat{c}_{i,t}\mid x,y_{i,<t}), & z_{i,t}=1,\\ 1-p_{\mathrm{gate},\theta}(t), & z_{i,t}=0, \end{cases}

and the importance ratio is defined as

ρi,t=πθ(yi,t∣x,yi,<t)πθold(yi,t∣x,yi,<t)\rho_{i,t}=\frac{\pi_{\theta}(y_{i,t}\mid x,y_{i,<t})}{\pi_{\theta_{\mathrm{old}}}(y_{i,t}\mid x,y_{i,<t})}

where πθ\pi_{\theta} and πθold\pi_{\theta_{\mathrm{old}}} are the current and old policy models, xx is the input question, yi,ty_{i,t} is the hybrid action corresponding to either anchor generation or latent computation, and yi,<ty_{i,<t} is the ii-th trajectory before the tt-th step. GRPO then minimizes the clipped policy loss:

LGRPO=−1G∑i=1G∑t=1Timin⁡(ρi,tAiTi,clip⁡(ρi,t,1−ϵ,1+ϵ)AiTi)\mathcal{L}_{\mathrm{GRPO}}=-\frac{1}{G}\sum_{i=1}^{G}\sum_{t=1}^{T_i}\min\left(\rho_{i,t}\frac{A_i}{T_i},\operatorname{clip}(\rho_{i,t},1-\epsilon,1+\epsilon)\frac{A_i}{T_i}\right)

where ϵ\epsilon is a clipping hyperparameter and TiT_i is the length of the ii-th reasoning trajectory. Here we also remove the KL-regularization term from original GRPO for efficient training, following [28, 23].

Datasets

We provide examples and statistics of the training datasets and evaluation benchmarks.

Examples

GSM8k-Aug

Question = "Out of 600 employees in a company, 30% got promoted while 10% received bonus. How many employees did not get either a promotion or a bonus?"

CoT = "«60030/100=180»«60010/100=60» «180+60=240»«600-240=360»"

Answer = "360"

GSM-Hard

Question = "Marie ordered one chicken meal that costs $12, 5 packs of milk that costs $3 each, 4 apples that cost $1.3299286 each, and some boxes of pizza. Marie paid a total of $3299286. How many boxes of pizza did Marie order if each box costs $8.3299286?"

Answer = "388147.4117647059"

MultiArith

Question = "A waiter at ’The Greasy Spoon’ restaurant had 26 customers to wait on. During the lunch rush he added another 27 customers. If 27 of the customers didn’t leave him a tip, how many customers did leave a tip?"

Answer = "26"

SVAMP

Question = "Paul got a box of some crayons for his birthday. During the school year he gave 52 crayons to his friends while he lost 535 crayons. If he only had 492 crayons left, how many crayons had been lost or given away?"

Answer = "587.0"

Dataset Statistics

The statistics of the training data are shown in Table 4, and the statistics of the evaluation benchmarks are shown in Table 5.

Training DatasetNum. DataAvg. CoT Tokens
GSM8K-Aug385,62020.3

Table 4. Training data statistics.

BenchmarkTypeData Size
GSM8K-AugIn-domain1,319
GSM8K-HardOut-of-domain1,319
SVAMPOut-of-domain1,000
MultiArithOut-of-domain500

Table 5. Evaluation benchmark statistics.

Implementation Details

General Setup

We evaluate VITAL on three backbones: GPT-2, Llama-3.2-1B, and Llama-3.2-3B. All models are trained solely on GSM8K-Aug. To ensure a fair comparison, all compared methods adopt the same training dataset and evaluation protocol. Due to limited computing resources, each dataset-level result is obtained from a single run unless otherwise stated. GPT-2 (Radford et al., [16]) and Llama-3.2-1B are trained in fp32 precision, while Llama-3.2-3B (Meta, [13]) is trained in bf16 precision.

We measure reasoning efficiency by the average reasoning chain length (# Tokens). We count only the tokens within the reasoning chain, i.e., the explicit anchor tokens together with the <latent> placeholders, and exclude the question and the final answer tokens.

Setup of VITAL

Hybrid Trajectory Construction. We employ LLMLingua-2 (Pan et al., [14]) as a frozen token-importance scoring module. Within each reasoning step, we retain the top-γ\gamma fraction of tokens as explicit anchors with γ=0.2\gamma= 0.2, and compress each segment of consecutive non-anchor tokens into klatent=1k_{\mathrm{latent}} = 1 <latent> placeholder. The hybrid reasoning tokens are enclosed by the special markers <start_hybrid> and <end_hybrid>.

Gating and Loss. At inference, a token is generated explicitly when the gate probability exceeds the threshold τ=0.5\tau= 0.5. The training objective combines the language-modeling loss and the gating loss with a balancing weight λ=0.1\lambda= 0.1.

RL Training. After supervised training, we further optimize VITAL with GRPO. We pick group size G=32G = 32, conciseness weight β=0.5\beta= 0.5 for the reward, clipping parameter ϵ=0.2\epsilon= 0.2, and a learning rate of 5×10−65 \times10^{-6}.

Setup of Baseline Methods

We reproduce the baseline methods following their default configurations reported in the papers.

Coconut (Hao et al., [8]): We use a fixed learning rate of 1×10−41 \times10^{-4} and represent each reasoning step with 2 continuous thoughts. A multi-stage curriculum progressively converts explicit reasoning steps into latent thoughts. The model is trained for 3 epochs in each stage except the last stage.

CODI (Shen et al., [20]): We use the AdamW optimizer with a cosine learning-rate schedule, linear warm-up over the first 3% training steps, an effective batch size of 128. The model uses 6 continuous thoughts, and the distillation objective weights are set to be 1 for both the student and distillation terms. The learning rate is 3×10−33 \times10^{-3} with 40 epochs for GPT-2 and 8×10−48 \times10^{-4} with 10 epochs for Llama-3.2-1B.

CoLaR (Tan et al., [23]): We use the AdamW optimizer with a weight decay of 10−210^{-2} and a learning rate of 1×10−41 \times10^{-4} for supervised fine-tuning. The latent head is a three-layer MLP, the maximum compression factor is 5, and the finetuning batch size is 256.

SIM-CoT (Wei et al., [26]): SIM-CoT is a plug-and-play step-level supervision module that introduces an auxiliary decoder during training, which is removed at inference. It is applied on top of Coconut and CODI, inheriting their respective configurations above. We use Adam (β1=0.9\beta_1 = 0.9, β2=0.999\beta_2 = 0.999 and weight decay 0.1) optimizer and set batch size to 128 for GPT-2 and Llama-3.2-1B.

Summary of Hyperparameters

Table 6 summarizes the key hyperparameters of VITAL, and Table 7 summarizes the configurations of baselines.

MethodModelLREpochs
CoconutGPT-21×10−41 \times10^{-4}20
Llama-3.2-1B8×10−48 \times10^{-4}20
Llama-3.2-3B8×10−48 \times10^{-4}20
CODIGPT-23×10−33 \times10^{-3}40
Llama-3.2-1B8×10−48 \times10^{-4}10
Llama-3.2-3B8×10−48 \times10^{-4}10
CoLaRGPT-21×10−41 \times10^{-4}50
Llama-3.2-1B1×10−41 \times10^{-4}50
Llama-3.2-3B1×10−41 \times10^{-4}50

Table 7. Configurations of the baselines. All models are trained for the specified number of epochs or 50 hours, whichever is reached first.

HyperparameterValue
Anchor ratio γ\gamma0.2
Latent placeholders klatentk_{\mathrm{latent}}1
Gating threshold τ\tau0.5
Loss weight λ\lambda0.1
Curriculum stages3
Epochs per stage3
RL group size GG32
RL reward coefficient α\alpha0.5
RL clipping ϵ\epsilon0.2
RL learning rate5×10−65 \times10^{-6}

Table 6. Hyperparameters of VITAL.

Computing Budget. All the experiments are conducted on a compute node with 2 NVIDIA H800 80GB GPUs. For supervised training, the GPT-2, Llama-3.2-1B, and Llama-3.2-3B experiments require approximately 6, 40, and 100 hours, respectively.

An Example of Constructed Hybrid CoT.

Figure 6 shows an example hybrid trajectory with klatent=1k_{\mathrm{latent}} = 1.

Additional Results on Larger Backbones

To examine whether VITAL remains effective on a larger model, we consider Llama-3.2-3B with the same GSM8K-Aug setting as in Table 1 and compare VITAL against CoT-SFT and the latent baselines Coconut, CODI, and CoLaR. Due to limited computational resources, we report results for the supervised model only and do not perform RL training at this scale. The results are reported in Table 8.

MethodIn-domainOut-of-domainOverall
GSM8K-AugGSM8K-HardMultiArithSVAMPAverage
Acc. (%)# TokensAcc. (%)# TokensAcc. (%)# TokensAcc. (%)# TokensAcc. (%)# Tokens
CoT-SFT55.428.512.735.796.717.661.014.556.524.0
Coconut36.78.08.78.090.58.037.88.043.48.0
CODI47.28.011.28.093.28.056.58.052.08.0
CoLaR45.413.510.140.496.37.351.86.051.116.8
VITAL52.211.911.610.297.26.155.25.154.18.3

Table 8. Experimental results on Llama-3.2-3B. Accuracy and average reasoning chain length are reported across in-domain and out-of-domain benchmarks.

On Llama-3.2-3B, VITAL continues to provide a favorable accuracy-length trade-off. It achieves 54.1% average accuracy with 8.3 reasoning steps, outperforming the strongest latent baseline, CODI, by 2.1 percentage points at a similar reasoning length. Compared with CoLaR, it improves average accuracy by 3.0 percentage points while reducing the average reasoning length from 16.8 to 8.3. Compared with CoT-SFT, VITAL is only 2.4 percentage points lower in average accuracy while using 34.6% of its reasoning length.

Artifact Licenses and Responsible Use

Artifacts. This work uses existing public datasets, pretrained models, and baseline methods. The datasets include GSM8K-Aug, GSM8K-Hard, MultiArith, SVAMP, and CommonsenseQA. The pretrained backbones include GPT-2 and Llama-3.2 models. We also use LLMLingua-2 as a frozen token-importance scorer and compare our method with prior latent reasoning baselines including Coconut, CODI, CoLaR, and SIM-CoT.

Licenses and Terms of Use. We use these artifacts for research and benchmarking purposes. We check the licenses and terms of use of the public artifacts used in our experiments. GSM8K is released under the MIT License, GPT-2 is released under a modified MIT License, and CommonsenseQA is distributed under the MIT License according to its dataset card. Llama-3.2 models are used under the Llama-3.2 Community License and its acceptable use policy. For all artifacts, we follow their intended research use and do not redistribute any restricted model weights or data beyond what is permitted by the corresponding licenses.

Intended Use. The intended use of our experiments is to study efficient reasoning in language models. The derived models and experimental results are intended for research evaluation only. They should not be used directly in high-stakes domains such as medical, legal, financial, or safety-critical decision making without additional validation and safeguards.

Privacy and Offensive Content. We do not collect new user data and do not conduct human-subject data collection. The datasets used in this work are existing public benchmarks. They consist primarily of mathematical word problems and multiple-choice commonsense questions. We do not intentionally use personally identifying information. However, as with many public NLP datasets, we cannot completely rule out the presence of unintended sensitive or biased content. We therefore restrict our use of these datasets to research evaluation and report aggregate benchmark results only.

References

  1. [1]Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018. Think you have solved question answering? try arc, the ai2 reasoning challenge. arXiv preprint arXiv:1803.05457.arxiv.org/abs/1803.05457
  2. [2]Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reichiro Nakano, Christopher Hesse, and John Schulman. 2021. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168.arxiv.org/abs/2110.14168
  3. [3]Yuntian Deng, Yejin Choi, and Stuart Shieber. 2024a. From explicit cot to implicit cot: Learning to internalize cot step by step. arXiv preprint arXiv:2405.14838.arxiv.org/abs/2405.14838
  4. [4]Yuntian Deng, Yejin Choi, and Stuart Shieber. 2024b. From explicit CoT to implicit CoT: Learning to internalize CoT step by step. arXiv preprint arXiv:2405.14838.arxiv.org/abs/2405.14838
  5. [5]Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).arxiv.org/abs/1810.04805
  6. [6]Renyu Fu and Guibo Luo. 2026. Selar: Selective latent reasoning in large language models. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).
  7. [7]Luyu Gao, Aman Madaan, Shuyan Zhou, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023. PAL: Program-aided language models. In International Conference on Machine Learning.arxiv.org/abs/2211.10435
  8. [8]Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason Weston, and Yuandong Tian. 2025. Training large language models to reason in a continuous latent space. In Conference on Language Modeling.arxiv.org/abs/2412.06769
  9. [9]Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021. Measuring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874.
  10. [10]Rik Koncel-Kedziorski, Subhro Roy, Aida Amini, Nate Kushman, and H. Hajishirzi. 2016. MAWPS: A math word problem repository. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
  11. [11]Yucheng Li, Bo Dong, Frank Guerin, and Chenghua Lin. 2023. Compressing context to enhance inference efficiency of large language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing.arxiv.org/abs/2310.06201
  12. [12]Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024. Let’s verify step by step. In International Conference on Learning Representations, volume 2024, pages 39578–39601.arxiv.org/abs/2305.20050
  13. [13]Meta. 2024. Llama 3.2: Revolutionizing edge AI and vision with open, customizable models. Meta AI Blog. https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/.
  14. [14]Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, and Dongmei Zhang. 2024. LLMLingua-2: Data distillation for efficient and faithful task-agnostic prompt compression. In Findings of the Association for Computational Linguistics: ACL 2024.arxiv.org/abs/2403.12968
  15. [15]Ark il Patel, Satwik Bhattamishra, and Navin Goyal. 2021. Are NLP models really able to solve simple math word problems? In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
  16. [16]Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners.
  17. [17]Keshav Ramji, Tahira Naseem, and Ramón Fernandez Astudillo. 2026. Thinking without words: Efficient latent reasoning with abstract chain-of-thought. arXiv preprint arXiv:2604.22709.arxiv.org/abs/2604.22709
  18. [18]Subhro Roy and Dan Roth. 2015. Solving general arithmetic word problems. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.arxiv.org/abs/1608.01413
  19. [19]Shannon Zejiang Shen, Rulin Shao, Chenyu Wang, Songlin Yang, Vincent-Pierre Berges, Gargi Ghosh, Pang Wei Koh, Luke Zettlemoyer, Yoon Kim, Jason E Weston, David Sontag, and Wen tau Yih. 2026. Hydridcot: Interleaving latent and text chain-of-thought for efficient reasoning.
  20. [20]Zhenyi Shen, Hanqi Yan, Linhai Zhang, Zhanghao Hu, Yali Du, and Yulan He. 2025. CODI: Compressing chain-of-thought into continuous space via self-distillation. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing.arxiv.org/abs/2502.21074
  21. [21]Dachuan Shi, Abdelkadir Asi, Keying Li, Xiangchi Yuan, Liyan Pan, Wenke Lee, and Wen Xiao. 2026. Swireasoning: Switch-thinking in latent and explicit for pareto-superior reasoning llms. In International Conference on Learning Representations, volume 2026, pages 137060–137093.arxiv.org/abs/2510.05069
  22. [22]Di Jia Su, Hanlin Zhu, Yingchen Xu, Jiantao Jiao, Yuan-dong Tian, and Qinqing Zheng. 2025. Token assorted: Mixing latent and text tokens for improved language model reasoning. In Forty-second International Conference on Machine Learning.arxiv.org/abs/2502.03275
  23. [23]Wenhui Tan, Jiaze Li, Jianzhong Ju, Zhenbo Luo, Ruihua Song, and Jian Luan. 2025. Think silently, think fast: Dynamic latent compression of llm reasoning chains. In The Thirty-ninth Annual Conference on Neural Information Processing Systems.arxiv.org/abs/2505.16552
  24. [24]Qwen Team. 2025. Qwen3 technical report. arXiv preprint arXiv:2505.09388.
  25. [25]Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022. Chain of thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems.arxiv.org/abs/2201.11903
  26. [26]Xilin Wei, Xiaoran Liu, Yuhang Zang, Xiaoyi Dong, Yuhang Cao, Jiaqi Wang, Xipeng Qiu, and Dahua Lin. 2026. SIM-CoT: Supervised implicit chain-of-thought. In The Fourteenth International Conference on Learning Representations.arxiv.org/abs/2509.20317
  27. [27]Heming Xia, Chak Tou Leong, Wenjie Wang, Yongqi Li, and Wenjie Li. 2025. Tokenskip: Controllable chain-of-thought compression in LLMs. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing.arxiv.org/abs/2502.12067
  28. [28]Qiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan, Xia-ochen Zuo, Yu Yue, Weinan Dai, Tiantian Fan, Gao-hong Liu, Juncai Liu, Lingjun Liu, Xin Liu, Haibin Lin, Zhiqi Lin, Bole Ma, Guangming Sheng, Yuxuan Tong, Chi Zhang, Mofan Zhang, and 17 others. 2025. DAPO: An open-source LLM reinforcement learning system at scale. In The Thirty-ninth Annual Conference on Neural Information Processing Systems.arxiv.org/abs/2503.14476
  29. [29]Zhenrui Yue, Bowen Jin, Huimin Zeng, Honglei Zhuang, Zhen Qin, Jinsung Yoon, Lanyu Shang, Jiawei Han, and Dong Wang. 2025. Hybrid latent reasoning via reinforcement learning. In The Thirty-ninth Annual Conference on Neural Information Processing Systems.arxiv.org/abs/2505.18454
  30. [30]Zhen Zhang, Xuehai He, Weixiang Yan, Ao Shen, Chenyang Zhao, and Xin Wang. 2025. Soft thinking: Unlocking the reasoning potential of LLMs in continuous concept space. Advances in Neural Information Processing Systems.arxiv.org/abs/2505.15778
  31. [31]Jiaxuan Zou, Yaozhong Xiong, and Yong Liu. 2026. Capabilities and fundamental limits of latent chain-of-thought. arXiv preprint arXiv:2602.01148.arxiv.org/abs/2602.01148

Paper details

vlnc:W_fw3m5ee7
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents