alphaFeedback

WorksComputer Science

PhysEvolve: Verifier-grounded Self-evolution for Physical Reasoning with Executable Worlds

AI contributions
Not recorded for this paper
View details
Ancillary data
1 code link
View

Abstract

Physical reasoning underpins how embodied systems understand and act in the physical world, yet vision-language models (VLMs) remain unreliable on questions about dynamics and physical causality. Progress is critically constrained by the scarcity of grounded counterfactual training data, as observational videos capture only the factual trajectory that occurred. The self-evolving paradigm offers a route beyond fixed datasets by enabling models to construct their own training problems. Extending this paradigm to physics, however, requires an external source of truth that can both validate model-proposed environments and verify alternative physical outcomes under intervention. We introduce \physevolve{}, a verifier-grounded self-evolving framework that trains VLMs for causal physical reasoning from model-proposed executable worlds and simulation-authored tasks. At each round, a shared VLM proposes executable world programs and evidence schemas; a deterministic physics engine freezes each valid world, simulates matched baseline and body-elided counterfactual branches, and synthesizes discrete, answer-bound visual tasks. Exact verifier feedback from task solving updates both the shared policy via GRPO and an adaptive curriculum over physical intents. Starting from Qwen3-VL-8B-Instruct, \physevolve{} achieves targeted gains across PhysBench, CausalPhys, and ContPhy without human intervention data, improving PhysBench Throwing by 8.88.8 points and ContPhy Counterfactual Removal and Goal-Pit by 7.47.4 and 24.424.4 points. These gains concentrate on interaction-sensitive and altered-world questions, demonstrating zero-shot transfer of causal principles to unseen complex dynamics (cloth, fluid, soft bodies) and real-world video.

Introduction

Multimodal understanding of the physical world is foundational to embodied intelligence and robotic systems, where reliable decision-making requires anticipating how scenes evolve and respond to external interventions [8] (Zhou et al. 2026). Yet current vision-language models (VLMs) remain substantially less reliable on physical dynamics, intervention effects, and counterfactual outcomes than on static object recognition or spatial relations [12, 36, 51], and broader multimodal reasoning benchmarks echo the same reliability gap on structured logical inputs [46]. Closing this gap is fundamentally bottlenecked by training data: high-quality, verifiably annotated examples that isolate how physical outcomes change under controlled interventions are exceptionally scarce. Real-world videos are not only costly to annotate, but fundamentally capture only the factual trajectory that occurred, rendering counterfactual alternatives unobservable [32].

A growing paradigm of self-evolving systems circumvents static data bottlenecks by enabling models to autonomously generate the problems from which they learn [49, 44, 18]. The viability of this paradigm hinges on an external source of truth that can independently validate self-generated problems and verify their correct answers as the training distribution shifts. In symbolic domains such as mathematics and code, an interpreter provides this exact supervision: a Proposer generates an executable specification, the interpreter computes its deterministic output, and exact correctness supplies the Solver’s learning signal. Physics simulators offer a natural counterpart for the physical world by executing proposed environments and exposing their complete internal states [33]. This analogy suggests an appealingly direct route to physical self-play: retain the proposer–solver curriculum and substitute a physics simulator for the symbolic interpreter.

However, naively mapping this paradigm to physical reasoning reveals a fundamental structural breakdown (Figure 1). When a shared Proposer–Solver policy proposes rigid-body scenes and evaluates a single simulated trajectory using continuous proximity scores, two failure modes emerge (§ 3.1): (1) single-trajectory readouts cannot construct or verify intervention tasks, starving the curriculum of causal supervision; and (2) continuous proximity rewards inflate learnability signals for uniformly incorrect rollouts, inducing reward hacking without improving exact physical correctness. These findings establish two indispensable requirements for physical self-play: the verification environment must actively execute interventions across paired branches, and derived visual tasks must be bound to discrete, exact ground truth.

Naive self-play baseline for physical reasoning

Figure 1. Naive self-play baseline for physical reasoning. A Proposer generates a world program; the executor simulates a single trajectory and derives Forward, Inverse, and Parameter tasks. Graded continuous proximity can reward a Solver that remains fundamentally incorrect, broadcasting distorted learnability signals back to the Proposer.

We introduce PhysEvolve, a verifier-grounded self-evolving framework that learns causal physical reasoning from policy-proposed executable worlds and simulation-authored tasks (Figure 2). Rather than authoring text questions directly, a task-conditioned Proposer generates an executable world program and an evidence schema. A deterministic physics executor validates and freezes the scene, executes matched baseline and body-elided counterfactual branches under identical initial conditions, and derives an answer-bound question from their divergent outcomes. The shared VLM then solves the task from the baseline video, receiving exact discrete feedback. This architecture establishes a strict information boundary: the policy guides the exploration of physical environments, while the fixed simulator alone determines physical validity and factual/counterfactual ground truth. The resulting exact solver feedback simultaneously drives shared-policy updates via GRPO and guides an adaptive curriculum over physical reasoning intents.

Overview of PhysEvolve

Figure 2. Overview of PhysEvolve. A shared VLM proposes an executable world program and evidence schema. A fixed deterministic executor validates and freezes the scene, simulates matched baseline and body-elided branches when required, and synthesizes an answer-bound item. Exact discrete Solver feedback updates the shared policy and the curriculum.

Training on executor-synthesized tasks over policy-proposed worlds produces targeted transfer across three physical-reasoning benchmarks without any human-annotated intervention data. Starting from Qwen3-VL-8B-Instruct [3], PhysEvolve improves PhysBench Throwing by 8.78 percentage points and Judgement by 5.08 points. Crucially, on ContPhy, performance on Counterfactual Removal and Goal-Pit increases by 7.38 and 24.44 points, transferring causal intervention principles zero-shot to held-out continuous media (cloth, fluid, rope, and soft bodies) entirely absent from the rigid-body training templates. On real-world videos in CausalPhys, PhysEvolve likewise achieves consistent gains on Anticipation (+2.46) and Intervention (+2.27).

Our core contributions are summarized as follows:

  1. Verifier-grounded physical self-play: We present PhysEvolve, the first self-evolving framework that trains VLMs for causal physical reasoning via model-proposed executable worlds, enforcing a strict information boundary between policy exploration and deterministic simulator verification.

  2. Intervention-grounded task synthesis: We introduce an execution pipeline that executes matched baseline and body-elided branches under identical seeds, transforming continuous multi-body dynamics into discrete, answer-bound multi-choice tasks with exact verifier rewards.

  3. Out-of-distribution causal transfer & audit: We demonstrate that self-play on rigid-body programs transfers zero-shot to complex continuous dynamics and real-world video, and provide an empirical audit exposing why naive single-trajectory physical self-play fundamentally collapses.

Related Work

Physical reasoning in vision-language models. Extensive studies reveal that current multimodal models handle static visual appearance and geometric arrangements far more reliably than temporal prediction, physical intervention, and counterfactual reasoning [34, 7, 38, 45, 2, 12, 36]. Broader multimodal reasoning benchmarks further expose that vision-language models remain unreliable on structured logical reasoning [46], motivating verifiable, grounded supervision rather than perception-only training. To diagnose physical understanding beyond passive prediction, counterfactual benchmarks introduce paired simulator-generated alternative trajectories and intervention questions [5, 11, 31]. Recently, simulator-grounded training has emerged to convert simulation traces into verifiable supervision: notably, Sim2Reason synthesizes physics QA pairs from predefined simulator rollouts and filters shortcut solutions [33]. Unlike offline trajectory-to-QA pipelines, PhysEvolve autonomously synthesizes verifiable counterfactual supervision online by executing paired intervention branches over active, policy-proposed physical worlds.

Self-evolving agents and environment co-design. While standard self-training bootstraps reasoning over fixed problem sets [48, 19], self-evolving agents generate the very curricula and environments from which they learn. Absolute Zero pioneered shared-policy proposer–solver self-play with code interpreters [49], inspiring subsequent frameworks to expand task substrates across multi-agent debates, geometric spaces, games, and tool-augmented execution [21, 9, 44, 28, 42, 20, 39, 26]. A complementary line of modular and agentic multimodal systems—spanning visual-to-code generation, agentic coding for games, search-augmented image generation, multimodal deep search, agentic perception, and failure-aware software repair—demonstrates that decomposing perception, planning, and execution into verifiable sub-routines scales reliably across complex tool-use environments (Jiang et al., 2026b;a; Feng et al., 2026a; Jiao et al., 2026; Fan et al., 2026). In parallel, unsupervised environment design (UED) co-evolves adaptive environments alongside control policies based on learner regret or progress [41, 14, 30, 47, 27]. While existing self-play frameworks operate primarily in discrete symbolic spaces, PhysEvolve shifts the frontier of self-evolution to continuous multi-body physics, delegating the physical environment proposal to the policy while retaining deterministic verification and task synthesis within the executor.

Reinforcement learning with verifiable rewards. Reinforcement learning with verifiable rewards (RLVR) substitutes brittle, exploitable learned reward models with deterministic, ground-truth verifiers in domains admitting objective computation [13, 25]. Verification methods have expanded from exact answer matching and test-suite execution to hybrid dense-sparse rewards, self-consistency checks, and formal proof checking [37, 50, 43]. Recent multimodal RL work further studies reward design under heterogeneous or competing objectives, including multi-task visual reasoning with moving-average reward normalization, thinking-with-image video reward models, and reasoning reward models for agents [17, 40, 15]. While RLVR has achieved remarkable success in mathematical deduction and program synthesis, extending objective verification to multimodal physical reasoning has remained an open challenge. PhysEvolve realizes RLVR for multimodal physics by grounding policy updates in discrete, simulation-verified causal outcomes rather than heuristic continuous proximity metrics.

Methodology

We introduce PhysEvolve, a verifier-grounded self-evolving framework that learns causal physical reasoning by having a shared vision–language policy propose executable worlds while a deterministic physics executor authors and verifies derived multimodal tasks. Below, § 3.1 first diagnoses the structural pitfalls of naively transferring code self-play to physical reasoning and establishes two necessary design principles. § 3.2–§ 3.5 then detail the framework architecture, the task-conditioned proposer, the intervention-grounded task synthesis pipeline, and the hierarchical co-evolution training loop.

Problem Formulation and Pitfalls of Naive Physical Self-Play

In discrete symbolic domains such as mathematics and code synthesis, self-play enables models to surpass fixed data limits by autonomously generating and solving their own problems [49]. The policy evolves by optimizing a learnability reward that dynamically prioritizes tasks near the boundary of its current competence. The viability of this paradigm stems from its objectivity: a deterministic interpreter executes model-written specifications and returns exact correctness signals without human supervision.

Given that grounded, intervention-level annotations are exceptionally scarce in physical reasoning, transferring this self-play paradigm to multimodal physics by substituting a physics simulator for the symbolic interpreter appears to be a natural solution. In a direct physical transfer, a shared Proposer–Solver policy interacts with a rigid-body simulator. For each proposed world W\mathcal{W}, the executor simulates one factual trajectory τ\tau under seed ξ\xi, extracts an observation xx alongside a simulator-derived target yy, and scores the Solver’s prediction y^\hat{y} via a graded similarity metric ss:

τ=Φξ(W),(x,y)=readout⁡(τ),rnaive=s(y^,y).(1)\tau= \Phi_{\xi}(\mathcal{W}), \qquad(x,y) = \operatorname{readout}(\tau), \qquad r_{\mathrm{naive}} = s(\hat{y},y). \tag*{(1)}

Here Φξ\Phi_{\xi} denotes deterministic simulation and ss assigns partial credit based on continuous numerical or spatial proximity, intended to prevent sparse, uninformative all-zero rewards early in training. While this transfer ostensibly preserves both autonomous task generation and verifiable supervision, empirical auditing reveals two fatal structural failure modes.

Failure Mode 1: Single-trajectory execution cannot ground causal interventions. Physical reasoning distinctively demands understanding how scenes respond to counterfactual interventions—outcomes that never occurred in the observed trajectory ([32]). However, evaluating a single trajectory τ\tau restricts the task space strictly to passive observational readouts (e.g., predicting an object’s future position or initial velocity). In our audit of the naive transfer baseline, exactly zero intervention or counterfactual tasks were synthesized across 100 training rounds, causing PhysBench dynamics accuracy to stagnate and reasoning performance to degrade (§ 4.4). This limitation is structural: causal ground truth cannot be inferred from a single trajectory without paired, counterfactual branch executions. Neither scaling model capacity nor expanding rollout volume can produce verified labels that lie beyond the verification interface itself.

Failure Mode 2: Graded proximity rewards induce learnability illusions. In code and math, execution verification yields a rigorous binary correctness signal. In continuous physics, however, substituting exact match with graded proximity ss fundamentally distorts reinforcement signals. Because ss scores relative closeness rather than true task resolution, clusters of uniformly incorrect rollouts (e.g., predicting stationary velocities or median parameters) yield intermediate rewards. These reward distributions artificially inflate the empirical learnability metric rlearn=1−2∣aˉ−0.5∣r_{\mathrm{learn}} = 1 - 2|\bar{a} - 0.5|, misleading the curriculum into classifying failed, trivial tasks as productive learning boundaries. Consequently, graded reward steadily increases during naive training while exact physical correctness remains near zero (§ 4.4, Table 4).

Prediction taskMean graded rewardExact accuracyZero-exact rounds
Forward0.3730.00%100/100
Inverse0.6646.63%75/100
Parameter0.7875.44%83/100

Table 4. Training-time audit of the single-trajectory naive verifier across 100 rounds.

These failure modes establish that continuous physics cannot be treated as a trivial drop-in replacement for discrete code interpreters. Autonomous physical reasoning requires two non-negotiable architectural guarantees:

  1. Branch-level verification: The executor must actively execute paired, counterfactual interventions (divergent simulation branches) under identical initial conditions to establish objective causal ground truth.

  2. Discrete answer binding: Derived physical tasks must map continuous trajectories into discrete, answer-bound problems, ensuring that Solver success reflects exact correctness rather than deceptive proximity.

Framework Overview

Guided by these requirements, we introduce PhysEvolve (Figure 2). At each round, a Task-Conditioned Proposer transforms a sampled reasoning intent into an executable candidate world. Through Intervention-Grounded Task Synthesis, a fixed executor establishes factual and counterfactual outcomes via deterministic simulation and synthesizes discrete, answer-bound multiple-choice questions. Finally, Co-Evolution Training translates exact Solver correctness into joint updates for the shared policy and an adaptive curriculum.

Let πθ\pi_{\theta} denote the shared vision–language policy. The identical parameters serve as Proposer πθP\pi_{\theta}^{\mathrm{P}} and Solver πθS\pi_{\theta}^{\mathrm{S}}. The Proposer controls the exploration of executable physical environments, while the Solver receives only rendered baseline video observations and the resulting question and options. Crucially, a strict information boundary is enforced: the fixed physics executor alone accesses internal simulator states, computes counterfactual branches, and binds the correct answer. This boundary enables the policy to actively shape its own training distribution without ever setting its own training labels, eliminating label contamination and reward hacking.

Task-Conditioned Proposer

The Proposer receives a reasoning intent σ\sigma, which specifies the target physical relation to probe and the evidence required to make that relation uniquely decidable. Grounded in classical cognitive physics ([6, 35]), we instantiate simulation across three fundamental Newtonian paradigms: (1) projectile motion and parabolic dynamics (Throwing), (2) impulse-momentum transfer and kinematic collisions (Collision), and (3) continuous kinematics and contact interactions (Motion), spanning eight active reasoning intents.

Conditioned on σ\sigma, the Proposer samples a tuple (W,S)∼πθP(⋅∣σ)(\mathcal{W},\mathcal{S}) \sim\pi_{\theta}^{\mathrm{P}}(\cdot\mid\sigma): an executable world program W\mathcal{W} and an evidence schema S\mathcal{S}. The world program is authored in PhysDSL (a domain-specific Python API over rigid-body simulation) specifying 3D geometry, material properties (mass, restitution, friction), initial states, kinematic constraints, and rendering viewpoints. The evidence schema S\mathcal{S} declares the semantic roles of key entities (e.g., query projectiles, barrier obstacles, potential collision targets) required by intent σ\sigma. The executor validates these role declarations against the realized simulation, rejecting any proposal whose physical dynamics cannot support the requested reasoning intent. Complete specifications of PhysDSL and evidence schemas are provided in Appendices A and A.2.

Intervention-Grounded Task Synthesis

A candidate pair (W,S)(\mathcal{W}, \mathcal{S}) represents only a potential reasoning opportunity; simulation execution must establish its physical semantics before it can constitute a valid training task. The executor admits an item only when execution recovers unambiguous physical evidence that determines a unique answer. This contract is executed across three sequential stages:

World verification and freezing. The executor parses and executes the world program in a sandboxed simulator, resolving evidence-schema roles against simulated rigid bodies. It admits only worlds exhibiting valid geometry, non-trivial physical events, and the causal prerequisites of intent σ\sigma. A bounded deterministic repair stage corrects minor placement or boundary syntax violations without introducing new bodies or joints. Once admitted, the world definition is strictly frozen into an immutable scene definition. Freezing guarantees that all subsequent intervention branches share identical initial geometry, material properties, and simulation seeds, ensuring that divergent outcomes are strictly attributable to declared interventions.

Branch elision. For interventional reasoning intents, the executor constructs a finite set of body removals Bσ\mathcal{B}_{\sigma}. For each B∈BσB \in\mathcal{B}_{\sigma}, it elides those bodies and their dependent constraints from the frozen world, yielding the matched execution pair:

(τ∅,τB)=(Φξ(W),Φξ(W∖B)),B∈Bσ.(2)(\tau_{\varnothing}, \tau_{B}) = \left(\Phi_{\xi}(\mathcal{W}), \Phi_{\xi}(\mathcal{W} \setminus B)\right), \qquad B \in\mathcal{B}_{\sigma}. \tag*{(2)}

Both trajectories share the identical simulator state, random seed ξ\xi, and time horizon. The Solver observes only a video rendering of the factual trajectory τ∅\tau_{\varnothing}, while the executor retains the divergent branch trajectories {τB}\{\tau_{B}\} as objective ground truth.

Answer-bound question synthesis. Each reasoning intent defines a discrete readout function, feasibility margins, and natural language templates. The executor applies the readout across baseline and branch trajectories. An item is suppressed if readouts are non-unique, infeasible, or fall within sensitive physical margin thresholds (e.g., velocity differences below 0.30 m/s). Otherwise, the executor determines the unique factual or counterfactual outcome, binds it to ground-truth option index a⋆∈{A,B,C,D}a^{\star} \in\{A, B, C, D\}, and renders the final visual question and distractors. For inverse intervention tasks (e.g., “Which wall should be removed to make the ball land in the target pit?”), the executor runs all candidate elisions (remove A, remove B, remove both) and validates whether exactly one branch achieves the goal; “none of the above” is selected only if no branch reaches the target. Detailed contracts, margin tests, and binding rules are documented in Appendix C.

Co-Evolution Training and Adaptive Curriculum

The synthesized answer-bound items close the self-play loop by providing exact, discrete supervision to both policy roles.

Exact solver supervision. Each retained item defines a group of GG Solver rollouts from policy πθS\pi_{\theta}^{\mathrm{S}}. Given the executor-bound label a⋆a^{\star} and predicted options {a^i}i=1G\{\hat{a}_{i}\}_{i=1}^{G}, the binary Solver reward and empirical item success rate are:

risolve=1[a^i=a⋆],aˉ=1G∑i=1Grisolve.(3)r_{i}^{\mathrm{solve}} = \mathbf{1}[\hat{a}_{i}=a^{\star}], \qquad\bar{a} = \frac{1}{G}\sum_{i=1}^{G} r_{i}^{\mathrm{solve}}. \tag*{(3)}

In contrast to the continuous proximity score ss in Equation (1), risolver_{i}^{\mathrm{solve}} provides unambiguous binary verification immune to proximity-induced reward hacking.

Hierarchical co-evolution. Co-evolution coordinates task selection and world exploration across two complementary levels:

  • Macro-level intent curriculum: Across reasoning intents, the rolling Solver accuracy aˉf\bar{a}_{f} for each task family ff governs adaptive intent sampling. After an 8-round cold start, intent sampling weights follow wf=ρfmax⁡(0.05,4aˉf(1−aˉf))w_{f} = \rho_{f}\max(0.05, 4\bar{a}_{f}(1-\bar{a}_{f})), where ρf\rho_{f} denotes structural family priors. This formulation concentrates training on intents situated at the frontier of the model’s evolving competence (where 4aˉf(1−aˉf)4\bar{a}_{f}(1-\bar{a}_{f}) peaks near aˉf=0.5\bar{a}_{f}=0.5). A family-difficulty multiplier further modulates Proposer credit according to rolling intent challenge.

  • Micro-level world exploration: Conditioned on the sampled intent σ\sigma, the Proposer explores the space of valid, physically rich world programs. Proposer rewards reward successful compilation,

dynamic collision feasibility, and structural edit-distance diversity II, penalized by anti-copy and saturation controls (Appendix E).

Shared-policy GRPO optimization. Both Proposer and Solver roles are optimized jointly via Group Relative Policy Optimization (GRPO) on the shared parameters πθ\pi_\theta, regularized against a frozen reference policy πref\pi_{\mathrm{ref}}. Proposer groups share a sampled intent σ\sigma, while Solver groups share an executor-rendered item. Joint optimization ensures that while the Solver masters causal physical deduction, the Proposer continuously adapts to author executable environments that remain informative and verifiable (Appendix F).

Experiments

Experimental Setup

Research questions. We design our empirical evaluation around four central questions: (Q1) Targeted capability transfer: Does PhysEvolve yield targeted improvements on the specific physical capabilities it simulates during training? (Q2) Out-of-distribution transfer: Do causal principles learned in synthetic rigid-body environments generalize to unseen complex media (fluid, cloth, soft bodies) and real-world video? (Q3) Architectural necessity: How critically do paired branch simulation and joint Proposer–Solver optimization contribute to performance? (Q4) Failure anatomy: What exact supervisory signals are forfeited by relying on single-trajectory execution and continuous proximity rewards?

Training configuration. All experimental variants are initialized from the open-weight base model Qwen3-VL-8B-Instruct [3]. Training is executed in a single run for 100 steps using one-epoch GRPO with a learning rate of 10−610^{-6}. At each step, the curriculum samples N=4N = 4 reasoning intents and generates G=4G = 4 world program proposals per intent, capping retention at 32 active Solver groups with 4 rollouts per group. The complete hyperparameters and training loop are detailed in Appendix F and Algorithm 2.

Benchmarks and evaluation protocols. We evaluate across three rigorous physical reasoning benchmarks: (1) PhysBench [12] covers broad static and dynamic physical QA over 9,802 items; (2) ContPhy [51] benchmarks counterfactual and goal-directed physical reasoning across 1,950 scenarios involving complex continuous dynamics (cloth, fluid, rope, and soft bodies); and (3) CausalPhys [36] assesses physical anticipation and intervention in 3,057 real-world video scenarios. All evaluated models share identical prompts, visual frame sampling, greedy decoding, and official evaluation protocols (Appendix F.3).

Baselines and comparative context. Our primary, strictly matched comparison comprises: (1) the base Qwen3-VL-8B-Instruct model; (2) Naive self-play, which replicates single-trajectory execution with continuous proximity rewards; and (3) PhysEvolve. To contextualize performance across model scales, we also report unaligned results for prominent open-weight models: InternVL2.5-8B [10], Llama-3.2-11B-Vision [29], Pixtral-12B [1], Qwen2.5-VL-7B [4], and the scaled Qwen3-VL-32B [3].

Main Results: Targeted and External Transfer

Table 1 presents overall and capability-specific accuracies across the three benchmarks, separating matched 8B configurations from open-weight context models.

ModelPhysBench Ovr.PhysBench Throw.PhysBench MotionPhysBench Judg.CausalPhys Ovr.CausalPhys Antic.CausalPhys Interv.ContPhy Ovr.ContPhy CF-Rm.ContPhy Goal-Pit
InternVL2.5-8B ([10])43.840.027.732.750.251.542.431.448.423.3
Llama-3.2-11B-Vision [29]38.736.627.230.844.244.140.120.70.020.0
Pixtral-12B ([1])46.941.235.231.050.253.044.521.540.213.3
Qwen2.5-VL-7B ([4])49.444.450.633.152.656.545.725.911.524.4
Qwen3-VL-32B ([3])60.947.183.544.358.961.952.941.045.926.7
Qwen3-VL-8B (base) ([3])52.946.154.734.953.955.942.837.144.320.0
Naive self-play52.445.955.535.255.857.645.937.443.425.6
PhysEvolve (ours)53.5 (+0.6)54.9 (+8.8)56.5 (+1.7)40.0 (+5.1)54.5 (+0.6)58.4 (+2.5)45.0 (+2.3)39.5 (+2.5)51.6 (+7.4)44.4 (+24.4)

Table 1. Accuracy (%) across the three physical reasoning benchmarks. The upper block provides contextual reference models; bold text indicates the best performance within the strictly matched 8B comparison block.

Q1: Targeted capability transfer on PhysBench. Within the matched 8B evaluation, PhysEvolve achieves substantial gains on tasks directly aligned with simulated Newtonian paradigms, improving Throwing by 8.78 percentage points, Judgment by 5.08, and Motion by 1.74. In stark contrast, Naive self-play yields negligible or negative differences on these categories (−0.24 on Throwing, +0.26 on Judgment). Crucially, PhysEvolve improves overall accuracy (+0.55) without catastrophic forgetting of general visual capabilities: performance remains close to or above the base model across most non-target partitions, including static relations and object identification (Appendix G, Table 16).

Q2: Out-of-distribution transfer to complex media and real video. The most compelling evidence of physical generalization emerges on ContPhy: despite being trained exclusively on synthetic rigid-body simulations, PhysEvolve demonstrates remarkable zero-shot transfer to continuous media (cloth, fluid, rope, and soft bodies). On Counterfactual Removal, accuracy increases by 7.38 points over Base (51.64% vs. 44.26%), while on Goal-Pit, accuracy surges by 24.44 points (44.44% vs. 20.00%), surpassing even Qwen3-VL-32B’s 26.7%. On CausalPhys real-world videos, PhysEvolve similarly yields consistent gains on Anticipation (+2.46) and Intervention (+2.27). Because the non-rigid dynamics and visual textures of ContPhy are completely absent from the training templates, these gains confirm that PhysEvolve internalizes an abstract intervention operator—the ability to deduce how physical states diverge under structural removal—rather than memorizing superficial simulation artifacts.

Fine-grained task transfer and checkpoint dynamics. Figure 3 breaks down transfer across fine-grained causal subcategories. Relative to the Base model, PhysEvolve improves Fluid Flow by 11.00 points and Action Substitution by 9.09 points, significantly outperforming the branch-disabled control (by 23.00 points on Fluid Flow). Furthermore, longitudinal checkpoint analysis (Figure 4, left) shows consistent gains over Base on Throwing and Judgment throughout self-play. At the terminal checkpoint (Figure 4, right), item-level paired auditing reveals that PhysEvolve correctly answers 69 Throwing items that Base misses against only 33 reversals (a net gain of 36 items), and net gains of 39 and 25 items on Judgment and Motion, confirming genuine competence acquisition.

Task-level transfer across matched comparisons

Figure 3. Task-level transfer across matched comparisons. Markers show accuracy differences between PhysEvolve and each comparison model on ContPhy (Counterfactual Removal, Goal-Pit) and CausalPhys subcategories. Positive values favor PhysEvolve. Sample counts appear at right; see Table 19 for complete accuracies.

PhysBench training dynamics and paired correctness analysis

Figure 4. PhysBench training dynamics and paired correctness analysis. Left: accuracy gains over Base across scheduled training checkpoints. Right: item-level paired analysis at the terminal checkpoint, separating questions answered correctly only by PhysEvolve from those answered correctly only by Base. Diamonds indicate net correct item gains; see Table 20 for complete counts.

Ablation Studies

Q3: Necessity of branch-enabled synthesis and joint co-evolution. We investigate the architectural components of PhysEvolve via two targeted endpoint ablations:

Essentiality of paired branch execution. In Table 2, removing branch simulation and its dependent Counterfactual/Inverse task families sharply degrades downstream causal transfer. The performance drop is especially drastic on ContPhy Counterfactual Removal (−8.20 points) and Goal-Pit (−23.33 points), dropping performance back to the un-finetuned Base level. This ablation empirically confirms that paired branch elision is the indispensable engine for acquiring causal physical reasoning.

ConfigurationBranch Sim.CF/InvGroupsRolloutsOvr.Interv.Ovr.CF-Rm.Goal-Pit
PhysEvolveOnOn2,1678,66854.5045.0339.5451.6444.44
w/o branch-enabled pathOffOff1,9907,96051.4241.7137.2843.4421.11
Difference––+177+708+3.07+3.32+2.26+8.20+23.33

Table 2. Ablation of the complete branch-enabled training path. Evaluating endpoint accuracy (%) under identical protocols when branch execution and dependent Counterfactual/Inverse families are deactivated.

Criticality of joint Proposer–Solver optimization. In Table 3, we freeze Proposer role updates, training the shared policy exclusively via Solver rollouts. Without co-evolution, the policy undergoes severe representational collapse: accuracy drops precipitously to 15.01% on CausalPhys and 17.85% on ContPhy, accompanied by a collapse in answer parse rate (falling to 26.07% on CausalPhys and 0% in later steps). Updating the Proposer keeps world generation diverse and physically non-trivial, preventing the Solver from over-adapting to a degenerate data stream.

ConfigurationProposerSolverACCParse rateACCParse rate
PhysEvolve✓✓54.5097.8439.54100.00
w/o Proposer-role updates–✓15.0126.0717.8599.90
Δ––+39.48+71.77+21.69+0.10

Table 3. Ablation of joint Proposer–Solver optimization. Disabling Proposer parameter updates while updating only Solver parameters collapses policy distribution and answer parse rates (%).

Auditing the Single-Trajectory Interface

Q4: What causes naive physical self-play to collapse? We conduct an empirical audit of the single-trajectory verifier and task stream in Naive self-play to validate the theoretical pitfalls identified in § 3.1.

Divergence between graded reward and exact correctness. Table 4 exposes a striking pathology: continuous proximity rewards ss consistently provide deceptive reinforcement. For Forward prediction, rollouts achieve a high mean graded reward of 0.373 despite zero exact matches across all 100 rounds. For Inverse and Parameter tasks, mean rewards reach 0.664 and 0.787 while exact accuracy remains below 7%. An error audit reveals severe mode collapse: the policy learns to output sta tionary initial velocities (746 instances) or the median rung of the parameter ladder (145 instances), exploiting the graded metric to reap partial credit without solving the physical events.

Task space starvation. Over 100 training rounds, the naive single-trajectory verifier generated zero intervention questions and zero counterfactual tasks. Constrained to an un-intervened factual trajectory τ\tau, the system is incapable of synthesizing causal supervision. Consequently, downstream PhysBench dynamics accuracy stagnates (Table 1).

Conclusion

PhysEvolve demonstrates that verifier-grounded self-evolution extends to continuous multimodal physical reasoning by anchoring self-play in executable 3D world programs and paired counterfactual branches. Converting continuous physics into discrete verifier contracts eliminates the dual traps of continuous reward hacking and causal blindness inherent in naive physical self-play. Strong targeted gains on Newtonian dynamics and zero-shot transfer to unseen continuous media and real-world video show that counterfactual execution provides a scalable foundation for generalizable physical intelligence in vision-language models, entirely without any human-annotated physical reasoning supervision during self-play training. Each training target is bound to a verified physical outcome.

Complete PhysDSL and Executable World Interface

Complete callable surface

A proposal is a Python module containing build_scene(api) and a literal SCENE_MANIFEST. Every construction/setter call mutates a builder and returns None; the proposal cannot branch on simulator state. The executor alone calls freeze() to obtain a scene. Table 5 lists the complete public surface used by the current executor, including operations not exercised by every reported world class. Section B instantiates the interface with three auditable golden-world illustrations.

CapabilityCallsEffect
Geometryadd_box, add_sphere, add_cylinder, add_capsule, add_planeRegister fixed or free rigid bodies and visual/material attributes.
Initial stateset_velocity, set_rotationSet linear/angular velocity or a normalized orientation quaternion.
Constraintsadd_hinge, add_slide, add_springAdd one-DOF joints or a damped spatial spring between existing bodies.
Environmentset_gravity, set_duration, add_cameraSet the execution horizon, gravity vector, and look-at camera.
FinalizationfreezeAdd default ground/camera if absent and snapshot a SceneDef.

Table 5. Complete PhysDSL callable surface. Arguments are validated when the call is made; freeze() returns the immutable executor input.

Hard validation envelope. Table 6 gives the actual validator bounds. Stage 2 uses continuous_levels=True: mass, friction, and restitution remain the submitted real values inside their intervals rather than being snapped to the Stage-1 ladders.

FieldEnforced contract
NamesPattern [a-z ][a-z0-9 ]*; one namespace across bodies, joints, springs, and cameras; ground/world/sky reserved (ground is allowed for the plane).
Body centers and count∣x∣,∣y∣<1.5|x|, |y| < 1.5 and 0<z<2.50 < z < 2.5 m; a plane may use z=0z = 0. At least one body after finalization and at most 20 dynamic bodies; fixed scene furniture does not consume the dynamic-body cap.
Geometric sizeEach non-plane radius/half-size/half-height in [0.01,1.0][0.01, 1.0] m; each plane half-size is at least 0.010.01 m and has no API upper cap.
MaterialMass [0.01,100][0.01, 100] kg, sliding friction [0,2][0, 2], restitution [0,1][0, 1], and every RGBA channel [0,1][0, 1].
Initial stateEach linear and angular velocity component has magnitude at most 20; orientation is a nonzero quaternion and is normalized.
JointNonzero axis; optional limits satisfy ℓ<u\ell< u; parent and child differ; only the parent may be the world; one explicit joint per child.
SpringStiffness [0.1,104][0.1, 10^{4}], damping [0,103][0, 10^{3}], body-local anchor components in [−2,2][-2, 2] m, and optional rest length >0> 0; at least one endpoint is dynamic and neither endpoint is a plane.
EnvironmentDuration [0.1,60][0.1, 60] s; finite three-vector gravity; camera position and target must differ.

Table 6. PhysDSL construction-time bounds. Intervals are closed unless an inequality is written explicitly.

Reported evidence schemas

A reasoning intent specifies the semantic relation to probe and the evidence needed to decide it. PhysDSL can express more worlds than the reported run uses; the run enables exactly the three schemas in Table 7, which jointly serve the eight active families in Section C. The executor resolves every declared role against the frozen world before constructing an item.

Auditable World-Program Gallery

Three human-authored reference worlds illustrate the executable world-program interface: Throwing, Collision, and Motion. We execute the v01 programs with seed 7 in MuJoCo 3.6.0, retaining

World classRequired role fieldsServed active families
Throwingballs, three or more fixed platforms, two or more removable walls, region_kind, and three destination regions derived from platform gapsfinal destination; current-run judgment; counterfactual destination; inverse intervention
Collisiondynamic target; trigger; exactly four dynamic movers; relation_pair={a,b,expected}final state; final relation; motion attribution
Motiondynamic motion_target; optional speed_pair={a,b}motion-state change, including forward, speed-profile, and pairwise surface forms

their colors, materials, and lighting. Initialization images precede the first simulation step; subsequent frames show the accepted world’s execution. Program copies, evidence schemas, accepted scenes, and execution records are stored under paper/assets/world_program_demo/. The rendered components are stored separately under paper/figures/world_program_demo/.

Throwing: one program, four executable inputs

The reference program defines three balls, three platforms, four walls, and three destination regions. Figure 5 uses the orange ball (ball_b) as the query. Wall A is black_left_wall; wall B is orange_wall. Each branch preserves the retained bodies’ initial conditions and removes the designated walls together with the two non-query balls.

Throwing reference world and executable interventions

Figure 5. Throwing reference world and executable interventions. The frozen baseline and three altered inputs share the same camera and initial conditions for retained bodies. Each altered input removes the designated wall set and the non-query balls. The executor runs these inputs separately to obtain the region readouts used for question and answer construction.

The orange ball settles in the left pit in the baseline and in the middle pit when wall A and the other balls are removed. This executed difference supplies the counterfactual answer. The four evidence objects in Table 8 also support inverse questions by comparing which interventions reach a requested destination.

Evidence keyElided bodiesReadout
τ0(b)\tau_{0}(b)nonebaseline settled region
τA(b)\tau_{A}(b)wall A and all non-query ballsaltered settled region
τB(b)\tau_{B}(b)wall B and all non-query ballsaltered settled region
τAB(b)\tau_{AB}(b)walls A+B and all non-query ballsaltered settled region

Table 8. Throwing evidence objects. Each altered input is executed with the same seed and horizon as the frozen baseline.

Collision: roles and contact evidence

The evidence schema names swing_striker as the trigger, blue_plate as the target, four attribution candidates, and the relation pair orange_ball/blue_plate. These roles support attribution, final-state, and relation questions.

Initialization of the collision reference world

(a) Initialization, t=0t = 0 s

Collision reference world at 1.032 seconds

(b) t=1.032t = 1.032 s

Collision reference world at 1.678 seconds

(c) t=1.678t = 1.678 s

Figure 6. Collision reference world. The initialization and later frames connect the entity roles to execution. The lower panels bracket contact between the orange ball and blue plate; times are measured from simulation start.

Motion: an apparatus for motion and contact

The Motion world combines a ramp, a platform with a separate surface patch, a slider, and two balls. The green ball descends the ramp and contacts the amber slider, which subsequently contacts the blue ball. Its trajectory provides evidence for the active motion-state family.

Motion world initialization

(a) (a) Initialization, t=0t = 0 s

Motion world at 0.790 seconds

(b) (b) t=0.790t = 0.790 s

Motion world at 1.356 seconds

(c) (c) t=1.356t = 1.356 s

Figure 7. Motion reference world. Initialization and two execution states show the ramp-to-platform motion and resulting contacts. All frames share the same camera; times are measured from simulation start.

FamilyRepresentative item and option semanticsEvidence, binding, and suppression
throwing_final_destination“What is the final destination of the [referent]?” Regions use {left pit, right pit, center pit, none}; an unsettled layout uses {left, right, neither, none}.Baseline only. A region requires final speed ≤0.30\le0.30 m/s, a non-ejected status, exactly one derived gap interval, and final height no more than 0.300.30 m above the platform tops. A settled region binds that region; otherwise neither is bound rather than guessed.
throwing_current-run-judgment“Will the [referent] eventually drop into the left pit?” Options are {Yes, No, Can not answer, Uncertain}; a second surface asks whether it reaches a different destination region than a named one.Baseline only. Yes iff the settled-region readout equals the named target; otherwise No, including an unsettled/ejected readout. Target choice alternates between matching and nonmatching regions across ball indices.
counterfactual_destination“If we removed the [wall] and other balls, which pit would the [referent] drop into?” Options are {left, right, center, none}.Matched baseline and one elision branch. Admit only when the branch is available, settles in one region, and differs from the baseline region. The branch region is the answer; failed, unsettled, or unchanged branches suppress the item.
inverse-intervention“What can we do to make the [referent] drop into the [target] pit?” Options are {remove A + other balls, remove B + other balls, remove both + other balls, none}.Baseline plus all three A/B/A+B branches. In a first fixed-order pass, the first non-baseline target reached by exactly one branch binds that intervention. Only if no target has a unique achiever, a second pass binds none to the first non-baseline target reached by no branch. A multiply achieved target is skipped; missing branches suppress.

Table 9. Exact contracts for the four active throwing families. The option descriptions give canonical semantics; an eligible surface layout may permute slots and substitute compatible distractors, but must preserve a unique binding for the admitted answer semantic.

FamilyRepresentative item and option semanticsEvidence, binding, and suppression
collision-final_state“Which phrase best describes the final pose of the [target]?” Options are {standing upright, leaning, lying horizontally, floating}.Terminal status and speed. Ejected with z>0.35z > 0.35 binds floating; fallen binds lying; moving with speed ≥0.10\ge0.10 binds leaning; stable with speed ≤0.20\le0.20 binds standing. Other/borderline combinations suppress the item.
collision.final_relation“Which phrase best describes the interaction between A and B during the run?” Options are {ends in contact, never touches, passes near without touching, ends vertically separated without contact}; a binary surface uses {Yes, No, Sometimes, Uncertain}.Contact is trajectory-level: any recorded pairwise contact dominates and binds the contact semantic (canonically rendered as “ends in contact”). Otherwise vertical separation requires final ∣Δz∣≥0.30\lvert\Delta z\rvert\ge0.30 and lateral gap ≤0.30\le0.30 m; pass-by requires initial or final distance ≤0.20\le0.20 m; the remainder is no-contact. The computed class must equal the manifest declaration or the family is suppressed.
motion.attribution“Which object experienced a change in motion as a result of the [trigger]?” The four options are the manifest’s four mover bodies.Candidates must be distinct, dynamic, and different from the trigger. Eligibility requires trigger contact and velocity-change magnitude ∥vf−v0∥2>0.30\lVert v_f-v_0\rVert_2 > 0.30 m/s; the argmax is bound only if its lead over a second eligible candidate is at least 0.300.30 m/s. The absence of an eligible candidate, or a lead below this margin, suppresses the item.
motion.state_changeThree surfaces: motion change {stop, slow but moving, speed up, same}; speed profile {accelerate, decelerate, accelerate then decelerate, constant}; pairwise semantics {final tie, final A faster, final B faster, non-tied order reversal}. The canonical middle options use “consistently faster” wording.Require target initial speed ≥0.10\ge0.10 m/s. Stop uses final speed <0.10< 0.10; speed-change/profile boundaries use an absolute 0.300.30 m/s gap; pairwise order uses 0.100.10 m/s. Crossover is bound only when both endpoint orders are non-tied and reverse; otherwise the final order is bound. The pairwise surface requires both declared bodies.

Table 10. Exact contracts for the other four active families. Canonical options are shown; eligible layouts may change slot order and compatible distractors while preserving the admitted answer semantic.

Intervention-Grounded Task Contracts

The implementation follows one order for every family: define the physical semantic, test whether the executed evidence makes it decidable, map the admitted case to an answer semantic, and only then realize a question and option layout. Tables 9 and 10 enumerate all eight active families. Frozen registry entries are not counted.

Branch matrix and unique-answer binding

For a query ball bb, let r0,rA,rB,rAB∈{left,right,middle,⊥}r_0, r_A, r_B, r_{AB} \in\{\text{left}, \text{right}, \text{middle}, \bot\} be the settled-region readouts of the four executions in Table 8; ⊥\bot denotes no admitted region. Table 11 formalizes which cells each family must observe before any option letters are assigned.

ExecutionBaselineRemove ARemove BRemove A+B
Stored semanticr0r_0rAr_ArBr_BrABr_{AB}
Required for counterfactual(A)yesyesnono
Required for inverseyesyesyesyes

Table 11. Branch-result contract used for counterfactual and inverse items.

A counterfactual(A) item is admitted exactly when rA≠⊥r_A \ne\bot and rA≠r0r_A \ne r_0, then binds answer semantic to rAr_A. For an inverse target t≠r0t \ne r_0, define Ht={A:rA=t,B:rB=t,AB:rAB=t}H_t = \{A : r_A = t, B : r_B = t, AB : r_{AB} = t\}. The generator requires all three branch views and makes two fixed-order passes over left/right/middle. The first returns the first target with ∣Ht∣=1\lvert H_t\rvert= 1 and binds its sole lever. Only when no target has a unique achiever does the second return the first target with ∣Ht∣=0\lvert H_t\rvert= 0 and bind none of the above; a target with ∣Ht∣>1\lvert H_t\rvert> 1 is skipped in both passes. Thus “none” is an executor-derived negative, not a catch-all for failed execution, and an ambiguous target does not preclude a decidable target elsewhere.

Surface realization boundary

Only after an answer semantic is admitted does the task-interface library select a compatible stem and four-option layout and bind the semantic to an index. A canonical family layout is used whenever a sampled surface lacks the required semantic. This ordering keeps the physical decision rule executor-determined while allowing multiple linguistic realizations of the same evidence.

Verification, Repair, and Branch Execution

Typed termination. Every proposal receives exactly one status. FAILED_SYNTAX, FAILED_SEMANTIC, and FAILED_RUNTIME cover parsing, eager DSL validation, and build_scene execution. FAILED_COMPILE, FAILED_OVERLAP, and FAILED_NAN cover simulator-model, initial-interpenetration, and numerical failures. FAILED_TIMEOUT and FAILED_RENDER cover bounded execution and rendering. FAILED_VQA means the manifest or generated item violates its contract. TRIVIAL means maximum displacement is below 0.05 m and there is no collision. Only OK worlds with admitted items enter Solver groups.

Bounded repair. Repairs are recorded as an ordered trace. Minor repairs address supported syntax/argument variants, manifest repairs recover fields mechanically determined by authored geometry, and geometry repairs clamp workspace positions or separate simple initial overlap. Repair does not add a new body, joint, spring, or declared causal relation. The strongest applied tier yields a proposal-credit multiplier of 0.90 (minor), 0.80 (manifest), or 0.75 (geometry); unrepaired worlds use 1.0.

Frozen matched branches. After repair, the executor calls freeze() once. A branch clones that immutable SceneDef, elides its named body set and every incident joint/spring, and re-executes with the baseline seed and horizon. Identical removal sets share one cached execution. At most six distinct removal sets are run per world; failed/capped branches are absent, causing dependent items to be suppressed. The throwing scheduler places the A/B/AB inverse sets for the first two balls before compatible counterfactual requests, so the latter can reuse the same branch views.

Optimization and Active Curriculum

General objective. Let zz be the terminal proposal status, nn the number of retained Solver rollouts, Gmin⁡=4G_{\min}=4, and II the intrinsic score. Before repair, anti-copy, saturation control, and family scaling,

Algorithm 1 Executor-determined item construction under an explicit contract
Require: proposal module $p$, stage-2 DSL, simulation seed $s$
1: parse `build_scene` and literal `SCENE_MANIFEST`
2: execute the sandboxed builder with eager DSL checks
3: apply bounded repair and freeze one immutable world $W$
4: compile, execute, and render baseline $\tau_0 \leftarrow \mathcal{E}(W,s)$
5: validate manifest roles against $W$ and enumerate required elisions
6: for each distinct removal set $B$ up to the branch cap do
7:   $W_B \leftarrow W$ with $B$ and incident constraints elided
8:   $\tau_B \leftarrow \mathcal{E}(W_B,s)$; cache by $B$
9: end for
10: for each requested active family $f$ do
11:   compute evidence predicates from $\tau_0$ and required $\tau_B$
12:   if all decidability and margin conditions for $f$ hold then
13:     derive answer semantic; select a compatible surface layout
14:     bind semantic to one option index and emit the item
15:   end if
16: end for

the implementation defines

rbase={λfailcz,z≠OK,0,z=OK and n<Gmin⁡,λlearneffrlearn+λintI,otherwise.(4)r_{\mathrm{base}} = \begin{cases} \lambda_{\mathrm{fail}}c_z, & z \ne\mathrm{OK},\\ 0, & z = \mathrm{OK}\ \text{and}\ n < G_{\min},\\ \lambda_{\mathrm{learn}}^{\mathrm{eff}}r_{\mathrm{learn}}+\lambda_{\mathrm{int}}I, & \text{otherwise}. \end{cases} \tag*{(4)}

(4) separates terminal failure, insufficient retained evidence, and admitted worlds. Here rlearn=1−2∣aˉprop−12∣r_{\mathrm{learn}} = 1 - 2\lvert\bar{a}_{\mathrm{prop}} - \frac{1}{2}\rvert is the instance-level tent statistic, where aˉprop\bar{a}_{\mathrm{prop}} denotes the retained-rollout Solver accuracy used to score the proposal. The Solver receives exact option-match reward. Status prices are cz=−1.0c_z=-1.0 for syntax, semantic, and VQA failure, −0.8-0.8 for runtime failure, −0.5-0.5 for compile and overlap failure, −0.3-0.3 for numerical, timeout, and render failure, and 00 for a trivial world.

Reported instantiation and hierarchical co-evolution. Co-evolution operates through a two-level curriculum. At the macro level, family sampling tracks the Solver’s competence boundary across reasoning intents: after an eight-step prior-weighted cold start, selection uses max⁡(0.05,4aˉf(1−aˉf))\max(0.05,4\bar{a}_f(1-\bar{a}_f)) multiplied by the structural priors in Table 12, so saturated or unsolvable families are down-weighted. The family-difficulty multiplier further scales Proposer credit by rolling aˉf\bar{a}_f, so Solver outcomes reshape both which intents are sampled and how admitted worlds are valued. At the micro level, conditioned on the sampled intent σ\sigma, the shared policy explores the program space for valid, physically non-trivial environments. Instance-level scoring prioritizes physical validity, collision feasibility, and structural diversity II, with the instance-level tent coefficient held at λlearn=0\lambda_{\mathrm{learn}}=0. This hierarchy combines competence-adaptive task selection with verifier-grounded exploration of executable worlds. The executor supplies the verifiable answers that connect both levels. Executable demonstrations remain available as syntactic references. Through this dual-level loop, Solver progression reshapes the training distribution via the adaptive intent curriculum, and shared-parameter updates of πθ\pi_\theta align world generation with physical reasoning.

ComponentReported configuration
Failure scale λfail\lambda_{\mathrm{fail}}1.5
Instance-level tent coefficient λlearneff\lambda_{\mathrm{learn}}^{\mathrm{eff}}held at 0 (validity/diversity dominate instance scoring)
Intrinsic weight λint\lambda_{\mathrm{int}}0.1; structural diversity only
Repair factors0.90 minor; 0.80 schema; 0.75 geometry
Near-copy controlsimilarity ≥0.95\ge0.95 capped at 0.1 before repair and family scaling
Exact/within-group duplicate proposalpre-family reward override −0.8-0.8
Edit-distance diversity weight1.5
Saturation controlthreshold 0.75; weight 1.0
Family-difficulty multiplierclip⁡(1+(0.5−aˉf),0.5,1.5)\operatorname{clip}(1 + (0.5 - \bar{a}_f), 0.5, 1.5)
Rolling family statistic64 most recent per-world family accuracies
Family-sampling cold start8 rounds
Family-sampling priors2.0×2.0\times for priority families; 2.0×2.0\times for collision-final_relation; 1.2×1.2\times for each branch family; 1.0×1.0\times otherwise
Solver reward scale1.5

Table 12. Reward and sampling controls in the reported 100-step run.

The active proposal signals are typed failure/validity, repair credit, structural diversity, anti-copy, saturation control, and family-difficulty scaling; the active Solver signal is exact option match. Table 12 records these controls.

Exact Solver outcomes update the rolling family statistics used for subsequent rounds. Family sampling directs task generation toward the Solver’s competence boundary, and the family-difficulty multiplier adjusts Proposer credit across intents. Within each intent, validity, repair, diversity, and saturation controls shape executable world generation.

Algorithm 2 Reported verifier-grounded shared-policy training loop

Require: shared policy πθ\pi_\theta, executor E\mathcal{E}, intent curriculum C\mathcal{C}, intent batch NN, group size GG

  1. for t=1,…,100t = 1, \ldots, 100 do

  2. sample {σn}n=1N∼C\{\sigma_n\}_{n=1}^{N} \sim\mathcal{C} with scene-kind minima

  3. sample GG program/manifest proposals for each σn\sigma_n

  4. validate proposals and execute Algorithm 1

  5. retain up to the per-scene and per-step Solver-group caps

  6. sample GG Solver answers per retained item; score exact option match

  7. compute proposal rewards and role-wise GRPO advantages

  8. update the shared πθ\pi_\theta from Proposer and Solver rows

  9. update rolling family accuracy and C\mathcal{C}

  10. end for

Reproducibility, Training, and Evaluation Configuration

Role contracts and update loop

The shared policy alternates between two tagged interfaces. The Proposer receives a reasoning intent and returns a world program plus manifest inside <propose> tags. The Solver receives a rendered video and an executor-authored multiple-choice item and returns one option inside <answer> tags; it has no simulator tool. The fixed executor joins the roles by validating programs, executing the required baseline/branches, and binding each admitted answer.

Resolved training configuration

Table 13 transcribes the v7i launcher and current configuration builder. The launcher fixes a 100-step horizon and saves every 25 steps. We report the terminal step-100 checkpoint and show every scheduled intermediate checkpoint in Figure 4.

Evaluation protocols

Table 14 gives the evaluation contract used for each benchmark.

BenchmarkItemsVisual inputGenerationScoring
PhysBench9,8028 uniform framesgreedy; 2,048 tokensofficial prompts, normalization, and scorer
CausalPhys3,0575 uniform framesCoT; greedy; 512 tokensfinal A–D answer; unparsed output is incorrect
ContPhy1,95010 uniform framesgreedy; 64 tokensnormalized MC or normalized open-response exact match

Table 14. Evaluation protocols for the three reported benchmarks.

PhysBench frames are passed directly to the Qwen processor as an array. For CausalPhys, five annotations whose gold field is not an A–D label are excluded before scoring. ContPhy evaluates one question per generation and normalizes extracted open responses by lowercasing and stripping whitespace. All models within one benchmark share the item list, visual preprocessing, prompt, decoding, answer parser, and scorer. An unparsed response is scored as incorrect.

ComponentConfiguration
Base and horizonQwen3-VL-8B-Instruct; 100 steps; checkpoints at 25/50/75/100
Run multiplicityOne training run per reported configuration; no training-seed sweep
Compute4 GPUs; 32 Ray CPUs; 4 executor workers
Proposer samplingN=4N = 4 intent groups per step; G=4G = 4 programs per intent; at least one throwing, collision, and motion intent per step
Solver retention and rolloutAt most 5 items per scene and 32 groups per step; 4 answers per group; rollout chunk size 8
Visual variantsOne additional color permutation per accepted baseline world; one executor camera; 32 rendered frames at 480×480480 \times480
Golden demonstration pool10 throwing, 8 collision, and 6 motion programs; active for steps 1–100
Auxiliary geometry itemCamera-depth bypass enabled; at most one executor-geometry item on an eligible collision/motion scene, outside the eight sampled intents
Generationtemperature 0.7; top-p=0.95p = 0.95; top-k=20k = 20; 6,144-token prompt and 4,096-token response budgets
GRPO1 epoch; clip ratio 0.2; learning rate 10−610^{-6}; entropy coefficient 0
Batch sizestraining batch 4; prompt-group mini-batch 1; per-GPU micro-batch 1
Reference regularizationfrozen reference policy; low-variance actor KL and reward KL coefficient 0.03
Reference bufferenabled during demonstrations; capacity 32; 2 references per prompt
Family sampling8-step prior-weighted cold start; accuracy-adaptive sampling thereafter. Structural priors throughout: 2.0×2.0 \times for priority and relation coverage; 1.2×1.2 \times for counterfactual/inverse families.
Online construction seedsexecutor sequence starts at 9001; curriculum/reference RNG base 9001 (resolved code defaults)
Executor limits0.002 s timestep; 30 s simulation and 15 s render timeouts; at most 6 distinct branch executions per world

Table 13. Resolved configuration for the reported PhysEvolve run.

We report accuracy and percentage-point differences on the shared item set within each benchmark.

Extended Results

PhysBench taxonomy

Table 15 reports the matched claim-facing views. Table 16 then gives every top-level task and ability partition from the same step-100 evaluation, plus the three physical dynamics subtypes used in the main text.

View (nn)BaseNaiveΔ\Delta vs. BasePhysEvolveΔ\Delta vs. Base
Overall (9,802)52.9252.39−0.53-0.5353.47+0.55+0.55
Dynamics (2,932)44.3744.44+0.07+0.0745.29+0.92+0.92
Throwing (410)46.1045.85−0.24-0.2454.88+8.78+8.78
Collision (650)38.6238.77+0.15+0.1540.77+2.15+2.15
Motion (1,433)54.7155.48+0.77+0.7756.45+1.74+1.74
Prediction (1,430)42.1742.87+0.70+0.7043.71+1.54+1.54
Judgment (767)34.9435.20+0.26+0.2640.03+5.08+5.08
Reasoning (2,056)43.0940.42−2.68-2.6843.92+0.83+0.83
Static (1,899)60.6661.40+0.74+0.7462.24+1.58+1.58

Accuracies and differences are percentage points. Difference columns compare Naive and PhysEvolve with Base. Task, subtype, and ability levels overlap; rows within each top-level partition do not.

Table 15. PhysBench accuracy and paired differences for matched models.

Taxonomy levelView (nn)BasePhysEvolveΔ\Delta
TaskDynamics (2,932)44.3745.29+0.92+0.92
Relationships (2,088)61.9763.46+1.48+1.48
Scene (2,240)45.1345.62+0.49+0.49
Property (2,542)62.2061.61−0.59-0.59
Dynamics subtypeThrowing (410)46.1054.88+8.78+8.78
Collision (650)38.6240.77+2.15+2.15
Motion (1,433)54.7156.45+1.74+1.74
AbilityPerception (919)60.3956.04−4.35-4.35
Dynamic (189)75.1375.66+0.53+0.53
Static (1,899)60.6662.24+1.58+1.58
Comparison (1,423)45.8944.91−0.98-0.98
Reasoning (2,056)43.0943.92+0.83+0.83
Identify (1,119)82.9382.84−0.09-0.09
Judgment (767)34.9440.03+5.08+5.08
Prediction (1,430)42.1743.71+1.54+1.54

Table 16. Complete top-level PhysBench task and ability partitions for the matched Base and PhysEvolve models. The dynamics-subtype rows are nested inside Dynamics and therefore do not form a complete partition.

Complete contextual reference table

Table 17 restores the complete set of views for the open-weight contextual references. These heterogeneous scales are not used for component attribution; Base, Naive, and PhysEvolve remain the matched 8B comparison.

ModelPhysBenchCausalPhysContPhy
Ovr.Dyn.Throw.Coll.MotionPred.Judg.Reason.Ovr.Antic.Interv.Ovr.CF-Rm.Goal-Pit
InternVL2.5-8B43.842.140.038.927.743.032.727.450.251.542.431.448.423.3
Llama-3.2-11B-Vision38.743.236.635.527.244.130.829.644.244.140.120.70.020.0
Pixtral-12B46.944.641.239.235.246.931.035.150.253.044.521.540.213.3
Qwen2.5-VL-7B49.444.344.436.550.644.133.136.552.656.545.725.911.524.4
Qwen3-VL-32B60.948.747.146.083.548.044.351.458.961.952.941.045.926.7
Qwen3-VL-8B Base52.944.446.138.654.742.234.943.153.955.942.837.144.320.0
Naive self-play52.444.445.938.855.542.935.240.455.857.645.937.443.425.6
PhysEvolve53.545.354.940.856.543.740.043.954.558.445.039.551.644.4

Table 17. Full accuracy (%) table for open-weight context and matched 8B models.

CausalPhys categories and ContPhy domains

Table 18 exposes all four CausalPhys categories and all four ContPhy physical domains from the reported protocols. The intervention-operation views used in the main text are included after the domain partition.

Benchmark view (nn)BasePhysEvolveΔ\Delta
CausalPhys Overall (3,057)53.9454.50+0.56
Anticipation (896)55.9258.37+2.46
Goal orientation (637)50.7149.61−1.10
Intervention (573)42.7645.03+2.27
Perception (951)60.9959.83−1.16
ContPhy Overall (1,950)37.0839.54+2.46
Cloth (450)48.0047.11−0.89
Fluid (450)24.8928.44+3.55
Rope (600)30.8332.17+1.33
Soft body (450)46.6752.89+6.22
Counterfactual removal (122)44.2651.64+7.38
Goal-Pit (90)20.0044.44+24.44

Table 18. Matched cross-benchmark accuracy and complete category/domain breakdowns.

The complete branch-path control is reported in Table 2.

Joint Proposer–Solver updates

An additional run removed Proposer-role rows from the shared-policy update while retaining Proposer generation, the executor, and the family set. Its training answer parse rate remains valid through step 64 and becomes zero for steps 65–100. Table 3 reports endpoint accuracy and answer parse rates for the joint and Solver-only update configurations.

Task-level transfer and paired answer changes

Table 19 gives the exact accuracies underlying Figure 3. The CausalPhys Naive and branch-disabled results use the same video-packing protocol as the Base and full-model evaluations. All comparisons retain the same valid-gold evaluation set.

TasknnBaseNaivew/o branchPhysEvolve
ContPhy
Counterfactual Removal12244.2643.4443.4451.64
Goal-Pit9020.0025.5621.1144.44
CausalPhys / Anticipation
Collision Prediction30053.6750.6754.6751.67
Fluid Flow20047.5060.5035.5058.50
Intention Speculation19645.9252.5542.3548.47
Deformation20077.5070.0078.0078.00
CausalPhys / Intervention
Action Substitution9938.3846.4644.4447.47
Spatial Manipulation15143.0546.3641.0645.03
Temporal Shifting14954.3659.7350.3457.05
Viewpoint Transformation17435.0633.3333.3333.33

Table 19. Complete accuracies for the task-level transfer comparison (%). CausalPhys controls use the matched video-packing protocol.

Table 20 uses the official PhysBench answer-matching rule to partition the matched questions by terminal-checkpoint correctness. The difference between the two discordant counts, divided by the row’s sample size, recovers the accuracy change. Throwing and Motion are taxonomy subtypes; Judgment is an ability view and can overlap the subtype views. Counts are therefore interpreted within each row.

TasknnBoth correctOurs onlyBase onlyNeitherΔ\Delta (pp)
Overall980244877547003861+0.55
Throwing4101566933152+8.78
Judgment7672208748412+5.08
Motion14337307954570+1.74

Table 20. Paired terminal-checkpoint correctness on PhysBench. Each row partitions the same evaluation items by Base and PhysEvolve correctness.

Matched ContPhy examples for Counterfactual Removal and Goal-Pit

Figure 8. Matched ContPhy examples for Counterfactual Removal and Goal-Pit. Each example displays three of the ten evaluation input frames, the original question and options, the extracted model answers, and the reference answer. The examples illustrate reasoning about removal and a requested destination in held-out soft-body scenes. The Goal-Pit reference answer is “None of the above.”

References

  1. [1]Pravesh Agrawal, Szymon Antoniak, Emma Bou Hanna, Baptiste Bout, Devendra Chaplot, Jessica Chudnovsky, Diogo Costa, Baudouin De Monicault, Saurabh Garg, Theophile Gervet, Soham Ghosh, Amélie Héliou, Paul Jacob, Albert Q. Jiang, Kartik Khandelwal, Timothée Lacroix, Guillaume Lample, Diego Las Casas, Thibaut Lavril, Teven Le Scao, Andy Lo, William Marshall, Louis Martin, Arthur Mensch, Pavankumar Muddireddy, Valera Nemychnikova, Marie Pellat, Patrick Von Platen, Nikhil Raghuraman, Baptiste Rozière, Alexandre Sablayrolles, Lucile Saulnier, Romain Sauvestre, Wendy Shang, Roman Soletskyi, Lawrence Stewart, Pierre Stock, Joachim Studnia, Sandeep Subramanian, Sagar Vaze, Thomas Wang, and Sophia Yang. Pixtral 12B. arXiv preprint arXiv:2410.07073, 2024.arxiv.org/abs/2410.07073
  2. [2]Tayfun Ates, M. Antesoglu, Cagatay Yigit, Ilker Kesen, Mert Kobas, Erkut Erdem, Aykut Erdem, Tilbe Goksun, and Deniz Yuret. CRAFT: A benchmark for causal reasoning about forces and interactions. In Findings of the Association for Computational Linguistics: ACL 2022, pages 2602–2627, 2022. doi: 10.18653/v1/2022.findings-acl.205.DOI
  3. [3]Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, et al. Qwen3-VL technical report. arXiv preprint arXiv:2511.21631, 2025a. URL https://arxiv.org/abs/2511.21631.
  4. [4]Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, et al. Qwen2.5-VL technical report. arXiv preprint arXiv:2502.13923, 2025b. URL https://arxiv.org/abs/2502.13923.
  5. [5]Fabien Baradel, Natalia Neverova, Julien Mille, Greg Mori, and Christian Wolf. CoPhy: Counterfactual learning of physical dynamics. In International Conference on Learning Representations (ICLR), 2020. arXiv:1909.12000.arxiv.org/abs/1909.12000
  6. [6]Peter W. Battaglia, Jessica B. Hamrick, and Joshua B. Tenenbaum. Simulation as an engine of physical scene understanding. Proceedings of the National Academy of Sciences, 110(45):18327–18332, 2013.DOI
  7. [7]Daniel M. Bear, Elias Wang, Damian Mrowca, Felix J. Binder, Hsiao-Yu Fish Tung, R. T. Pramod, Cameron Holdaway, Sirui Tao, Kevin A. Smith, Fan-Yun Sun, Fei-Fei Li, Nancy Kanwisher, Joshua B. Tenenbaum, Daniel L. K. Yamins, and Judith E. Fan. Physion: Evaluating physical prediction from vision in humans and machines. In Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks, 2021.arxiv.org/abs/2106.08261
  8. [8]Kevin Black, Noah Brown, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Lachy Groom, Karol Hausman, Brian Ichter, Szymon Jakubczak, Tim Jones, Liyming Ke, Sergey Levine, Adrian Li-Bell, Mohith Mukuthuri, Suraj Nair, Karl Pertsch, Lucy Xiaoyang Shi, James Tanner, Quan Vuong, Anna Walling, Haohuan Wang, and Ury Zhilinsky. π₀: A vision-language-action flow model for general robot control. arXiv preprint arXiv:2410.24164, 2024.arxiv.org/abs/2410.24164
  9. [9]Yixing Chen, Yiding Wang, Siqi Zhu, Haofei Yu, Tao Feng, Muhan Zhang, Mostofa Patwary, and Jiaxuan You. Multi-agent evolve: LLM self-improve through co-evolution. arXiv preprint arXiv:2510.23595, 2025.arxiv.org/abs/2510.23595
  10. [10]Zhe Chen, Weiyun Wang, Yue Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Shenglong Ye, Hao Tian, Zhaoyang Liu, et al. Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling. arXiv preprint arXiv:2412.05271, 2024.arxiv.org/abs/2412.05271
  11. [11]Zhenfang Chen, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B. Tenenbaum, and Chuang Gan. ComPhy: Compositional physical reasoning of objects and events from videos. In International Conference on Learning Representations (ICLR), 2022. arXiv:2205.01089.arxiv.org/abs/2205.01089
  12. [12]Wei Chow, Jiageng Mao, Boyi Li, Daniel Seita, Vitor Guizilini, and Yue Wang. PhysBench: Benchmarking and enhancing vision-language models for physical world understanding. In International Conference on Learning Representations (ICLR), 2025. arXiv:2501.16411.
  13. [13]DeepSeek-AI. Deepseek-R1: Incentivizing reasoning capability in LLMs via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025.DOI
  14. [14]Michael Dennis, Natasha Jaques, Eugene Vinitsky, Alexandre Bayen, Stuart Russell, Andrew Critch, and Sergey Levine. Emergent complexity and zero-shot transfer via unsupervised environment design. In Advances in Neural Information Processing Systems (NeurIPS), 2020. arXiv:2012.02096.arxiv.org/abs/2012.02096
  15. [15]Kaixuan Fan, Kaituo Feng, Tianshuo Peng, Yilei Jiang, Manyuan Zhang, Jun Wang, and Xiangyu Yue. EviRover: Reinforcing agentic perception beyond a glance. arXiv preprint arXiv:2609.40230, 2026.arxiv.org/abs/2609.40230
  16. [17]Kaituo Feng, Manyuan Zhang, Hongyu Li, Kaixuan Fan, Shuang Chen, Yilei Jiang, Dian Zheng, Peiwen Sun, Yiyuan Zhang, Haoze Sun, Yan Feng, Peng Pei, Xunliang Cai, and Xiangyu Yue. OneThinker: All-in-one reasoning model for image and video. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026b. arXiv:2512.03043.arxiv.org/abs/2512.03043
  17. [18]Huan-ang Gao, Jiayi Geng, Wenxue Hua, Mengkang Hu, Xin zhe Juan, Hongzhang Liu, Shilong Liu, Jiahao Qiu, Xuan Qi, Qihan Ren, Yiran Wu, Hongru Wang, Han Xiao, Yuhang Zhou, Shaokun Zhang, Jiayi Zhang, Jinyu Xiang, Yixiong Fang, Qiwen Zhao, Dongrui Liu, Cheng Qian, Zhen-hailong Wang, Minda Hu, Huazheng Wang, Qingyun Wu, Heng Ji, and Mengdi Wang. A survey of self-evolving agents: What, when, how, and where to evolve on the path to artificial super intelligence. Transactions on Machine Learning Research, 2026. arXiv:2507.21046.arxiv.org/abs/2507.21046
  18. [19]Çağlar Gülçehre, Tom Le Paine, Srivatsan Srinivasan, Ksenia Konyushkova, Lotte Weerts, Abhishek Sharma, Aditya Siddhant, Alex Ahern, Miaosen Wang, Chenjie Gu, Wolfgang Mache rey, Arnaud Doucet, Orhan Firat, and Nando de Freitas. Reinforced self-training (ReST) for language modeling. arXiv preprint arXiv:2308.08998, 2023.arxiv.org/abs/2308.08998
  19. [20]Yicheng He, Chengsong Huang, Zongxia Li, Jiaxin Huang, and Yonghui Yang. VisPlay: Self-evolving vision-language models from images. arXiv preprint arXiv:2511.15661, 2025.arxiv.org/abs/2511.15661
  20. [21]Chengsong Huang, Wenhao Yu, Xiaoyang Wang, Hongming Zhang, Zongxia Li, Ruosen Li, Jiaxin Huang, Haitao Mi, and Dong Yu. R-Zero: Self-evolving reasoning LLM from zero data. arXiv preprint arXiv:2508.05004, 2025.arxiv.org/abs/2508.05004
  21. [25]Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Xinxi Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Christopher Wilhelm, Luca Soldaini, Noah A. Smith, Yizhong Wang, Pradeep Dasigi, and Hanna Hajishirzi. Tülu 3: Pushing frontiers in open language model post-training. arXiv preprint arXiv:2411.15124, 2024.arxiv.org/abs/2411.15124
  22. [26]Dingming Li, Yingxiu Zhao, Xinrui Cheng, Kanheng Lin, Hongbo Peng, Hongxing Li, Zixuan Wang, Yuhong Dai, Haodong Li, Jia Wang, Yukang Shi, Liang Zhao, Jianjian Sun, Zheng Ge, Xiangyu Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, and Yongliang Shen. SpatialEvo: Self-evolving spatial intelligence via deterministic geometric environments. arXiv preprint arXiv:2604.14144, 2026.arxiv.org/abs/2604.14144
  23. [27]William Liang, Sam Wang, Hung-Ju Wang, Osbert Bastani, Dinesh Jayaraman, and Yecheng Jason Ma. Evolving curricula with regret-based environment design. In Conference on Robot Learning (CoRL), 2024. arXiv:2411.01775.
  24. [28]Bo Liu, Leon Guertler, Simon Yu, Zichen Liu, Penghui Qi, Daniel Balcells, Mickel Liu, Cheston Tan, Weiyan Shi, Min Lin, Wee Sun Lee, and Natasha Jaques. SPIRAL: Self-play on zero-sum games incentivizes reasoning via multi-agent multi-turn reinforcement learning. arXiv preprint arXiv:2506.24119, 2025. URL https://arxiv.org/abs/2506.24119.
  25. [29]Meta. Llama 3.2: Revolutionizing edge AI and vision with open, customizable models. https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/, 2024.
  26. [30]Jack Parker-Holder, Minqi Jiang, Michael Dennis, Mikayel Samvelyan, Jakob Foerster, Edward Grefenstette, and Tim Rocktäschel. Evolving curricula with regret-based environment design. In Proceedings of the 39th International Conference on Machine Learning (ICML), 2022. arXiv:2203.01302.
  27. [31]Maitreya Patel, Tejas Gokhale, Chitta Baral, and Yezhou Yang. CRIPP-VQA: Counterfactual reasoning about implicit physical properties via video question answering. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 9856–9870, 2022.arxiv.org/abs/2211.03779
  28. [32]Judea Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, 2nd edition, 2009.
  29. [33]Mihir Prabhudesai, Aryan Satpathy, Yangmin Li, Zheyang Qin, Nikash Bhardwaj, Amir Zadeh, Chuan Li, Katerina Fragkiadaki, and Deepak Pathak. Solving physics olympiad via reinforcement learning on physics simulators. In International Conference on Machine Learning (ICML), 2026. URL https://sim2reason.github.io/. arXiv:2604.11805.arxiv.org/abs/2604.11805
  30. [34]Ronan Riochet, Mario Ynocente Castro, Mathieu Bernard, Adam Lerer, Rob Fergus, Véronique Izard, and Emmanuel Dupoux. IntPhys: A framework and benchmark for visual intuitive physics reasoning. arXiv preprint arXiv:1803.07616, 2018.arxiv.org/abs/1803.07616
  31. [35]Elizabeth S. Spelke. Principles of object perception. Cognitive Science, 14(1):29–56, 1990.
  32. [36]Tianyi Tang, Zhuoyi Lin, Zeyu Feng, Tianyi Ma, Yew-Soon Ong, Ivor Tsang, and Haiyan Yin. Causal scaffolding for physical reasoning: A benchmark for causally-informed physical world understanding in VLMs. arXiv preprint arXiv:2606.05966, 2026.arxiv.org/abs/2606.05966
  33. [37]Leitian Tao, Ilia Kulikov, Swarnadeep Saha, Tianlu Wang, Jing Xu, Sharon Li, Jason E. Weston, and Ping Yu. Hybrid reinforcement: When reward is sparse, it’s better to be dense. In International Conference on Learning Representations (ICLR), 2026. arXiv:2510.07242.arxiv.org/abs/2510.07242
  34. [38]Hsiao-Yu Tung, Mingyu Ding, Zhenfang Chen, Daniel M. Bear, Chuang Gan, Joshua B. Tenenbaum, Daniel L. K. Yamins, Judith E. Fan, and Kevin A. Smith. Physion++: Evaluating physical scene understanding that requires online inference of different physical properties. In Advances in Neural Information Processing Systems (NeurIPS), 2023.
  35. [39]Qinsi Wang, Bo Liu, Tianyi Zhou, Jing Shi, Yueqian Lin, Yiran Chen, Hai Helen Li, Kun Wan, and Wentian Zhao. Vision-Zero: Scalable VLM self-improvement via strategic gamified self-play. arXiv preprint arXiv:2509.25541, 2025.arxiv.org/abs/2509.25541
  36. [40]Qunzhong Wang, Jie Liu, Jiajun Liang, Yilei Jiang, Yuanxing Zhang, Yaozhi Zheng, Xintao Wang, Pengfei Wan, Xiangyu Yue, and Jiaheng Liu. VR-Thinker: Boosting video reward models through thinking-with-image reasoning. In International Conference on Machine Learning (ICML), 2026. arXiv:2510.10518.arxiv.org/abs/2510.10518
  37. [41]Rui Wang, Joel Lehman, Jeff Clune, and Kenneth O. Stanley. Paired open-ended trailblazer (POET): Endlessly generating increasingly complex and diverse learning environments and their solutions. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), 2019. arXiv:1901.01753.arxiv.org/abs/1901.01753
  38. [42]Yuxiang Wei, Zhiqing Sun, Emily McMilin, Jonas Gehring, David Zhang, Gabriel Synnaeve, Daniel Fried, Lingming Zhang, and Sida Wang. Toward training superintelligent software agents through self-play SWE-RL. arXiv preprint arXiv:2512.18552, 2025. URL https://arxiv.org/abs/2512.18552.
  39. [43]Alex Wilf, Pranjal Aggarwal, Bryan Parno, Daniel Fried, Louis-Philippe Morency, Paul Pu Liang, and Sean Welleck. Propose, solve, verify: Self-play through formal verification. In International Conference on Machine Learning (ICML), 2026. arXiv:2512.18160.arxiv.org/abs/2512.18160
  40. [44]Peng Xia, Kaide Zeng, Jiaqi Liu, Can Qin, Fang Wu, Yiyang Zhou, Caiming Xiong, and Huaxiu Yao. Agent0: Unleashing self-evolving agents from zero data via tool-integrated reasoning. arXiv preprint arXiv:2511.16043, 2025.arxiv.org/abs/2511.16043
  41. [45]Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, and Joshua B. Tenenbaum. CLEVRER: Collision events for video representation and reasoning. In International Conference on Learning Representations (ICLR), 2020.arxiv.org/abs/1910.01442
  42. [46]Jiakang Yuan, Tianshuo Peng, Yilei Jiang, Yiting Lu, Renrui Zhang, Kaituo Feng, Chaoyou Fu, Tao Chen, Lei Bai, Bo Zhang, and Xiangyu Yue. MME-Reasoning: A comprehensive benchmark for logical reasoning in MLLMs. In International Conference on Machine Learning (ICML), 2026. arXiv:2505.21327.arxiv.org/abs/2505.21327
  43. [47]Abhay Zala, Jaemin Cho, Han Lin, Jaehong Yoon, and Mohit Bansal. EnvGen: Generating and adapting environments via LLMs for training embodied agents. In Conference on Language Modeling (COLM), 2024. arXiv:2403.1014.arxiv.org/abs/2403.12014
  44. [48]Eric Zelikman, Yuhuai Wu, Jesse Mu, and Noah Goodman. STaR: Bootstrapping reasoning with reasoning. In Advances in Neural Information Processing Systems (NeurIPS), 2022.arxiv.org/abs/2203.14465
  45. [49]Andrew Zhao, Yiran Wu, Yang Yue, Tong Wu, Quentin Xu, Matthieu Lin, Shenzhi Wang, Qingyun Wu, Zilong Zheng, and Gao Huang. Absolute zero: Reinforced self-play reasoning with zero data. In Advances in Neural Information Processing Systems (NeurIPS), 2025. arXiv:2505.03335.arxiv.org/abs/2505.03335
  46. [50]Xuandong Zhao, Zhewei Kang, Aosong Feng, Sergey Levine, and Dawn Song. Learning to reason without external rewards. In International Conference on Learning Representations (ICLR), 2026. arXiv:2505.19590.arxiv.org/abs/2505.19590
  47. [51]Zhicheng Zheng, Xin Yan, Zhenfang Chen, Jingzhou Wang, Qin Zhi Eddie Lim, Joshua B. Tenenbaum, and Chuang Gan. ContPhy: Continuum physical concept learning and reasoning from videos. In Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.arxiv.org/abs/2402.06119

Paper details

vlnc:W_j7v8p9xw
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

Not recorded for this paper · View statement →

Looking for related papers…
Contents