WorksComputer Science
DreamVLA: From Generated Human Motions to Humanoid Vision-Language-Action Policies
Abstract
Training vision-language-action (VLA) policies typically depends on substantial robot demonstration data, making human teleoperation a costly and cumbersome bottleneck, particularly for whole-body humanoid interaction. Reinforcement learning in simulation offers an alternative for scaling this data, but designing task-specific rewards remains challenging. To address this, we propose DreamVLA, which uses generated motion trajectories to guide reinforcement learning (RL) in simulation, converting them into reliable task execution trajectories. These trajectories train VLA models in simulation without new task-specific teleoperation data. Our central contribution is a reference-conditioned DAgger distillation procedure: after a failed learner rollout, we restart the RL expert from a sampled learner state with the same reference suffix and aggregate successful corrective trajectories, addressing the distribution shift left by offline imitation. We evaluate picking from a platform, opening a drawer, pressing a button, and walking and picking from a platform, with ablations of DAgger iterations, residual RL, and generated dataset scale. Project website: ember-center-berkeley.github.io/DreamVLA.
Introduction
Vision-language-action (VLA) models offer a common interface for mapping visual observations and natural-language instructions to robot behavior. Models such as OpenVLA and GR00T learn from robot demonstrations and can be adapted to downstream tasks through additional training [1, 2]. For a humanoid, these demonstrations must coordinate reaching, hand interaction, torso motion, foot placement, and balance. A hierarchical interface can use a low-level (system-1) controller such as SONIC [7] to execute robot motion tokens supplied by a higher-level policy or a human teleoperation interface. Using this interface, an operator collects interactive demonstrations for VLA training. Collecting this behavior repeatedly across scene configurations demands operator time, a suitable teleoperation interface, and careful supervision. Increasing the number of tasks and environmental variations therefore increases the human effort required to build useful training data.
Simulation offers a way to scale this data, but replacing a teleoperator with an autonomous data generator introduces a control problem. Reinforcement learning in simulation with sparse task success gives a high-dimensional humanoid little guidance for approaching a target while maintaining balance [3]. Dense rewards can support exploration, yet often require task-specific choices about reaching, posture, contact, timing, and object progress [9, 12]. A policy can also satisfy parts of a reward while producing behavior that is poorly suited to imitation. Consequently, the usefulness of simulated demonstrations depends on both physical task completion and the quality of the behavior used to achieve it.
Generative human motion models provide a complementary source of structure. Text and spatial constraints can specify the intended behavior and the location of an interaction, yielding whole-body motion references with a human motion prior. DreamControl combines such references with RL for humanoid scene interaction [3]. This motivates using generated motion as a scalable source of supervision for downstream VLA training. The remaining challenge is to turn kinematic intent into repeatable interactions with movable objects, and then transfer that competence to a policy that receives images and language. Reward design remains part of this process, but references provide a unified framework for task-reward specification.
We propose DreamVLA, a framework for producing task demonstrations in simulation from generated human motions and distilling them into a VLA. We first generate task-conditioned references with DreamControl, using OmniControl to constrain relevant human joints at target locations and times [4]. After retargeting these motions to the Unitree G1, we train an expert to co-track the humanoid and the interacting object. We use SONIC as the whole-body control backbone [7], and learn residual corrections in its motion-token interface to adapt the reference behavior to contact and randomized physics. The resulting expert acts as an automated demonstration generator: motion synthesis supplies the intended human-like behavior, and RL supplies the physically executed interaction. Successful rollouts are recorded as a LeRobot dataset and used to fine-tune GR00T.
This construction is analogous to collecting teleoperation data with a generative model supplying the motion commands. It removes the need to have a human operate the robot for every downstream demonstration while retaining an interface suited to whole-body control. The human motion prior and the pretrained control and VLA backbones remain valuable upstream resources. Our claim concerns eliminating new task-specific teleoperation collection for the simulated tasks, rather than eliminating human data from the pretraining of those resources. We formulate each interaction task using motion references, object behavior, and a success specification; the present study evaluates four tasks.
The central research question is how to distill this expert into a VLA that remains competent under its own closed-loop execution. Successful expert trajectories are a useful starting point, but they emphasize states reached by the expert. A student that grasps slightly late, approaches a handle at a different angle, or misaligns its fingertip can visit states absent from that dataset. Its next action changes the next observation, allowing small errors to compound. Collecting more clean demonstrations may improve coverage of nominal behavior without providing the corrective behavior needed after these deviations. Offline imitation alone therefore leaves a gap between supervised action prediction and reliable interaction.
We address this gap through a reference-conditioned DAgger distillation procedure that collects corrective trajectories after learner failures. Standard DAgger aggregates expert labels on states encountered by the learner [8], and prior humanoid teacher–student systems such as VIRAL already use online DAgger [9]. Our task-specific adaptation queries a generated-motion, residual-SONIC expert at a randomly sampled state of a failed learner rollout. The expert resumes with the suffix of the same generated reference, and only successful recovery trajectories are added to the aggregate. This supplies temporally consistent corrective demonstrations for the language-conditioned VLA while retaining the reference context required by the expert.
The evaluation is organized around picking from a platform, opening a drawer, pressing a button, and walking and picking from a platform in simulation. These tasks expose distinct interaction requirements: establishing and maintaining a grasp, driving an articulated object, reaching a precise contact target, and combining locomotion with grasping. We present results from controlled studies of the number of DAgger iterations, the residual control formulation, and the amount of generated training data. Together, task completion, motion fidelity, and the student–expert performance gap characterize demonstration quality and the competence retained through distillation.
Our three contributions are:
A generative demonstration framework. We propose a pipeline that uses generated human motions and residual RL on a SONIC backbone to collect natural, human-like interaction demonstrations for VLA training in simulation, without task-specific human teleoperation collection.
A DAgger-based VLA distillation method. We propose using the RL expert to supervise the VLA on learner-visited states, with reference-conditioned expert recovery and success-filtered trajectory aggregation as the methodological contribution.
A four-task simulation study with controlled ablations. We evaluate platform picking, drawer opening, button pressing, and walking and picking with controlled ablations of DAgger iterations, residual RL, and generated data scale.
Related Work
Humanoid Motion Tracking and Teleoperation
Human-motion priors support humanoid tracking and whole-body control [13, 14, 15, 16, 17, 18, 19], while camera, VR, and portable interfaces support teleoperation and demonstration collection [20, 21, 22, 23, 24, 25]. We use SONIC’s motion-token interface [7] to turn generated references into autonomous interaction demonstrations. Generated motions supply the nominal commands in our pipeline, and task-specific residual RL adjusts their execution at contact without collecting new teleoperated demonstrations.
Vision-Language-Action Learning for Humanoids
Humanoid VLAs connect visual-language representations to executable behavior through multimodal pretraining and reusable motor controllers [2, 26, 27, 28, 29, 30]. Synthetic kinematic and optimal-control demonstrations also provide supervision for whole-body visual policies [31, 32]. DreamVLA uses a generated-motion, residual-SONIC expert to produce physically executed interactions and reference-conditioned corrective trajectories for GR00T. We fine-tune an existing VLA backbone and study demonstration generation and corrective supervision, without introducing a new model architecture.
Visual Sim-to-Real Across Embodiments
Across manipulation, legged, and aerial embodiments, visual sim-to-real combines simulated experience with perception randomization, privileged supervision, or reconstructed scenes [33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46]. Humanoid pipelines use teacher–student distillation [9, 12]. We study VLA distillation in simulation. Our pipeline shares privileged-to-visual supervision with these humanoid systems, while isolating motion-guided expert training and corrective VLA distillation without visual domain randomization.
Motion Generation, Retargeting, and Synthetic Demonstrations
Language-conditioned motion models provide interaction references [4, 47, 48, 49, 50, 51], while retargeting and demonstration augmentation adapt motions to robot morphology and new scenes [5, 6, 52, 53, 54]. Generative video and simulated experts offer complementary routes to synthetic policy data [55, 56, 57, 58, 59]. We build on DreamControl [3] to produce physically executed SONIC demonstrations from guided human motion. Residual RL resolves the contact dynamics left by kinematic synthesis, and successful-rollout filtering converts the resulting interactions into executable action labels for VLA training.
Expert Distillation and Corrective Data Aggregation
DAgger-style distillation addresses learner-induced distribution shift [8, 9, 60, 61]. Our adaptation restores a state from a failed VLA rollout, resumes the expert with the same reference suffix, and aggregates only successful corrective trajectories for GR00T action-chunk training. This retains the DAgger principle of querying learner-visited states while collecting full, phase-consistent recovery segments for action-chunk training.
Methodology
DreamVLA comprises four stages: reference generation, residual expert training and successful rollout collection, GR00T distillation with iterative expert recovery, and simulation validation (Figure 1). Let denote a task instruction, the full simulator state, and the student observation, consisting of camera images and robot proprioception . The expert uses privileged simulator information; the VLA predicts executable commands from and . Privileged object states used for expert training and success checks are excluded from the student observation.

Figure 1. DreamVLA overview. Task-conditioned human motions are generated with DreamControl/OmniControl, retargeted to G1 with OmniRetarget, and augmented with HumanoidMimicGen. Residual RL on SONIC produces successful LeRobot demonstrations for GR00T initialization. Our DAgger loop restarts the privileged expert from a sampled state of a failed VLA rollout, follows the same reference suffix, and aggregates successful recoveries. The final VLA is evaluated on four simulated tasks. Motion and simulation reference images are adapted from DreamControl [3].
Generating Task References with DreamControl
We follow DreamControl’s trajectory-generation stage [3]. OmniControl [4] samples human motions conditioned on an instruction and spatiotemporal constraints,
where joint is guided toward position at time . Sampling target locations and interaction times produces varied references. Wrist targets specify the picking or drawer interaction; an appropriate hand target specifies button contact.
The generated motions are retargeted to G1 using OmniRetarget [5]. After retargeting, we have a set of reference kinematic trajectories denoted by . We represent each robot reference by root pose, body joint configuration, and hand state, and align the simulated scene with its intended interaction frame. We also augment the generated trajectories by modifying the contact points using HumanoidMimicGen [6].
Residual RL for Humanoid–Object Co-Tracking
Expert inputs and object references. The privileged expert observes robot joint positions and velocities, root linear and angular velocities, gravity projected into the root frame, the previous executed command, and task-relevant object state . Following DreamControl’s privileged observation representation [3], we encode the local reference segment as current and look-ahead target observations:
where , is the number of sampled frames, and . For reference time , each target observation is
Here, specify target joint angles and velocities; represents the reference root’s position and orientation relative to the robot’s current base; and contains reference keypoint coordinates in that same frame. The hand targets encode open (0) and closed (1) configurations. For keypoint ,
where is the robot root’s rotation in world coordinates. Using the current robot frame for all targets preserves spatial tracking errors relevant to contact.
The object reference separately describes intended interaction progress: object pose for picking, drawer joint displacement for opening, or button travel for pressing. Co-tracking couples the humanoid reference to the corresponding object outcome, so matching a hand trajectory alone does not satisfy the interaction objective. Reference windows and privileged object state are used by the RL expert; the VLA executes without these inputs.
SONIC backbone and residual token actions. SONIC maps motion commands into a shared token representation and decodes them with proprioception into robot control commands [7]. We use this interface as the backbone for a residual task expert. Let denote the motion encoder and the control decoder. We write the residual formulation as
The residual adapts the generated motion to the actual robot–object interaction, while SONIC provides the underlying whole-body control prior. The hand commands complete the executable expert command . We operate the hand in a binary open/close mode i.e. the hand action is binary.
Training objective. The expert is trained to maximize return under a reward comprising humanoid reference tracking, sparse task-specific rewards, and control regularization:
The reward structure for the tasks is the same as in DreamControl [3]. The tracking objectives supply dense reference supervision; the task objective checks meaningful interaction progress or completion. The regularization term discourages excessive corrections and abrupt commands. Reference tracking guides the motion strategy, while sparse task rewards specify the interaction outcome.
Physics domain randomization. We randomize robot and object physics during expert training to expose the policy to variation in interaction dynamics. Randomized scenes preserve feasibility and remain compatible with their target references. Physics randomization addresses control robustness; the VLA is trained without visual domain randomization.
Successful Expert Rollouts as a LeRobot Dataset
After expert training, we execute rollouts over sampled scenes, references, and physical parameters. An episode is accepted only when its task-specific success predicate is satisfied. We export synchronized images, proprioceptive states, actions, timestamps, episode identifiers, and task instructions in LeRobot format [10]. The initial imitation dataset is
where represents the composed SONIC motion command and the hand command, is the language prompt, is the observation consisting of camera images, , and proprioception . We use only the robot’s egocentric camera to obtain . By predicting these executable commands, the VLA uses the same low-level backbone without a reference trajectory at inference. Each accepted episode contains the executed interaction, including the approach and completion phases. This produces successful demonstrations suitable for VLA supervision from physically simulated expert behavior.
Success filtering improves the quality of the initial demonstration set, but changes its distribution. Difficult scenes may contribute to fewer accepted episodes and nominal successes may contain little corrective behavior. We therefore track both the number of attempted episodes and the number retained, along with scene coverage. The DAgger stage extends this dataset with successful expert recoveries from learner-induced failures.
GR00T Fine-Tuning and DAgger-Based Distillation
Offline initialization. We fine-tune a pretrained GR00T VLA [2] on , conditioning action prediction on visual observations, robot state, and task instruction. Let denote an expert action chunk of horizon . Constructing action chunks from consecutive samples within each episode, the initialization objective is
The loss is the native action-training objective of the selected GR00T implementation. Privileged object state and reference context remain available to the expert but are excluded from the student.
Why iterative supervision is needed. The initialized student is trained on expert-generated observations and then evaluated on observations induced by its own actions. These distributions differ whenever perception, timing, or action prediction changes the interaction. This matters particularly at contact: a small error can alter whether an object is grasped, whether a drawer handle is engaged, or whether a button is actuated. The appropriate next command may then differ substantially from the next command in the original successful trajectory. Iterative distillation exposes the VLA to such states and obtains expert supervision appropriate to the current interaction.
Standard DAgger foundation. At iteration , the current student is rolled out and the expert labels selected visited states. Denoting that set of states by , the standard aggregation structure is
followed by training the next student on the aggregate [8]. The context denotes whatever reference and task information is required to make an expert query well defined. Equation (10) describes the established DAgger principle.
Reference-conditioned recovery DAgger. Our adaptation collects successful expert recovery segments seeded by states from failed learner rollouts, rather than independently labeling every learner state. At iteration , we use the following procedure:
Sample a reference with length and initialize the robot and object according to that reference.
Roll out the current VLA until task success or timeout at , saving simulator states along the learner trajectory. Successful learner rollouts require no corrective trajectory in this procedure.
For a failed rollout, sample uniformly from and restore the saved learner state . Resume the privileged RL expert using the same reference starting at phase . Retain the resulting corrective segment only if the expert completes the task within the remaining reference horizon; otherwise discard it.
Let denote this expert recovery segment, and let , , and denote its states, observations, and executed expert commands. The initial recovery state satisfies , while subsequent states are induced by the expert. Aggregation therefore takes the trajectory-level form
where is the recovery termination time in the original reference clock. We fine-tune GR00T on the aggregate and repeat. Action chunks are constructed within each accepted segment, without crossing episode or recovery boundaries. The student uses the same visual, proprioceptive, and language inputs as during offline initialization; simulator state and the reference suffix are used only to query the expert. This makes the distinction from standard pointwise DAgger explicit: supervision is provided by successful, reference-conditioned expert continuations from learner-induced failures.
Results
We evaluate DreamVLA on four simulated interaction tasks and study the effects of DAgger iterations, residual control, and generated dataset scale.
Four-Task Setup and the Effect of DAgger Iterations
Task suite. We evaluate a simulated Unitree G1 on the four interactive tasks in Table 1. Each task requires whole-body coordination and a verifiable task outcome. Table 1 defines the task-specific success criteria. Figure 2 shows representative simulation scenes for the four tasks.
| Task | Interaction setup | Success predicate |
| Pick from platform | Reach an object on a platform, grasp it, and lift while maintaining balance. | Object is lifted at least 15 cm above the platform and remains held. |
| Open drawer | Approach the handle, establish contact or grasp, and pull along the drawer’s articulation. | Drawer displacement exceeds 0.15 m. |
| Press button | Align the interacting hand with the button and establish actuating contact. | The robot’s right index finger contacts the button. |
| Walk and pick | Walk to a platform with an object on it, reach for the object, grasp it, and lift while maintaining balance. | Object is lifted at least 15 cm above the platform and remains held. |
Table 1. Task setup and success criteria for the four simulated interactions.

Figure 2. Four-task simulation setup with the Unitree G1: (a) picking from a platform, (b) opening a drawer, (c) pressing a button, and (d) walking and picking from a platform. The screenshots are cropped to equal-sized panels with comparable robot heights.
Evaluation and reporting. The primary metric is task success rate. The distribution of object, button, or drawer-handle locations is the same as the distribution from which target positions are chosen for generating their trajectories. We also report per-task expert success, student performance relative to the expert, and mean per-joint position error (MPJPE). For each task-success rate evaluation, we use 100 rollouts.
DAgger iteration ablation. We compare the offline student () with students after 1, 2, and 3 aggregation rounds (Table 2). We use 200 initial expert trajectories and collect 200 additional successful corrective trajectories per round, giving 800 trajectories at . The matched offline-data control uses 800 successful trajectories collected from the base expert without learner-triggered recovery, matching the total trajectory budget of three DAgger rounds. This controls for the amount of data when evaluating the usefulness of corrective aggregation.
| Distillation variant | Rounds | Trajectories | Pick | Drawer | Button | Walk and Pick |
| Offline GR00T initialization | 0 | 200 | 0% | 51% | 59% | 0% |
| DAgger with | 1 | 400 | 17% | 55% | 58% | 1% |
| DAgger with | 2 | 600 | 30% | 54% | 62% | 7% |
| DAgger with | 3 | 800 | 54% | 60% | 69% | 18% |
| Matched offline-data control | 0 | 800 | 0% | 54% | 57% | 0% |
Table 2. DAgger results on all tasks. Success is reported per task with 100 random environment settings.
Effectiveness of Residual RL on SONIC
This study isolates the choice to learn residual SONIC token commands. Table 3 compares expert task success and tracking error after the same budget of 3000 RL training iterations for the learned formulations. Residual token RL achieves higher task success than absolute token RL under this matched training budget. We also report performance of using SONIC commands as-is with no residual RL. Without residual adaptation, nominal SONIC tracking has zero success on picking and lower success than residual RL on the other tasks (Table 3). Tracking error in the base SONIC controller and kinematic references that are not exactly trackable can hinder zero-shot execution on precise tasks. Residual RL makes small trajectory corrections needed to complete the task while retaining the nominal SONIC motion, and compensates for the forces needed to pick an object or open a heavy drawer. Figure 3 compares matched video frames from nominal and residual execution. In this rollout, nominal SONIC tips the mustard bottle off the counter, whereas residual control retains the bottle in the hand.
Table 3: Expert task success and tracking error for nominal SONIC tracking, residual token RL, and absolute token RL. MPJPE is mean per-joint position error; lower is better.
| Expert formulation | Pick | Drawer | Button | Walk and Pick | MPJPE (mm) |
| Nominal SONIC tracking | 0% | 30.0% | 68.0% | 17.30% | 24.84 |
| Residual SONIC token RL | 88.6% | 74.0% | 81.0% | 75.95% | 25.51 |
| Absolute token RL control | 0% | 0% | 0% | 0% | 62.29 |
Table 3.
Figure 3. Matched nominal and residual SONIC execution on the mustard-bottle interaction. Both subfigures use video frames 50, 250, and 739 (the final frame), corresponding to 1.00, 5.00, and 14.78 s, with identical crop coordinates. (a) Left: nominal zero-shot tracking tips the bottle off the counter; the bottle is on the floor at the end. (b) Right: residual control retains the bottle in the hand.
Scaling the Generated Dataset
We vary the number of generated kinematic references while keeping the task mix, observation/action schema, and evaluation set fixed. Nested subsets sampled at the episode level allow comparisons across data budgets. Increasing the number of generated references leads to more diverse behavior and coverage, and higher success rates for drawer opening and button pressing; picking and walking and picking remain at zero success in this ablation. Table 4 reports episode counts and per-task success across reference budgets.
Table 4: Generated-data scaling. Nested reference budgets are fixed at 10, 50, and 200; episode counts and held-out task success are reported for each budget.
| References | Episodes | Pick | Drawer | Button | Walk and Pick |
| 10 | 10 | 0% | 13.0% | 0% | 0% |
| 50 | 50 | 0% | 51.0% | 14.0% | 0% |
| 200 | 200 | 0% | 51.0% | 59.0% | 0% |
Table 4.
Limitations
The evaluation is limited to four simulated interaction tasks on a single humanoid embodiment. Generated motions can be incompatible with robot kinematics or contact requirements, and task-specific guidance, filtering, object references, and reward weights remain necessary parts of the pipeline.
Successful-rollout filtering may underrepresent difficult configurations. Reference-conditioned experts may provide unreliable or abrupt corrections on learner-visited states, particularly during precise interactions.
Conclusion and Future Work
We present a framework for turning generated human motion into simulated humanoid demonstrations and using them to train a VLA. DreamControl supplies task-conditioned references, residual RL on a SONIC backbone adapts them to robot–object interaction, and successful rollouts initialize GR00T fine-tuning. Reference-conditioned recovery DAgger distills expert behavior under learner-induced state distributions by aggregating successful corrective continuations.
Future work focuses on expanding the task set and the diversity of interacting objects, studying longer task sequences, and quantifying data-generation efficiency at larger scale. A further direction is sim-to-real deployment, informed by the visual humanoid transfer pipelines of DoorMan and VIRAL [9, 12]. Key requirements include validating the control and sensing stack on hardware, matching cameras and contact behavior, and studying visual and physical randomization. These directions extend the present simulation study; hardware deployment is outside its scope.
Acknowledgments
This research was supported in part by DOD Advanced Research Projects Agency project Design of Robustly Implementable Autonomous and Intelligent Machines under Award HR00112490425.
References
- [1]M. J. Kim, K. Pertsch, S. Karamcheti, et al. OpenVLA: An Open-Source Vision-Language-Action Model. arXiv:2406.09246, 2024. https://arxiv.org/abs/2406.09246.
- [2]J. Bjorck, F. Castañeda, N. Cherniadev, et al. GR00T N1: An Open Foundation Model for Generalist Humanoid Robots. arXiv:2503.14734, 2025. https://arxiv.org/abs/2503.14734.
- [3]D. Kalaria, S. Harithas, P. Katara, S. Kwak, S. Bhagat, S. S. Sastry, S. Sridhar, S. Vemprala, A. Kapoor, and J. Huang. DreamControl: Human-Inspired Whole-Body Humanoid Control for Scene Interaction via Guided Diffusion. arXiv:2509.14353, 2025. https://genrobo.github.io/DreamControl/static/paper/DreamControl_arxiv.pdf.arxiv.org/abs/2509.14353
- [4]Y. Xie, V. Jampani, L. Zhong, D. Sun, and H. Jiang. OmniControl: Control Any Joint at Any Time for Human Motion Generation. In International Conference on Learning Representations, 2024. https://arxiv.org/abs/2310.08580.
- [5]L. Yang, X. Huang, Z. Wu, A. Kanazawa, P. Abbeel, C. Sferrazza, C. K. Liu, R. Duan, and G. Shi. OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction. arXiv:2509.26633, 2025. https://arxiv.org/abs/2509.26633.
- [6]K. Lin, A. Mandlekar, C. R. Garrett, N. Chernyadev, Y. Fang, R. Ding, Y. Xie, J. Tran, L. Fan, and Y. Zhu. HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning. arXiv:2605.27724, 2026. https://arxiv.org/abs/2605.27724.
- [7]Z. Luo, Y. Yuan, T. Wang, C. Li, F. Castañeda, et al. SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control. Science Robotics, 11(117):eaed4592, 2026. doi: 10.1126/scirobotics.aed4592. https://arxiv.org/abs/2511.07820.
- [8]S. Ross, G. Gordon, and D. Bagnell. A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, PMLR 15:627–635, 2011. https://proceedings.mlr.press/v15/ross11a.html.arxiv.org/abs/1011.0686
- [9]T. He, Z. Wang, H. Xue, Q. Ben, Z. Luo, W. Xiao, Y. Yuan, X. Da, F. Castañeda, S. Sastry, C. Liu, G. Shi, L. Fan, and Y. Zhu. VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation. arXiv:2511.15200, 2025. https://arxiv.org/abs/2511.15200.
- [10]Hugging Face. LeRobotDataset v3.0: Dataset documentation. Online documentation, accessed October 2, 2026. https://huggingface.co/docs/lerobot/lerobot-dataset-v3.
- [12]H. Xue, T. He, Z. Wang, Q. Ben, W. Xiao, Z. Luo, X. Da, F. Castañeda, G. Shi, S. Sastry, L. Fan, and Y. Zhu. Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer. arXiv:2512.01061, 2025. https://arxiv.org/abs/2512.01061.
- [13]X. B. Peng, P. Abbeel, S. Levine, et al. DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills. arXiv:1804.02717, 2018. https://arxiv.org/abs/1804.02717.
- [14]X. B. Peng, Z. Ma, P. Abbeel, et al. AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control. arXiv:2104.02180, 2021. https://arxiv.org/abs/2104.02180.
- [15]Z. Luo, J. Cao, A. Winkler, et al. Perpetual Humanoid Control for Real-time Simulated Avatars. arXiv:2305.06456, 2023. https://arxiv.org/abs/2305.06456.
- [16]M. Ji, X. Peng, F. Liu, et al. ExBody2: Advanced Expressive Humanoid Whole-Body Control. arXiv:2412.13196, 2024. https://arxiv.org/abs/2412.13196.
- [17]Q. Liao, T. E. Truong, X. Huang, et al. BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion. arXiv:2508.08241, 2025. https://arxiv.org/abs/2508.08241.
- [18]T. He, J. Gao, W. Xiao, et al. ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills. arXiv:2502.01143, 2025. https://arxiv.org/abs/2502.01143.
- [19]H. Li, P. Li, Y. Tao, et al. PGMT: Perceptive General Motion Tracking for Humanoid Robots. arXiv:2609.08511, 2026. https://arxiv.org/abs/2609.08511.
- [20]T. He, Z. Luo, W. Xiao, et al. Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation. arXiv:2403.04436, 2024. https://arxiv.org/abs/2403.04436.
- [21]T. He, Z. Luo, X. He, et al. OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learning. arXiv:2406.08858, 2024. https://arxiv.org/abs/2406.08858.
- [22]Z. Fu, Q. Zhao, Q. Wu, et al. HumanPlus: Humanoid Shadowing and Imitation from Humans. arXiv:2406.10454, 2024. https://arxiv.org/abs/2406.10454.
- [23]Y. Ze, Z. Chen, J. P. Araújo, et al. TWIST: Teleoperated Whole-Body Imitation System. arXiv:2505.02833, 2025. https://arxiv.org/abs/2505.02833.
- [24]H. Wang, C. Yu, Y. Hu, et al. HumanoidUMI: Bridging Robot-Free Demonstrations and Humanoid Whole-Body Manipulation. arXiv:2606.27239, 2026. https://arxiv.org/abs/2606.27239.
- [25]Y. Nai, L. Chang, L. Yang, et al. Whole-Body UMI: Transferring UMI Manipulation Skills to Humanoid Whole-Body Manipulation via Real-Time Motion Generation. arXiv:2609.22829, 2026. https://arxiv.org/abs/2609.22829.
- [26]NVIDIA. GROOT N1.6. Model release and technical overview, 2025. Accessed October 8, 2026. https://research.nvidia.com/labs/gear/gr00t-n1_6/.
- [27]NVIDIA. Isaac GROOT N1.7: Model Card. Model card, 2026. Accessed October 8, 2026. https://huggingface.co/nvidia/GROOT-N1.7-3B.
- [28]Figure. Helix: A Vision-Language-Action Model for Generalist Humanoid Control. Technical report, 2025. Accessed October 8, 2026. https://www.figure.ai/news/helix.
- [29]Figure. Introducing Helix 02: Full-Body Autonomy. Technical report, 2026. Accessed October 8, 2026. https://www.figure.ai/news/helix-02.
- [30]Figure. Helix 2.5: Zero-Shot 30-Home Generalization. Technical report, 2026. Accessed October 8, 2026. https://www.figure.ai/news/helix-2-5-zero-shot-30-home-generalization.
- [31]Y. Wang, J. Li, S. Chen, et al. VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes. arXiv:2606.30645, 2026. https://arxiv.org/abs/2606.30645.
- [32]M. Boukheddimi, O. Adjali, D. Sontag, et al. WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning. arXiv:2606.25591, 2026. https://arxiv.org/abs/2606.25591.
- [33]J. Tobin, R. Fong, A. Ray, et al. Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World. arXiv:1703.06907, 2017. https://arxiv.org/abs/1703.06907.
- [34]OpenAI, M. Andrychowicz, B. Baker, et al. Learning Dexterous In-Hand Manipulation. arXiv:1808.00177, 2018. https://arxiv.org/abs/1808.00177.
- [35]A. Handa, A. Allshire, V. Makoviychuk, et al. DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality. arXiv:2210.13702, 2022. https://arxiv.org/abs/2210.13702.
- [36]A. Bhardwaj, M. Wilder-Smith, M. Mittal, et al. ViserDex: Visual Sim-to-Real for Robust Dexterous In-hand Reorientation. arXiv:2604.11138, 2026. https://arxiv.org/abs/2604.11138.
- [37]M. Torne, A. Simeonov, Z. Li, et al. Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation. arXiv:2403.03949, 2024. https://arxiv.org/abs/2403.03949.
- [38]Y. Jiang, C. Wang, R. Zhang, et al. TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction. arXiv:2405.10315, 2024. https://arxiv.org/abs/2405.10315.
- [39]J. Wu, L. Yuan, Z. Sun, et al. DEXTERA: From a Single Image to Deployable Dexterous Manipulation via Real-to-Sim-to-Real. arXiv:2609.21045, 2026. https://arxiv.org/abs/2609.21045.
- [40]A. Deshpande, M. Guru, R. Hendrix, et al. MolmoBOT: Large-Scale Simulation Enables Zero-Shot Manipulation. arXiv:2603.16861, 2026. https://arxiv.org/abs/2603.16861.
- [41]J. Hu, R. Hendrix, A. Farhadi, et al. FLaRe: Achieving Masterful and Adaptive Robot Policies with Large-Scale Reinforcement Learning Fine-Tuning. arXiv:2409.16578, 2024. https://arxiv.org/abs/2409.16578.
- [42]T. Miki, J. Lee, J. Hwangbo, et al. Learning robust perceptive locomotion for quadrupedal robots in the wild. arXiv:2201.08117, 2022. https://arxiv.org/abs/2201.08117.
- [43]X. Cheng, K. Shi, A. Agarwal, et al. Extreme Parkour with Legged Robots. arXiv:2309.14341, 2023. https://arxiv.org/abs/2309.14341.
- [44]H. Ha, Y. Gao, Z. Fu, et al. UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers. arXiv:2407.10353, 2024. https://arxiv.org/abs/2407.10353.
- [45]A. Cheng, Y. Ji, Z. Yang, et al. NaVILA: Legged Robot Vision-Language-Action Model for Navigation. arXiv:2412.04453, 2024. https://arxiv.org/abs/2412.04453.
- [46]A. Loquercio, E. Kaufmann, R. Ranftl, et al. Learning High-Speed Flight in the Wild. arXiv:2110.05113, 2021. https://arxiv.org/abs/2110.05113.
- [47]G. Tevet, S. Raab, B. Gordon, et al. Human Motion Diffusion Model. arXiv:2209.14916, 2022. https://arxiv.org/abs/2209.14916.
- [48]J. Zhang, Y. Zhang, X. Cun, et al. T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations. arXiv:2301.06052, 2023. https://arxiv.org/abs/2301.06052.
- [49]B. Jiang, X. Chen, W. Liu, et al. MotionGPT: Human Motion as a Foreign Language. arXiv:2306.14795, 2023. https://arxiv.org/abs/2306.14795.
- [50]J. Li, J. Wu, and C. K. Liu. Object Motion Guided Human Motion Synthesis. arXiv:2309.16237, 2023. https://arxiv.org/abs/2309.16237.
- [51]J. Li, A. Clegg, R. Mottaghi, et al. Controllable Human-Object Interaction Synthesis. arXiv:2312.03913, 2023. https://arxiv.org/abs/2312.03913.
- [52]J. P. Araujo, Y. Ze, P. Xu, et al. Retargeting Matters: General Motion Retargeting for Humanoid Motion Tracking. arXiv:2510.02252, 2025. https://arxiv.org/abs/2510.02252.
- [53]A. Mandlekar, S. Nasiriany, B. Wen, et al. MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations. arXiv:2310.17596, 2023. https://arxiv.org/abs/2310.17596.
- [54]C. Garrett, A. Mandlekar, B. Wen, et al. SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment. arXiv:2410.18907, 2024. https://arxiv.org/abs/2410.18907.
- [55]H. Bharadhwaj, D. Dwibedi, A. Gupta, et al. Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation. arXiv:2409.16283, 2024. https://arxiv.org/abs/2409.16283.
- [56]J. Jang, S. Ye, Z. Lin, et al. DreamGen: Unlocking Generalization in Robot Learning through Video World Models. arXiv:2505.12705, 2025. https://arxiv.org/abs/2505.12705.
- [57]H. Li, I. Zhang, R. Ouyang, et al. MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Training. arXiv:2509.22199, 2025. https://arxiv.org/abs/2509.22199.
- [58]S. Ye, Y. Ge, K. Zheng, et al. World Action Models are Zero-shot Policies. arXiv:2602.15922, 2026. https://arxiv.org/abs/2602.15922.
- [59]W. Ye, F. Liu, Z. Ding, et al. Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videos. arXiv:2502.09886, 2025. https://arxiv.org/abs/2502.09886.
- [60]M. Kelly, C. Sidrane, K. Driggs-Campbell, et al. HG-DAgger: Interactive Imitation Learning with Human Experts. arXiv:1810.02890, 2018. https://arxiv.org/abs/1810.02890.
- [61]R. Li, Y. Korkmaz, and E. Biyik. Reward-DAgger: Robot-Gated Interactive Imitation Learning with General-Purpose Progress-Based Reward Models. arXiv:2610.04054, 2026. https://arxiv.org/abs/2610.04054.
