betaFeedback

WorksComputer Science

DexSuite: An All-in-One Framework for Dexterous Manipulation Across Arms, Hands, and Tasks

Abstract

Human-level dexterity remains a central open problem in robotics, yet few simulation frameworks cover the full workflow of dexterous manipulation, from setting up a robot to collecting dexterous demonstrations and evaluating policies. We present DexSuite, an all-in-one simulation framework for dexterous manipulation built on the Genesis simulator. DexSuite provides 30 tasks and assembles its 10 arms and 12 end-effectors, from parallel-jaw grippers to dexterous hands, into more than 100 single-arm robots and thousands of bimanual pairs. It also ships a standardized environment API, integrated teleoperation, and simulated tactile sensing. Moreover, we define a benchmark of 16 task-embodiment pairs spanning diverse contact complexities and horizons, and release a dataset of 4,700 successful episodes in simulation from human teleoperation, scripted experts, and learned policies. We release DexSuite as open source and hope others will build on it. Videos and datasets are available at https://dexsuiteorg.github.io

As humans, we designed the physical world for dexterous hands [1], [2]. Parallel-jaw grippers have enabled impressive progress in pick-and-place style manipulation, but they remain limited when tasks require in-hand adjustment, multi-point stabilization, or tool-like interactions [3], [4]. If robots are to operate in existing environments rather than in environments reshaped around their limitations, dexterous hands must be treated as a first-class benchmark target.

Recent advances in simulation, perception, and learning have accelerated progress in robotic manipulation [5, 6, 7, 8, 9, 10]. Since large-scale hardware experimentation remains slow and failure-prone, simulation is the most practical path to scalable training and controlled evaluation. Nevertheless, most widely used simulation benchmarks continue to prioritize parallel-jaw grippers [7], [9]–[17], as do the largest teleoperation datasets [18]–[23]. In part, this is because dexterous hands are harder to teleoperate, train, and evaluate given their high-dimensional actuation, reliance on intermittent contacts, and sensitivity to modeling errors [24]–[26]. Controlled studies across embodiments therefore remain difficult. Multi-finger benchmarks are often specialized for a specific hand model on a fixed set of tasks [27], and end-effectors are rarely swapped under consistent success metrics, and existing research in bimanual dexterity is spread across different frameworks [28], [29].

Introduction

As humans, we designed the physical world for dexterous hands [1], [2]. Parallel-jaw grippers have enabled impressive progress in pick-and-place style manipulation, but they remain limited when tasks require in-hand adjustment, multi-point stabilization, or tool-like interactions [3], [4]. If robots are to operate in existing environments rather than in environments reshaped around their limitations, dexterous hands must be treated as a first-class benchmark target.

Notes. Parallel denotes built-in vectorized environments for RL (not just GPU rendering). Tactile Sensing denotes built-in tactile-array observations with ready-to-use tactile end-effectors. Hand Teleop denotes built-in teleoperation of dexterous fingers, for example with data gloves or hand tracking.

We present DexSuite (Figure 1), which standardizes task semantics and includes a benchmark with teleoperated demonstrations to support reproducible learning and comparison across embodiments. We use the benchmark to study (i) whether policies trained for a dexterous hand get the same success rates as policies trained for a gripper on identical tasks, (ii) to what extent long-horizon and sequential-contact tasks reduce hand success more than short tasks, and finally (iii) which task types relying on finger-level control remain challenging for standard imitation learning. Our contributions are threefold.

DexSuite framework overview

Figure 1. DexSuite. An all-in-one simulation framework for dexterous manipulation, supporting diverse embodiments, GPU-parallel simulation, and cross-embodiment training and evaluation. It includes a benchmark of 16 task-embodiment pairs, a dataset of 4,700 successful episodes, and training and evaluation pipelines.

DexSuite framework. Built on Genesis [30], a lightweight and Python-native simulator, DexSuite provides 30 tasks, a standardized environment API, integrated teleoperation, and simulated tactile sensing.

Benchmark. A curated benchmark of 16 task-embodiment pairs designed to evaluate dexterous manipulation across action dimensionality, temporal horizon, and contact-rich control, with baselines for five imitation learning methods.

DexSuite dataset. A release of 4,700 successful episodes from human teleoperation, scripted experts and learned policies.

Related Work

Manipulation simulators

Isaac Lab [6] and ManiSkill3 [8] enable GPU-parallel simulation for scalable robot learning. The robosuite [9] and RLBench [10] frameworks provide large task families and standardized APIs. RoboCasa [11] and OmniGibson [17] supply high-quality and realistic scenes. However, dexterous-hand and arm-with-gripper tasks are typically separated, and bimanual benchmarks are fragmented across suites. While some suites include both dexterous hands and grippers, swapping end-effectors while keeping the same scene and conditions is uncommon. When several configurations are supported, hand-versus-gripper comparison on identical tasks is usually not the primary benchmark interface [9]. Table I summarizes the capabilities of major simulation frameworks.

NamePhysicsParallelRigid Deform/FluidRobot LibraryDex HandsBimanualEmbodiment IndependentHand DatasetHand TeleopTactile Sensing
DexSuiteGenesis✓✓✓✓✓✓✓✓✓
robosuiteMuJoCo✗✗✓✓✓✓✗✗✗
Isaac LabPhysX✓✗✓✓✓✗✗✓✓
RLBenchCoppeliaSim✗✗✓✗✗✗✗✗✗
ManiSkill3SAPIEN/ PhysX✓✗✓✓✓✗✗✗✓
OmniGibsonPhysX✓✓✓✓✓✓✗✓✗
RoboCasaMuJoCo✗✗✓✗✗✗✗✗✗

Table I. Comparison of manipulation frameworks and integrated resources.

Dexterous manipulation benchmarks

DexArt [26] benchmarks arm-mounted hands on articulated objects, DexMV converts third-person human videos into robot-hand demonstrations [31], and Dactyl [24] and DAPG [25] established in-hand reorientation with reinforcement learning and demonstration-augmented reinforcement learning from teleoperated data, respectively. These efforts each evaluate a single hand model. For bimanual dexterity, Bi-DexHands provides two-hand tasks with free-floating Shadow Hands on Isaac Gym [5], [29], while PerAct2 [10], [28] and robosuite [9] provide dual-arm tabletop tasks with parallel-jaw grippers. Concurrent work such as LabDex [32] benchmarks dexterous manipulation in laboratory settings, in both simulation and the real world.

Datasets for imitation and offline learning

Large-scale datasets such as DROID [19] and Open X-Embodiment [20] have demonstrated the impact of teleoperation data on learning generalist policies, but they use parallel-jaw grippers, focus on arm-level behaviors [18], and are not designed to compare grippers and dexterous hands on identical tasks. Hand-centric datasets such as DexDeform [27] and DexMV [31] are tied to specific embodiments and task families, while large synthetic grasp datasets [33]–[36] provide static grasps or short-horizon motions rather than full manipulation trajectories under a consistent observation and action interface.

DexSuite is designed to fill this gap. It integrates GPU-parallel simulation, rigid, articulated and deformable dynamics, simulated tactile sensing, native dexterous and bimanual setups, and on-the-fly modular robot composition within a single stack. DexSuite defines embodiment-independent tasks and success conditions. This allows the integration of a large number of robot configurations for every task. We pair this simulation framework with a fixed benchmark protocol containing full-episode teleoperation demonstrations for dexterous hands.

DexSuite

DexSuite is a simulation framework built on top of Genesis [30]. Genesis provides the underlying physics, rendering, asset loading, and parallel simulation, while DexSuite provides the manipulation layer needed to turn these primitives into reproducible robot learning experiments. As shown in Figure 2, this layer includes a library of tasks and robot embodiments, embodiment-independent task definitions, modular arm and end-effector composition, workspace-aware initialization, tactile sensing (Figure 3), teleoperation, and a unified Gymnasium API. DexSuite further provides a benchmark and curated dataset of dexterous manipulation demonstrations for training and evaluation.

Figure 2. DexSuite architecture. Tasks define assets, reset logic, observations, actions, and success metrics. Robot embodiments and controllers are instantiated through a shared abstraction on top of Genesis.

Simulated readings from the two FlexiTac pads of the UMI-style gripper

Figure 3. Simulated readings from the two FlexiTac pads of the UMI-style gripper (Right) during the pan task (Left).

Environments

DexSuite includes a total of 30 tasks designed to evaluate various aspects of robotic manipulation. These are categorized into two physical domains requiring different control strategies.

  • Rigid objects (23 tasks). Fundamental skills such as reaching, lifting, pushing, pick-and-place, stacking, and object reorientation. These tasks emphasize precision grasping and contact stability.

  • Articulated objects (7 tasks). Interactions with mechanisms that have internal degrees of freedom, such as folding glasses, opening a jar, pressing a toaster lever or closing a window sash. These require an understanding of kinematic constraints and applying forces along specific trajectories.

We also integrate the YCB object and model set [37], add a set of new objects with tuned masses and centers of mass, and provide textures with varying friction and light reflection properties.

Embodiment Abstraction

Robot manipulation frameworks often implicitly hard-code task logic and object initialization to a specific robot kinematic structure [6], [8]. DexSuite addresses this by adapting environment constraints to the loaded robot, rather than imposing static workspace assumptions. The framework provides 10 arms alongside integrated robots and a library of end-effectors, most of them adapted from MuJoCo Menagerie [38]. Modular composition supports single-arm and bimanual configurations for both existing and new tasks.

Robot composition. DexSuite abstracts robot construction into modular and integrated definitions to support a variety of asset formats. Independent arm and end-effector models are combined to create modular robots at runtime. Regardless of the underlying robot definition, this abstraction offers a common control interface that enables the arm to be controlled via inverse kinematics and the hand through joint-position commands. The same idea applies to task design where DexSuite exposes a single Tool Center Point (TCP) for all end-effectors, which is the midpoint of the fingertip for grippers or a central reachable frame for dexterous hands, in order to define rewards and success conditions regardless of embodiment (Figure 4).

Tasks contained in the DexSuite benchmark

Figure 4. Tasks contained in the DexSuite benchmark. The five at the top are for cross-embodiment evaluation; the bottom ones target multi-fingered dexterous capability.

Workspace-aware sampling. Many frameworks hard-code object sampling regions to a specific robot workspace, causing invalid initializations when changing embodiments. DexSuite instead uses Workspace-Aware Sampling, assigning each arm a reachable Workspace Axis-Aligned Bounding Box (AABB). This allows task initialization to automatically adapt across embodiments while remaining kinematically feasible.

Data Collection and Interfaces

Teleoperation. DexSuite supports teleoperation for both arm and finger control (Figure 5). Arm pose can be controlled with a SpaceMouse, HTC Vive, or Meta Quest controllers, while finger motion can be captured using MediaPipe [39], Leap Motion, Meta Quest hand tracking, or Manus MetaGlove Pro gloves. Related systems such as BiDex [40] and TeleDex [41] teleoperate dexterous hands with motion-capture gloves and smartphones.

Teleoperation devices integrated in DexSuite

Figure 5. Teleoperation devices integrated in DexSuite.

Tactile sensing. DexSuite simulates the FlexiTac tactile sensor [42] (Figure 3). A tactile pad is a grid of taxels on a flat elastomer, 12 by 32 at 2 mm spacing by default as on the real pad, and each taxel converts its penetration into nearby objects into a normal and a friction force. Pads can be declared on any end-effector link with a flat contact surface, with configurable grid size and spacing. We ship tactile pads on a UMI-style parallel-jaw gripper [43] and on a tactile ALOHA manipulator, and the scripted gripper demonstrations record both pads at every step. The Sharpa demonstrations record per-finger contact forces instead.

Extensibility. DexSuite allows task, robot, controller, sensor, and simulation configuration through a single make interface. New embodiments can be composed from existing arms and end-effectors without modifying task logic, allowing platforms such as bimanual ALOHA [44] and DROID [19] to be instantiated within the same framework. All environments follow the Gymnasium interface [45], enabling direct

Benchmark & Dataset

Benchmark Design

To address the three questions raised in the introduction, namely the embodiment gap, robustness to long horizons, and contact-rich capability, the benchmark contains 11 tasks organized into two evaluation tracks (Figure 4). Five tasks are simple enough to be attempted with either end-effector and are completed with both a parallel-jaw gripper and the Allegro hand. The other six are completed with a dexterous hand only, because their geometry precludes the use of a simple gripper. Four of them use the 16-DoF Allegro hand and the final two use the 22-DoF Sharpa Wave hand due to their extreme geometric complexity. This gives 16 task-embodiment pairs.

Track 1. Cross-Embodiment Evaluation. The five shared tasks use identical task definitions and success criteria for both end-effectors.

Track 2. Multi-fingered Dexterous Capability. The six hand-only tasks target stable grasping, constrained transport, tool use, multi-object interaction, and long-horizon manipulation.

Together, the two tracks separate embodiment effects from challenges that specifically require dexterous hands, while spanning tasks of increasing contact complexity and temporal horizon.

The DexSuite Dataset

We release 4,700 successful episodes covering the 16 task-embodiment pairs of the benchmark (Figure 6), collected across three tiers: human teleoperation, scripted experts, and learned-policy rollouts. Together, these tiers support a range of data regimes within a single benchmark. The human tier comprises 700 demonstrations on the Robotiq, UMI, and Allegro embodiments. The scripted tier adds 1,200 demonstrations using the UMI gripper and Sharpa hand. The machine-generated tier contributes 2,800 successful policy rollouts.

Figure 6. Composition of the DexSuite dataset by collection tier, embodiment, and task. Each human task-embodiment pair contains 50 episodes and each scripted or machine-generated pair contains 200. All episodes are recorded at 20 Hz with front and wrist cameras.

All trajectories share a common observation and action format containing proprioception, object states, and frontand wrist-camera observations. Scripted tactile configurations additionally include fingertip tactile readings. The dataset is released in LeRobot format [46], as well as HDF5 format compatible with robomimic [18].

Model / InputReachLiftPushPick & PlaceStackRack MugMove PanDrill to Point
Track 1: Parallel-Jaw GripperTrack 2: Allegro Hand
BC-G (state)78 ± 531 ± 527 ± 649 ± 140 ± 025 ± 85 ± 51 ± 1
BC-GMM (state)76 ± 232 ± 523 ± 624 ± 60 ± 028 ± 213 ± 65 ± 2
BC-T (state)90 ± 257 ± 848 ± 464 ± 02 ± 058 ± 368 ± 1647 ± 8
Diffusion (state)100 ± 072 ± 363 ± 265 ± 516 ± 282 ± 269 ± 650 ± 2
ACT (image)76 ± 673 ± 650 ± 266 ± 41 ± 137 ± 689 ± 343 ± 3
Diffusion (image)80 ± 654 ± 833 ± 645 ± 42 ± 056 ± 372 ± 1432 ± 4

Table II. Baseline results on the DexSuite benchmark. Success rates (%) are the mean ± standard deviation across three seeds with 50 episodes each. Track 1 tasks are completed with both the parallel-jaw gripper and the Allegro hand, and Track 2 tasks with a dexterous hand only, the Allegro hand or the Sharpa hand for Spray Graffiti and Toast Bread. Bold marks the best result for each task-embodiment pair, once among state-based and once among image-based policies, and results of 2% or less are not bolded.

Model / InputReachLiftPushPick & PlaceStackPlace FruitsSpray GraffitiToast Bread
Track 1: Allegro HandTrack 2: Sharpa Hand
BC-G (state)82 ± 921 ± 246 ± 715 ± 40 ± 01 ± 10 ± 00 ± 0
BC-GMM (state)75 ± 443 ± 847 ± 535 ± 50 ± 03 ± 10 ± 00 ± 0
BC-T (state)88 ± 247 ± 660 ± 776 ± 51 ± 19 ± 20 ± 00 ± 0
Diffusion (state)97 ± 165 ± 868 ± 567 ± 39 ± 57 ± 30.7 ± 10 ± 0
ACT (image)73 ± 145 ± 566 ± 660 ± 70 ± 027 ± 50 ± 00 ± 0
Diffusion (image)61 ± 258 ± 1262 ± 352 ± 111 ± 15 ± 10.7 ± 10 ± 0

Table II (PDF p. 5). Baseline results on the DexSuite benchmark. Success rates (%) are the mean ± standard deviation across three seeds with 50 episodes each. Track 1 tasks are completed with both the parallel-jaw gripper and the Allegro hand, and Track 2 tasks with a dexterous hand only, the Allegro hand or the Sharpa hand for Spray Graffiti and Toast Bread. Bold marks the best result for each task-embodiment pair, once among state-based and once among image-based policies, and results of 2% or less are not bolded.

Experiments and Results

Experiment Setup

We evaluate imitation learning baselines on the benchmark introduced in Sec. IV-A. We use the robomimic [18] implementations of behavior cloning [47] with Gaussian (BC-G), Gaussian mixture (BC-GMM), and Transformer (BC-T) policies, alongside Diffusion Policy [48] and ACT [44]. Models are trained on 50 human demonstrations for all tasks except the last two long-horizon dexterous tasks, where we use 200 scripted demonstrations per configuration, as described in Sec. IV-B. The BC baselines use state observations, ACT uses images and proprioception, and diffusion is evaluated with both modalities. During training, each run is rolled out for 50 episodes every 50 W Hz and we keep the checkpoint with the highest rollout success, as in robomimic [18]. Unlike robomimic, which reports this maximum, we evaluate the selected checkpoint again on three new evaluation seeds with 50 episodes each and report the mean success rate and standard deviation. For ACT, the in-training maximum exceeds the success of the same checkpoint on the new seeds by 7 percentage points on average across the 14 pairs trained on human demonstrations, and the last checkpoint was the best one in only 2 of them. With 50 episodes, the standard error of a success rate can reach 7 points, and the 150 evaluation episodes bring it to about 4, so gaps of a few points between policies should be read with care. The spread across seeds is similar for both embodiments, 4.8 and 5.3 points for the gripper and the Allegro hand on Track 1 without Stack, and we recommend the same protocol for work using the benchmark.

Results

a) Embodiment gap: The hand’s higher action dimensionality does not consistently reduce success (Table II). All six policy–observation combinations favor Allegro on Push, while four favor the gripper on Lift. State-based performance on Reach differs by at most four percentage points across embodiments. On Pick & Place, the gap changes direction with the policy: BC-T performs better with the hand (76% versus 64%), while ACT performs better with the gripper (66% versus 60%). The embodiment gap therefore depends on both the task and the policy.

b) Horizon and sequential manipulation: Performance drops sharply on tasks requiring successive object interactions. The best state-based policies reach only 16% with the gripper and 9% with Allegro on Stack, while image policies reach at most 2%. On Place Fruits, the best state-based result is 9%, compared with 27% for ACT. Yet ACT reaches 89% on Move Pan, despite its comparable horizon of 500 steps versus 600 for Stack. This suggests that coordinating successive interactions, rather than duration alone, contributes to the difficulty.

The diagnostic rollouts in Figure 7, scored by the stages of each task, show failures during these transitions. On Stack, 22–30% of episodes fail at the first placement and 12–24% at the second object across embodiments. On Place Fruits, 24% fail on the second fruit. Policies therefore struggle to carry an initial manipulation sequence through to subsequent objects.

Figure 7. Stage-wise outcomes of low-dimensional diffusion policies over 50 diagnostic rollouts per configuration, separate from the evaluations in Table II. Bars show the percentage of episodes ending at each stage, with successes in blue. The gripper is the Robotiq for Reach and the UMI gripper otherwise. For Sharpa, aim and fill refer to Spray Graffiti, and insert and press lever refer to Toast Bread.

c) Dexterous capability: Several hand-only tasks are learned successfully: state-based diffusion reaches 82% on Rack Mug, and ACT reaches 89% on Move Pan. Precise tool use remains harder. State-based diffusion reaches 50% on Drill to Point, with 48% of diagnostic rollouts failing at final alignment. On Spray Graffiti, half of the diagnostic rollouts fail at grasping the can, and another 28% paint without reaching the required coverage. No baseline exceeds 1% on Spray Graffiti, and all score 0% on Toast Bread.

Conclusion

We introduced DexSuite, a framework built on Genesis, together with a benchmark of 16 task-embodiment pairs and a dataset of 4,700 successful episodes. Policies trained and evaluated on a dexterous hand match or outperform their gripper counterparts on several shared tasks, while precise tool use and sequential object manipulation remain difficult. To enable repeatable evaluation across tasks and embodiments, we make the framework, benchmark, and dataset available as open source.

Contributors can add new environments as one class on the standard API, and new arms, hands, and sensors without changing any task code, then test them on the standard tasks. The more groups build on DexSuite, the more comparable results in dexterous manipulation become, and every new task, robot, or method makes it more useful to everyone.

References

  1. [1]A. Bicchi, “Hands for dexterous manipulation and robust grasping: A difficult road toward simplicity,” IEEE Transactions on robotics and automation, vol. 16, no. 6, pp. 652–662, 2000.DOI
  2. [2]A. M. Okamura, N. Smaby, and M. R. Cutkosky, “An overview of dexterous manipulation,” in Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065), vol. 1. IEEE, 2000, pp. 255–262.
  3. [3]A. Billard and D. Kragic, “Trends and challenges in robot manipulation,” Science, vol. 364, no. 6446, p. ea at8414, 2019.DOI
  4. [4]Physical Intelligence, K. Black, N. Brown, J. Darpinian, K. Dhabalia, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai et al., “π0.5: a vision-language-action model with open-world generalization,” arXiv preprint arXiv:2504.16054, 2025.arxiv.org/abs/2504.16054
  5. [5]V. Makoviychuk, L. Wawrzyniak, Y. Guo, M. Lu, K. Storey, M. Macklin, D. Hoeller, N. Rudin, A. Allshire, A. Handa et al., “Isaac Gym: High performance GPU-based physics simulation for robot learning,” arXiv preprint arXiv:2108.10470, 2021.arxiv.org/abs/2108.10470
  6. [6]M. Mittal, P. Roth, J. Tige, A. Richard, O. Zhang, P. Du, A. Serrano-Munoz, X. Yao, R. Zurbrügg, N. Rudin et al., “Isaac Lab: A GPU-accelerated simulation framework for multi-modal robot learning,” arXiv preprint arXiv:2511.04831, 2025.arxiv.org/abs/2511.04831
  7. [7]J. Gu, F. Xiang, X. Li, Z. Ling, X. Liu, T. Mu, Y. Tang, S. Tao, X. Wei, Y. Yao et al., “ManiSkill2: A unified benchmark for generalizable manipulation skills,” arXiv preprint arXiv:2302.04659, 2023.arxiv.org/abs/2302.04659
  8. [8]S. Tao, F. Xiang, A. Shukla, Y. Qin, X. Hinrichsen, X. Yuan, C. Bao, X. Lin, Y. Liu, T.-k. Chan et al., “ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI,” arXiv preprint arXiv:2410.00425, 2024.arxiv.org/abs/2410.00425
  9. [9]Y. Zhu, J. Wong, A. Mandlekar, R. Martín-Martín, A. Joshi, K. Lin, A. Maddakuri, S. Nasiriany, and Y. Zhu, “A modular simulation framework and benchmark for robot learning,” arXiv preprint arXiv:2009.12293, 2020.arxiv.org/abs/2009.12293
  10. [10]S. James, Z. Ma, D. R. Arrojo, and A. J. Davison, “RLBench: The robot learning benchmark & learning environment,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 3019–3026, 2020.arxiv.org/abs/1909.12271
  11. [11]S. Nasiriany, A. Maddakuri, L. Zhang, A. Parikh, A. Lo, A. Joshi, A. Mandlekar, and Y. Zhu, “RoboCasa: Large-scale simulation of everyday tasks for generalist robots,” arXiv preprint arXiv:2406.02523, 2024.arxiv.org/abs/2406.02523
  12. [17]C. Li, R. Zhang, J. Wong, C. Gokmen, S. Srivastava, R. Martín-Martín, C. Wang, G. Levine, M. Lingelbach, J. Sun et al., “BEHAVIOR-1K: A benchmark for embodied AI with 1,000 everyday activities and realistic simulation,” in Conference on Robot Learning. PMLR, 2023, pp. 80–93.arxiv.org/abs/2403.09227
  13. [18]A. Mandlekar, D. Xu, J. Wong, S. Nasiriany, C. Wang, R. Kulkarni, L. Fei-Fei, S. Savarese, Y. Zhu, and R. Martín-Martín, “What matters in learning from offline human demonstrations for robot manipulation,” arXiv preprint arXiv:2108.03298, 2021.arxiv.org/abs/2108.03298
  14. [19]A. Khazatsky, K. Pertsch, S. Nair, A. Balakrishna, S. Dasari, S. Karamcheti, S. Nasiriany, M. K. Srirama, L. Y. Chen, K. Ellis et al., “DROID: A large-scale in-the-wild robot manipulation dataset,” arXiv preprint arXiv:2403.12945, 2024.arxiv.org/abs/2403.12945
  15. [20]A. O’Neill, A. Rehman, A. Maddukuri, A. Gupta, A. Padalkar, A. Lee, A. Pooley, A. Gupta, A. Mandlekar, A. Jain et al., “Open X-Embodiment: Robotic learning datasets and RT-X models,” in 2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024, pp. 6892–6903.arxiv.org/abs/2310.08864
  16. [23]A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, J. Dabis, C. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, J. Hsu et al., “RT-1: Robotics transformer for real-world control at scale,” arXiv preprint arXiv:2212.06817, 2022.arxiv.org/abs/2212.06817
  17. [24]O. M. Andrychowicz, B. Baker, M. Chociej, R. Józefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray et al., “Learning dexterous in-hand manipulation,” The International Journal of Robotics Research, vol. 39, no. 1, pp. 3–20, 2020.arxiv.org/abs/1808.00177
  18. [25]A. Rajeswaran, V. Kumar, A. Gupta, G. Vezzani, J. Schulman, E. Todorov, and S. Levine, “Learning complex dexterous manipulation with deep reinforcement learning and demonstrations,” arXiv preprint arXiv:1709.10087, 2017.arxiv.org/abs/1709.10087
  19. [26]C. Bao, H. Xu, Q. Y. Qin, and X. Wang, “DexArt: Benchmarking generalizable dexterous manipulation with articulated objects,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2023, pp. 21 190–21 200.
  20. [27]S. Li, Z. Huang, T. Chen, T. Du, H. Su, J. B. Tenenbaum, and C. Gan, “Dexterom: Dexterous deformable object manipulation with human demonstrations and differentiable physics,” arXiv preprint arXiv:2304.03223, 2023.arxiv.org/abs/2304.03223
  21. [28]M. Grotz, M. Shridhar, Y.-W. Chao, T. Asfour, and D. Fox, “PerAct2: Benchmarking and learning for robotic bimanual manipulation tasks,” in CoRL 2024 Workshop on Whole-body Control and Bimanual Manipulation: Applications in Humanoids and Beyond, 2024.arxiv.org/abs/2407.00278
  22. [29]Y. Chen, T. Wu, S. Wang, X. Feng, J. Jiang, Z. Lu, S. McAleer, H. Dong, S.-C. Zhu, and Y. Yang, “Towards human-level bimanual dexterous manipulation with reinforcement learning,” Advances in Neural Information Processing Systems, vol. 35, pp. 5150–5163, 2022.arxiv.org/abs/2206.08686
  23. [30]Genesis Authors, “Genesis: A generative and universal physics engine for robotics and beyond,” 2024. [Online]. Available: https://github.com/Genesis-Embodied-AI/genesis-world
  24. [31]Y. Qin, Y.-H. Wu, S. Liu, H. Jiang, R. Yang, Y. Fu, and X. Wang, “DexMV: Imitation learning for dexterous manipulation from human videos,” in European Conference on Computer Vision. Springer, 2022, pp. 570–587.arxiv.org/abs/2108.05877
  25. [32]Z. Tang, S. Chen, S. Zhang, P. Yang, Y. Liu, W. Zhao, X. Liu, R. Huang, W. Du, Y. Huang et al., “LabDex: A hierarchical benchmark for dexterous manipulation in laboratories,” arXiv preprint arXiv:2608.18618, 2026.arxiv.org/abs/2608.18618
  26. [33]J. Mahler, J. Liang, S. Niyaz, M. Laskey, R. Doan, X. Liu, J. A. Ojea, and K. Goldberg, “Dex-Net 2.0: Deep learning to plan robust grasps with synthetic point clouds and analytic grasp metrics,” arXiv preprint arXiv:1703.09312, 2017.arxiv.org/abs/1703.09312
  27. [36]J. Ye, K. Wang, C. Yuan, Y. Li, J. Zhu, Y. Qin, X. Zou, and X. Wang, “Dex1B: Learning with 1B demonstrations for dexterous manipulation,” arXiv preprint arXiv:2506.17198, 2025.arxiv.org/abs/2506.17198
  28. [37]B. Calli, A. Singh, A. Walsman, S. Srinivasa, P. Abbeel, and A. M. Dollar, “The YCB object and model set: Towards common benchmarks for manipulation research,” in 2015 international conference on advanced robotics (ICAR). IEEE, 2015, pp. 510–517.DOI
  29. [38]K. Zakka, Y. Tassa, and MuJoCo Menagerie Contributors, “MuJoCo Menagerie: A collection of high-quality simulation models for MuJoCo,” 2022. [Online]. Available: http://github.com/google-deepmind/mujoco_menagerie
  30. [39]C. Lugaresi, J. Tang, H. Nash, C. McClanahan, E. Uboweja, M. Hays, F. Zhang, C.-L. Chang, M. Yong, J. Lee et al., “MediaPipe: A framework for perceiving and processing reality,” in Third workshop on computer vision for AR/VR at IEEE computer vision and pattern recognition (CVPR), vol. 2019. Long Beach, CA, 2019, p. 2.
  31. [40]K. Shaw, Y. Li, J. Yang, M. K. Srírama, R. Liu, H. Xiong, R. Mendonca, and D. Pathak, “Bimanual dexterity for complex tasks,” arXiv preprint arXiv:2411.13677, 2024.arxiv.org/abs/2411.13677
  32. [41]O. Rayyan, M. Gilles, and Y. Cui, “TeleDex: Accessible dexterous teleoperation,” arXiv preprint arXiv:2603.17065, 2026.arxiv.org/abs/2603.17065
  33. [42]B. Huang and Y. Li, “FlexiTac: A low-cost, open-source, scalable tactile sensing solution for robotic systems,” arXiv preprint arXiv:2604.28156, 2026.arxiv.org/abs/2604.28156
  34. [43]C. Chi, Z. Xu, C. Pan, E. Cousineau, B. Burchfiel, S. Feng, R. Tedrake, and S. Song, “Universal manipulation interface: In-the-wild robot teaching without in-the-wild robots,” in Robotics: Science and Systems XX. Robotics: Science and Systems Foundation, 2024.arxiv.org/abs/2402.10329
  35. [44]T. Z. Zhao, V. Kumar, S. Levine, and C. Finn, “Learning fine-grained bimanual manipulation with low-cost hardware,” arXiv preprint arXiv:2304.13705, 2023.arxiv.org/abs/2304.13705
  36. [45]M. Towers, A. Kwiatkowski, J. Balas, G. De Cola, T. Deleu, M. Goulão, K. Andreas, M. Krimmel, A. Kg, R. Perez-Vicente et al., “Gymnasium: A standard interface for reinforcement learning environments,” Advances in Neural Information Processing Systems, vol. 38, 2026.arxiv.org/abs/2407.17032
  37. [46]R. Cadene, S. Alibert, F. Capuano, M. Aractingi, A. Zouitine, P. Kooijmans, J. Choghari, M. Russi, C. Pascal, S. Palma et al., “LeRobot: An open-source library for end-to-end robot learning,” in International Conference on Learning Representations, vol. 2026, 2026, pp. 122 398–122 417.arxiv.org/abs/2602.22818
  38. [47]D. A. Pomerleau, “ALVINN: An autonomous land vehicle in a neural network,” Advances in neural information processing systems, vol. 1, 1988.
  39. [48]C. Chi, Z. Xu, S. Feng, E. Cousineau, Y. Du, B. Burchfiel, R. Tedrake, and S. Song, “Diffusion policy: Visuomotor policy learning via action diffusion,” The International Journal of Robotics Research, vol. 44, no. 10-11, pp. 1684–1704, 2025.

Paper details

vlnc:W_c776yc3d
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 19

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents