PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
In brief
- PDRVLA combines vision, language and action for robots with a lightweight physical dynamics module.
- The model predicts future visual features to guide actions without adding latency.
- It reaches up to 99.3% success rate on simulation benchmarks according to the announcement.
Vision--Language--Action (VLA) models generate robot actions from visual observations and language instructions, but their understanding of physical dynamics remains limited. Video world models can capture scene dynamics, yet generating future videos introduces high latency into the control loop. PDRVLA introduces a lightweight Physical Dynamics Module that extracts physical tokens from vision--language features to condition action generation without online video generation. The module learns through direct prediction of future RGB, depth, and optical-flow features, supervised by a frozen pretrained video world model. Training relies on publicly available data expanded via human-to-robot synthesis, subtask annotation, and embodied chain-of-thought (ECoT) annotation. According to the announcement, PDRVLA achieves success rates of 99.3% on LIBERO, 89.9% on LIBERO-Plus, 93.6% on RoboTwin~2.0, and 81.5% on SimplerEnv.
What it changes for you
- Industry & ManufacturingRobots using PDRVLA could better handle tasks requiring precise physical dynamics understanding, reducing errors in industrial environments.
This summary gives you the essentials. The full article, its figures and quotes are on Hugging Face Daily Papers.
Read the original articleAI-generated summary of the source, checked by rules. How we write · Report an error