Paper 2605.12090
World Action Models: The Next Frontier in Embodied AI
- Published
- May 2026
- Research lab
- Independent
- Citations
- 29
- GitHub
- 1.2K stars
01 In brief
Summary
This survey introduces World Action Models (WAMs), a new paradigm in embodied AI that unifies predictive world modeling with action generation, targeting a joint distribution over future states and actions.
WAMs are formally defined and distinguished from related concepts like Video Policies and Action World Models.
The paper organizes existing methods into a taxonomy of Cascaded WAMs (explicit or implicit planning) and Joint WAMs (autoregressive or diffusion-based generation), detailing their architectural variations.
It analyzes the data ecosystem for training WAMs, including robot teleoperation, portable human demonstrations, simulation, and egocentric video, and reviews evaluation protocols for visual fidelity, physical commonsense, and action plausibility.
The survey also discusses open challenges such as architectural coupling, multimodal state representation, data mixture design, long-horizon planning, inference latency, evaluation methodology, and safety, concluding with future research directions.
02 From the paper
Abstract
Vision-Language-Action (VLA) models have achieved strong semantic generalization for embodied policy learning, yet they learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under intervention. A growing body of work addresses this limitation by integrating world models, predictive models of environment dynamics, into the action generation pipeline. We term this emerging paradigm World Action Models (WAMs): embodied foundation models that unify predictive state modeling with action generation, targeting a joint distribution over future states and actions rather than actions alone. However, the literature remains fragmented across architectures, learning objectives, and application scenarios, lacking a unified conceptual framework. We formally define WAMs and disambiguate them from related concepts, and trace the foundations and early integration of VLA and world model research that gave rise to this paradigm. We organize existing methods into a structured taxonomy of Cascaded and Joint WAMs, with further subdivision by generation modality, conditioning mechanism, and action decoding strategy. We systematically analyze the data ecosystem fueling WAMs development, spanning robot teleoperation, portable human demonstrations, simulation, and internet-scale egocentric video, and synthesize emerging evaluation protocols organized around visual fidelity, physical commonsense, and action plausibility. Overall, this survey provides the first systematic account of the WAMs landscape, clarifies key architectural paradigms and their trade-offs, and identifies open challenges and future opportunities for this rapidly evolving field.