MolmoAct2: Action Reasoning Models for Real-world Deployment research paper by Ai2, 2026
Ai2 · Multimodal and robotics · May 4, 2026 · 100 citations · 355 upvotes
What it shows
A fully open robot action model, released with new datasets including 720 hours of two-arm teleoperation.
By Haoquan Fang, Jiafei Duan, Donovan Clay and 26 more · arXiv 2605.02881 · PDF · Code
Summarised by hand from the abstract.
More from Ai2
All 7MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction3D point motion forecasting model predicts object trajectories from visual history and language goals, demonstrating superior performance on benchmarks and transferring effectively to robot manipulation and video generation tasks.
Ai216 citations53 upvotesRead →WildDet3D: Scaling Promptable 3D Detection in the WildA unified 3D object detection framework with a large-scale dataset enables open-world detection with multiple prompt types and geometric cue integration.
Ai215 citations95 upvotesRead →TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for RoboticsTOPReward is a probabilistically grounded temporal value function that uses pretrained video Vision-Language Models to estimate robotic task progress through internal token logits, achieving superior performance in zero-shot evaluations across diverse real-world tasks.
Ai243 citations26 upvotesRead →Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative ReasoningRD-VLA introduces a recurrent architecture for vision-language-action models that adapts computational depth through latent iterative refinement, achieving constant memory usage and improved task success rates.
Ai221 citations71 upvotesRead →Olmo 3Olmo 3, a family of state-of-the-art fully-open language models at 7B and 32B parameter scales, excels in long-context reasoning, function calling, coding, instruction following, general chat, and knowledge recall.
Ai237 upvotesRead →MolmoAct: Action Reasoning Models that can Reason in SpaceAction Reasoning Models (ARMs) integrate perception, planning, and control to enable adaptable and explainable robotic behavior, achieving superior performance across various tasks and settings.
Ai2232 citations45 upvotesRead →
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 100, 12 influential · Semantic Scholar
- Upvotes
- 355 · Hugging Face
- Lab
- Ai2 · on Companies · on blogs · on labs · on Leaders · on Paydays · on problems · on Releases · on repos · on socials · on standards · on terms · on Titlewave
Changes
Influential citations rose from 11 to 12.
Citations rose from 87 to 100.
Influential citations rose from 6 to 11.
Citations rose from 62 to 87.
Influential citations rose from 5 to 6.
Citations rose from 56 to 62.
Influential citations rose from 1 to 5.
Citations rose from 46 to 56.
Citations rose from 44 to 46.
Added to the list.