MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction research paper by Ai2, 2026
Ai2 · Multimodal and robotics · Jun 17, 2026 · 16 citations · 53 upvotes · unverified
What it shows
3D point motion forecasting model predicts object trajectories from visual history and language goals, demonstrating superior performance on benchmarks and transferring effectively to robot manipulation and video generation tasks.
By Jianing Zhang, Chenhao Zheng, Yajun Yang and 10 more · arXiv 2606.18558 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Ai2
All 7MolmoAct2: Action Reasoning Models for Real-world DeploymentA fully open robot action model, released with new datasets including 720 hours of two-arm teleoperation.
Ai2100 citations355 upvotesRead →WildDet3D: Scaling Promptable 3D Detection in the WildA unified 3D object detection framework with a large-scale dataset enables open-world detection with multiple prompt types and geometric cue integration.
Ai215 citations95 upvotesRead →TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for RoboticsTOPReward is a probabilistically grounded temporal value function that uses pretrained video Vision-Language Models to estimate robotic task progress through internal token logits, achieving superior performance in zero-shot evaluations across diverse real-world tasks.
Ai243 citations26 upvotesRead →Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative ReasoningRD-VLA introduces a recurrent architecture for vision-language-action models that adapts computational depth through latent iterative refinement, achieving constant memory usage and improved task success rates.
Ai221 citations71 upvotesRead →Olmo 3Olmo 3, a family of state-of-the-art fully-open language models at 7B and 32B parameter scales, excels in long-context reasoning, function calling, coding, instruction following, general chat, and knowledge recall.
Ai237 upvotesRead →MolmoAct: Action Reasoning Models that can Reason in SpaceAction Reasoning Models (ARMs) integrate perception, planning, and control to enable adaptable and explainable robotic behavior, achieving superior performance across various tasks and settings.
Ai2232 citations45 upvotesRead →
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 16, 7 influential · Semantic Scholar
- Upvotes
- 53 · Hugging Face
- Lab
- Ai2 · on Companies · on blogs · on labs · on Leaders · on Paydays · on problems · on Releases · on repos · on socials · on standards · on terms · on Titlewave
Changes
Influential citations rose from 5 to 7.
Citations rose from 14 to 16.
Influential citations rose from 4 to 5.
Citations rose from 10 to 14.
Influential citations rose from 3 to 4.
Citations rose from 6 to 10.
Influential citations rose from 2 to 3.
Citations rose from 4 to 6.
A first count of 2 influential citations.
A first count of 4 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.