SAM 3D: 3Dfy Anything in Images research paper by Meta, 2025
Meta · Multimodal and robotics · Nov 20, 2025 · 343 citations · 117 upvotes · unverified
What it shows
SAM 3D is a generative model that reconstructs 3D objects from single images using a multi-stage training framework that includes synthetic pretraining and real-world alignment, achieving high performance in human preference tests.
By SAM 3D Team, Xingyu Chen, Fu-Jen Chu and 20 more · arXiv 2511.16624 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Meta
All 40InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.
Meta46 upvotesRead →Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.
Meta88 upvotesRead →Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.
Meta1 citations111 upvotesRead →World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.
Meta1 citations98 upvotesRead →Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.
Meta5 citations47 upvotesRead →In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.
Meta1 citations34 upvotesRead →WearableQA: A Benchmark for Health Reasoning over Real-World Wearable DataWearableQA is a benchmark of multiple-choice questions derived from real longitudinal wearable data that evaluates large language model reasoning across data and health dimensions.
Meta43 upvotesRead →Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.
Meta7 citations63 upvotesRead →
Other multimodal and robotics papers
TopicBLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and GenerationJanus, an autoregressive framework with separate visual encoding pathways within a unified transformer architecture, enhances performance in unified multimodal understanding and generation.
DeepSeek525 citations37 upvotesRead →LongLive: Real-time Interactive Long Video GenerationLongLive is a frame-level autoregressive framework for real-time and interactive long video generation, addressing efficiency and quality challenges through causal attention, KV-recache, streaming long tuning, and short window attention.
NVIDIA297 citations191 upvotesRead →
About this paper
- Venue
- Computer Vision and Pattern Recognition
- Citations
- 343, 81 influential · Semantic Scholar
- Upvotes
- 117 · Hugging Face
- Lab
- Meta · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf
Changes
Influential citations rose from 77 to 81.
Citations rose from 332 to 343.
Influential citations rose from 67 to 77.
Citations rose from 302 to 332.
Influential citations rose from 61 to 67.
Citations rose from 279 to 302.
Influential citations rose from 57 to 61.
Citations rose from 257 to 279.
Citations rose from 256 to 257.
A first count of 57 influential citations.
A first count of 256 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.