SAM 3: Segment Anything with Concepts research paper by Meta, 2025
Meta · Multimodal and robotics · Nov 20, 2025 · 1,466 citations · 138 upvotes · unverified
What it shows
Segment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
By Nicolas Carion, Laura Gustafson, Yuan-Ting Hu and 35 more · arXiv 2511.16719 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Meta
All 40InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.
Meta46 upvotesRead →Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.
Meta88 upvotesRead →Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.
Meta1 citations111 upvotesRead →World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.
Meta1 citations98 upvotesRead →Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.
Meta5 citations47 upvotesRead →In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.
Meta1 citations34 upvotesRead →WearableQA: A Benchmark for Health Reasoning over Real-World Wearable DataWearableQA is a benchmark of multiple-choice questions derived from real longitudinal wearable data that evaluates large language model reasoning across data and health dimensions.
Meta43 upvotesRead →Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.
Meta7 citations63 upvotesRead →
Other multimodal and robotics papers
TopicBLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and GenerationJanus, an autoregressive framework with separate visual encoding pathways within a unified transformer architecture, enhances performance in unified multimodal understanding and generation.
DeepSeek525 citations37 upvotesRead →LongLive: Real-time Interactive Long Video GenerationLongLive is a frame-level autoregressive framework for real-time and interactive long video generation, addressing efficiency and quality challenges through causal attention, KV-recache, streaming long tuning, and short window attention.
NVIDIA297 citations191 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 1,466, 237 influential · Semantic Scholar
- Upvotes
- 138 · Hugging Face
- Lab
- Meta · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf
Changes
Influential citations rose from 223 to 237.
Citations rose from 1,386 to 1,466.
Influential citations rose from 188 to 223.
Citations rose from 1,198 to 1,386.
Influential citations rose from 175 to 188.
Citations rose from 1,105 to 1,198.
Influential citations rose from 158 to 175.
Citations rose from 1,024 to 1,105.
Influential citations rose from 153 to 158.
Citations rose from 999 to 1,024.
A first count of 153 influential citations.
A first count of 999 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.