V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning research paper by Meta, 2026
Meta · Multimodal and robotics · Mar 15, 2026 · 161 citations · 39 upvotes · unverified
What it shows
V-JEPA 2.1 is a self-supervised model that learns dense visual representations for images and videos through a combination of dense predictive loss, deep self-supervision, multi-modal tokenizers, and effective scaling.
By Lorenzo Mur-Labadia, Matthew Muckley, Amir Bar and 6 more · arXiv 2603.14482 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Meta
All 40InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.
Meta46 upvotesRead →Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.
Meta88 upvotesRead →Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.
Meta1 citations111 upvotesRead →World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.
Meta1 citations98 upvotesRead →Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.
Meta5 citations47 upvotesRead →In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.
Meta1 citations34 upvotesRead →WearableQA: A Benchmark for Health Reasoning over Real-World Wearable DataWearableQA is a benchmark of multiple-choice questions derived from real longitudinal wearable data that evaluates large language model reasoning across data and health dimensions.
Meta43 upvotesRead →Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.
Meta7 citations63 upvotesRead →
Other multimodal and robotics papers
TopicBLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and GenerationJanus, an autoregressive framework with separate visual encoding pathways within a unified transformer architecture, enhances performance in unified multimodal understanding and generation.
DeepSeek525 citations37 upvotesRead →LongLive: Real-time Interactive Long Video GenerationLongLive is a frame-level autoregressive framework for real-time and interactive long video generation, addressing efficiency and quality challenges through causal attention, KV-recache, streaming long tuning, and short window attention.
NVIDIA297 citations191 upvotesRead →
About this paper
- Venue
- European Conference on Computer Vision
- Citations
- 161, 53 influential · Semantic Scholar
- Upvotes
- 39 · Hugging Face
- Lab
- Meta · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf
Changes
Influential citations rose from 52 to 53.
Citations rose from 157 to 161.
Influential citations rose from 43 to 52.
Citations rose from 114 to 157.
Influential citations rose from 40 to 43.
Citations rose from 106 to 114.
Influential citations rose from 39 to 40.
Citations rose from 88 to 106.
Influential citations rose from 37 to 39.
Citations rose from 83 to 88.
A first count of 37 influential citations.
A first count of 83 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.