Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models research paper by Meta, 2025

Meta · Multimodal and robotics · Dec 1, 2025 · 38 citations · 78 upvotes · unverified

Read on arXiv

What it shows

TUNA, a unified multimodal model, uses a cascaded VAE and representation encoder for end-to-end multimodal understanding and generation, outperforming decoupled models and achieving state-of-the-art results across various benchmarks.

By Zhiheng Liu, Weiming Ren, Haozhe Liu and 22 more · arXiv 2512.02014 · PDF · Code

UnverifiedHugging Face's summary; not yet checked by hand.

More from Meta

All 40
Multimodal and roboticsUnverifiedOct 25, 2026InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.Meta46 upvotesRead →Multimodal and roboticsUnverifiedOct 2, 2026Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.Meta88 upvotesRead →Alignment and safetyUnverifiedOct 1, 2026Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.Meta1 citations111 upvotesRead →Multimodal and roboticsUnverifiedOct 1, 2026World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.Meta1 citations98 upvotesRead →ArchitecturesUnverifiedSep 29, 2026Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.Meta5 citations47 upvotesRead →Inference and efficiencyUnverifiedSep 26, 2026In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.Meta1 citations34 upvotesRead →Agents and evaluationUnverifiedSep 4, 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable DataWearableQA is a benchmark of multiple-choice questions derived from real longitudinal wearable data that evaluates large language model reasoning across data and health dimensions.Meta43 upvotesRead →Multimodal and roboticsAug 6, 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.Meta7 citations63 upvotesRead →

Other multimodal and robotics papers

Topic
Multimodal and roboticsJan 30, 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.Salesforce9,805 citations3 upvotesRead →Multimodal and roboticsJan 28, 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.Salesforce7,655 citations5 upvotesRead →Multimodal and roboticsUnverifiedOct 25, 2024GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.OpenAI5,388 citations88 upvotesRead →Multimodal and roboticsUnverifiedMar 8, 2024DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.DeepSeek939 citations49 upvotesRead →Multimodal and roboticsUnverifiedOct 17, 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and GenerationJanus, an autoregressive framework with separate visual encoding pathways within a unified transformer architecture, enhances performance in unified multimodal understanding and generation.DeepSeek525 citations37 upvotesRead →Multimodal and roboticsUnverifiedSep 26, 2025LongLive: Real-time Interactive Long Video GenerationLongLive is a frame-level autoregressive framework for real-time and interactive long video generation, addressing efficiency and quality challenges through causal attention, KV-recache, streaming long tuning, and short window attention.NVIDIA297 citations191 upvotesRead →
About this paper
Venue
Computer Vision and Pattern Recognition
Citations
38, 2 influential · Semantic Scholar
Upvotes
78 · Hugging Face
Lab
Meta · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf

Changes

CitationsNov 9, 2026Citations rose from 37 to 38.
CitationsNov 2, 2026Influential citations fell from 3 to 2.
CitationsNov 2, 2026Citations rose from 36 to 37.
CitationsOct 5, 2026Influential citations rose from 2 to 3.
CitationsOct 5, 2026Citations rose from 35 to 36.
CitationsSep 25, 2026A first count of 2 influential citations.
CitationsSep 25, 2026A first count of 35 citations.
New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.