Notable data and AI papers

627 papers · 45 labs

The Path Not Taken: RLVR Provably Learns Off the Principals research paper by Meta, 2025

Meta · Reasoning · Nov 11, 2025 · 65 citations · 37 upvotes · unverified

Read on arXiv

What it shows

Reinforcement Learning with Verifiable Rewards (RLVR) improves large language models by updating a limited set of parameters, which is explained by a Three-Gate Theory, revealing distinct optimization dynamics compared to supervised fine-tuning.

By Hanqing Zhu, Zhenyu Zhang, Hanxian Huang and 11 more · arXiv 2511.08567 · PDF

UnverifiedHugging Face's summary; not yet checked by hand.

More from Meta

All 40
Multimodal and roboticsUnverifiedOct 25, 2026InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.Meta46 upvotesRead →Multimodal and roboticsUnverifiedOct 2, 2026Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.Meta88 upvotesRead →Alignment and safetyUnverifiedOct 1, 2026Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.Meta1 citations111 upvotesRead →Multimodal and roboticsUnverifiedOct 1, 2026World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.Meta1 citations98 upvotesRead →ArchitecturesUnverifiedSep 29, 2026Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.Meta5 citations47 upvotesRead →Inference and efficiencyUnverifiedSep 26, 2026In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.Meta1 citations34 upvotesRead →Agents and evaluationUnverifiedSep 4, 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable DataWearableQA is a benchmark of multiple-choice questions derived from real longitudinal wearable data that evaluates large language model reasoning across data and health dimensions.Meta43 upvotesRead →Multimodal and roboticsAug 6, 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and RecipesControlled experiments on when text, image understanding and image generation help or compete when trained together.Meta7 citations63 upvotesRead →
Topic
ReasoningJan 28, 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsAsking a model to write out its intermediate steps (chain of thought) sharply improves its math and logic answers.Google23.8k citations16 upvotesRead →ReasoningUnverifiedFeb 5, 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsDeepSeekMath 7B improves mathematical reasoning through enhanced data pre-training and Group Relative Policy Optimization, achieving high scores on MATH benchmark without external tools.DeepSeek10.6k citations152 upvotesRead →ReasoningJan 22, 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningReinforcement learning taught a model long step-by-step reasoning on par with OpenAI o1.DeepSeek5,972 citations458 upvotesRead →ReasoningUnverifiedJun 17, 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceDeepSeek-Coder-V2, a Mixture-of-Experts language model, excels in code-specific tasks by enhancing coding and mathematical reasoning capabilities while expanding language support and context length.DeepSeek530 citations73 upvotesRead →ReasoningUnverifiedAug 11, 2025MolmoAct: Action Reasoning Models that can Reason in SpaceAction Reasoning Models (ARMs) integrate perception, planning, and control to enable adaptable and explainable robotic behavior, achieving superior performance across various tasks and settings.Ai2232 citations45 upvotesRead →ReasoningUnverifiedJul 22, 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent PlanningThinkAct, a dual-system framework, uses reinforced visual latent planning to enable few-shot adaptation, long-horizon planning, and self-correction in embodied AI tasks by bridging high-level reasoning with low-level action execution.NVIDIA192 citations43 upvotesRead →
About this paper
Venue
arXiv.org
Citations
65, 6 influential · Semantic Scholar
Upvotes
37 · Hugging Face
Lab
Meta · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf

Changes

CitationsNov 2, 2026Influential citations rose from 5 to 6.
CitationsNov 2, 2026Citations rose from 56 to 65.
CitationsOct 12, 2026Citations rose from 55 to 56.
CitationsOct 5, 2026Citations rose from 49 to 55.
CitationsSep 25, 2026A first count of 5 influential citations.
CitationsSep 25, 2026A first count of 49 citations.
New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.