Notable data and AI papers

627 papers · 45 labs

QeRL: Beyond Efficiency -- Quantization-enhanced Reinforcement Learning for LLMs research paper by NVIDIA, 2025

NVIDIA · Reasoning · Oct 13, 2025 · 27 citations · 183 upvotes · unverified

Read on arXiv

What it shows

QeRL, a quantization-enhanced reinforcement learning framework, accelerates RL training for large language models by combining NVFP4 quantization with Low-Rank Adaptation and an Adaptive Quantization Noise mechanism, achieving significant speedups and improved performance.

By Wei Huang, Yi Ge, Shuai Yang and 11 more · arXiv 2510.11696 · PDF · Code

UnverifiedHugging Face's summary; not yet checked by hand.

More from NVIDIA

All 90
Multimodal and roboticsUnverifiedNov 5, 2026VFlash: Fast, Accurate Visual Planning via Flash Primitive DecodingA method called VFlash speeds up and improves visual motion planning for robots by predicting entire spatial shapes at once.NVIDIA109 upvotesRead →Foundation modelsUnverifiedOct 27, 2026Nemotron-Labs-Diffusion-Uni: Elastic Self-Refining Unified Diffusion LLM with Cross-Paradigm On-Policy DistillationNLD-Uni is a unified discrete diffusion language model that combines visual understanding and generation via cross-paradigm on-policy distillation and progressive self-refining diffusion.NVIDIA12 upvotesRead →ReasoningUnverifiedOct 27, 2026ThinkWorld: World Imagination Reinforces Chain-of-Dynamics ReasoningThinkWorld improves robotic generalization by representing actions as dynamics chains and using world imagination to learn from unlabeled human videos.NVIDIA57 upvotesRead →Multimodal and roboticsUnverifiedOct 20, 2026Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary RigsThis model generates both video and 3D motion for any character rig, allowing the motion to be replayed accurately within a 3D scene.NVIDIA26 upvotesRead →Inference and efficiencyUnverifiedOct 13, 2026EdgeWise: Bringing Long-Horizon Agents to the Edge via Selective Cloud DelegationThis paper introduces a framework that reduces inference costs by using a small local model for most tasks and delegating only critical steps to the cloud.NVIDIA30 upvotesRead →Training and scalingUnverifiedOct 8, 2026When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often BetterThis paper shows that distilling from offline student rollouts is often more efficient and accurate than standard on-policy distillation for many model pairs.NVIDIA28 upvotesRead →Multimodal and roboticsUnverifiedOct 7, 2026Long-WAM: Scaling the Context of World-Action ModelsLong-WAM improves robot control by using autoregressive pretraining to effectively leverage long visual histories for real-time action prediction.NVIDIA2 citations114 upvotesRead →Inference and efficiencyUnverifiedOct 6, 2026NeMo-DCR: Bit-Exact Delta-Compressed Refit for Scalable Agentic RL at Trillion-Parameter ScaleNeMo-DCR enables efficient, bit-exact synchronization of trillion-parameter model checkpoints by transmitting only the sparse weight changes between clusters.NVIDIA1 citations29 upvotesRead →
Topic
ReasoningJan 28, 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsAsking a model to write out its intermediate steps (chain of thought) sharply improves its math and logic answers.Google23.8k citations16 upvotesRead →ReasoningUnverifiedFeb 5, 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsDeepSeekMath 7B improves mathematical reasoning through enhanced data pre-training and Group Relative Policy Optimization, achieving high scores on MATH benchmark without external tools.DeepSeek10.6k citations152 upvotesRead →ReasoningJan 22, 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningReinforcement learning taught a model long step-by-step reasoning on par with OpenAI o1.DeepSeek5,972 citations458 upvotesRead →ReasoningUnverifiedJun 17, 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceDeepSeek-Coder-V2, a Mixture-of-Experts language model, excels in code-specific tasks by enhancing coding and mathematical reasoning capabilities while expanding language support and context length.DeepSeek530 citations73 upvotesRead →ReasoningUnverifiedAug 11, 2025MolmoAct: Action Reasoning Models that can Reason in SpaceAction Reasoning Models (ARMs) integrate perception, planning, and control to enable adaptable and explainable robotic behavior, achieving superior performance across various tasks and settings.Ai2232 citations45 upvotesRead →ReasoningUnverifiedJul 20, 2025WebShaper: Agentically Data Synthesizing via Information-Seeking FormalizationWebShaper, a formalization-driven framework, synthesizes information-seeking datasets using set theory and Knowledge Projections to enhance reasoning structure and achieve top performance in open-sourced benchmarks.Alibaba (Qwen)129 citations53 upvotesRead →
About this paper
Venue
arXiv.org
Citations
27, 2 influential · Semantic Scholar
Upvotes
183 · Hugging Face
Lab
NVIDIA · on Companies · on Acquisitions · on Quarterly · on Paydays · on TechConf

Changes

CitationsNov 2, 2026Citations rose from 21 to 27.
CitationsOct 12, 2026Citations rose from 19 to 21.
CitationsOct 5, 2026Citations rose from 17 to 19.
CitationsSep 25, 2026A first count of 2 influential citations.
CitationsSep 25, 2026A first count of 17 citations.
New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.