Notable data and AI papers

627 papers · 45 labs

Latest papers

The brief · Mon Nov 9

The unverified paper "VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding" by NVIDIA speeds up visual motion planning for robots by predicting spatial shapes at once, offering leaders lower robotics deployment latency. Carnegie Mellon University released the unverified paper "Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand", showing small benchmark subsets reliably estimate full scores to lower evaluation compute costs. ServiceNow introduced the unverified paper "Apriel Voice 27B Preview: An Open Model for Speech, Reasoning, and Tool Use", demonstrating an open model that directly processes spoken speech to converse, reason, and execute tool calls for voice workloads.

Read more
Thursday, Nov 51 paper
Multimodal and roboticsUnverifiedNov 5, 2026VFlash: Fast, Accurate Visual Planning via Flash Primitive DecodingA method called VFlash speeds up and improves visual motion planning for robots by predicting entire spatial shapes at once.NVIDIA109 upvotesRead →
Monday, Nov 23 papers
Multimodal and roboticsUnverifiedNov 2, 2026MoviEdit: Long-form Multi-Shot Video Editing Made EasyMoviEdit is a framework and benchmark for editing long videos across multiple camera shots and changing scenes.Adobe75 upvotesRead →Agents and evaluationUnverifiedNov 2, 2026RoboColosseum: Evaluating Physical Intelligence at Scale In-The-WildRoboColosseum is an evaluation framework that tests robot AI models across different environments and physical setups.Hugging Face50 upvotesRead →Agents and evaluationUnverifiedNov 2, 2026WebHarbor: Docking Real Websites for Evolving GUI Agent EnvironmentsWebHarbor provides realistic, containerized website environments for training and testing computer-using web agents across complex online tasks.Microsoft28 upvotesRead →
Saturday, Oct 311 paper
Agents and evaluationUnverifiedOct 31, 2026Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRandBestRand is a method for selecting small benchmark subsets that reliably estimate full evaluation scores at lower computational costs.Carnegie Mellon University51 upvotesRead →
Thursday, Oct 291 paper
Multimodal and roboticsUnverifiedOct 29, 2026Apriel Voice 27B Preview: An Open Model for Speech, Reasoning, and Tool UseApriel Voice 27B is an open AI model that directly processes spoken speech to converse, reason, and use external tools.ServiceNow37 upvotesRead →
Tuesday, Oct 273 papers
ReasoningUnverifiedOct 27, 2026ThinkWorld: World Imagination Reinforces Chain-of-Dynamics ReasoningThinkWorld improves robotic generalization by representing actions as dynamics chains and using world imagination to learn from unlabeled human videos.NVIDIA57 upvotesRead →Inference and efficiencyUnverifiedOct 27, 2026EmbeddingGemma 2: Unified and Efficient Multimodal RepresentationsEmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.Google34 upvotesRead →Foundation modelsUnverifiedOct 27, 2026Nemotron-Labs-Diffusion-Uni: Elastic Self-Refining Unified Diffusion LLM with Cross-Paradigm On-Policy DistillationNLD-Uni is a unified discrete diffusion language model that combines visual understanding and generation via cross-paradigm on-policy distillation and progressive self-refining diffusion.NVIDIA12 upvotesRead →
Monday, Oct 262 papers
Multimodal and roboticsUnverifiedOct 26, 2026StreamVibe: Proactive Video Agents for Evolving User IntentStreamVibe introduces a benchmark, streaming vision-language model, and hierarchical memory harness to enable proactive, intent-aware interaction with implicit and evolving user goals.Google78 upvotesRead →Agents and evaluationUnverifiedOct 26, 2026Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic ModelsCo-Design Bench evaluates how effectively coding agents update software applications based on user requests with text, images, and other media.Alibaba (Qwen)23 upvotesRead →
Sunday, Oct 251 paper
Multimodal and roboticsUnverifiedOct 25, 2026InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM AssistantsInteractiveWorld provides a verifiable simulation environment and benchmark to evaluate whether multimodal language models can reliably guide humans through physical tasks.Meta46 upvotesRead →
Saturday, Oct 242 papers
Foundation modelsUnverifiedOct 24, 2026Eat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RLFORK jointly optimizes recall and precision via rubric-driven necessity credits and factual grading to improve response quality and reduce verbosity in reinforcement learning.Carnegie Mellon University34 upvotesRead →Multimodal and roboticsUnverifiedOct 24, 2026Qwen-Image-PE: Learning Visual Design for Text-to-Image Prompt EnhancementQwen-Image-PE improves text-to-image prompts via two-stage training with caption-based reverse distillation and groupwise design rewards, scaling across data, model size, and information density.Alibaba (Qwen)23 upvotesRead →
Friday, Oct 233 papers
Training and scalingUnverifiedOct 23, 2026On-Policy Self-Training: Data-Free Self-Improvement in Large Language ModelsFoundation models can self-improve across text and vision tasks by generating synthetic questions and reasoning traces guided only by high-level topics, without external supervision.Google31 upvotesRead →Multimodal and roboticsUnverifiedOct 23, 2026World-in-Context: Interactive Video World Modeling with In-Context ConditioningWorld-in-Context unifies view, action, and camera controls via explicit tokens and interaction-aware positional encoding to improve interactive video generation and navigation.Alibaba (Qwen)22 upvotesRead →Alignment and safetyUnverifiedOct 23, 2026OTel: Open Telco AI Datasets, Benchmarks, and ModelsOpen Telco provides open telecom AI datasets and post-trained baselines for retrieval, reranking, and instruction-tuned language models, improving benchmark performance across all three families.AT&T1 citationsRead →
Thursday, Oct 222 papers
Agents and evaluationUnverifiedOct 22, 2026UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping AgentsUserArena introduces a real-world interactive benchmark with long-horizon shopping trajectories and an evaluation framework, alongside On-Policy Trajectory Distillation to improve simulator fidelity for agentic recommendations.Alibaba (Qwen)55 upvotesRead →Multimodal and roboticsUnverifiedOct 22, 2026Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research ReportsThis benchmark evaluates how well AI agents can research and synthesize information from videos to produce interactive reports.Alibaba (Qwen)19 upvotesRead →
Wednesday, Oct 211 paper
Retrieval and dataUnverifiedOct 21, 2026Retrieval Augmented Generation CompositionalityThis study shows that individual RAG techniques do not always work well together and provides a framework to evaluate full retrieval pipelines.IBM34 upvotesRead →
Tuesday, Oct 202 papers
Multimodal and roboticsUnverifiedOct 20, 2026Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary RigsThis model generates both video and 3D motion for any character rig, allowing the motion to be replayed accurately within a 3D scene.NVIDIA26 upvotesRead →Applied AIUnverifiedOct 20, 2026Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?This testbed evaluates how well AI agents can improve scientific machine learning models and identifies their reliance on engineering tricks over research insight.Anthropic18 upvotesRead →
Monday, Oct 193 papers
Multimodal and roboticsUnverifiedOct 19, 2026OpenVLHarness: Real World Visual Agentic Tool-Use with Multimodal MemoryThis framework improves multimodal AI reasoning by providing persistent memory and tool interfaces to help models process and combine complex visual evidence.Apple101 upvotesRead →Agents and evaluationUnverifiedOct 19, 2026Agent World Model in the Wild: Computer-Use Agent Environment SynthesisThis pipeline creates controllable, open-source environments to safely train and test AI agents on complex, long-horizon computer-use tasks.Microsoft69 upvotesRead →Inference and efficiencyUnverifiedOct 19, 2026SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolationThis training method uses a smaller, frozen model to guide the training of a larger diffusion model, improving quality without increasing inference costs.Alibaba (Qwen)30 upvotesRead →
Friday, Oct 161 paper
Training and scalingUnverifiedOct 16, 2026Self-Evolving Coding Agents via Harness-Policy OptimizationThis framework improves coding agents by recursively alternating between optimizing the agent's policy and the environment harness it uses to interact with code.Microsoft48 upvotesRead →
Wednesday, Oct 144 papers
ArchitecturesUnverifiedOct 14, 2026Correction Training for Diffusion ModelsThis method adds a correction step to diffusion models to fix errors that accumulate during the image generation process.UC Berkeley42 upvotesRead →Applied AIUnverifiedOct 14, 2026CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image GenerationThis paper presents an end-to-end framework for generating commercial-grade e-commerce product images by combining metadata extraction, layout planning, and multi-condition generation.Alibaba (Qwen)25 upvotesRead →Multimodal and roboticsUnverifiedOct 14, 2026BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesThis benchmark evaluates how well AI models can perform complex 3D creation and editing tasks within the Blender software.Alibaba (Qwen)23 upvotesRead →Training and scalingUnverifiedOct 14, 2026DeLoop: Repeated Actions as Self-Supervision for Long-Horizon AgentsThis self-supervised training method teaches AI agents to avoid repetitive, unproductive actions during long tasks by using their own history as feedback.Google21 upvotesRead →
Tuesday, Oct 1312 papers
Multimodal and roboticsUnverifiedOct 13, 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal RewardsThis paper introduces a method to improve code-based visual generation by using image-based aesthetic guidance and decoupled rewards to ensure quality and correctness.Microsoft137 upvotesRead →Multimodal and roboticsUnverifiedOct 13, 2026Urbex: Agentic Spatial Grounding for City-Scale 3D ScenesThis paper presents an agentic framework that treats city-scale 3D scene grounding as an active search task rather than a simple candidate ranking problem.Alibaba (Qwen)134 upvotesRead →Agents and evaluationUnverifiedOct 13, 2026Into the Unknown: Benchmarking AI agents on open scientific research problemsThis benchmark evaluates how well AI agents can write follow-up scientific research papers based on unpublished directions from domain experts.Carnegie Mellon University62 upvotesRead →Multimodal and roboticsUnverifiedOct 13, 2026LensErase: A Foundation Model for Erase AnythingThis paper introduces a foundation model designed for versatile image editing and object removal using mask-based inputs and efficient positional encoding.Microsoft52 upvotesRead →ReasoningUnverifiedOct 13, 2026Hybrid Reasoning AgentsThis paper introduces an agent architecture that dynamically switches between latent reasoning and text-based interaction to improve performance and inference speed.Stanford University41 upvotesRead →Agents and evaluationUnverifiedOct 13, 2026CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation PipelineThis paper introduces a benchmark and generation pipeline to evaluate how agents resolve conflicts and verify information in multi-agent computer-use scenarios.Google36 upvotesRead →Inference and efficiencyUnverifiedOct 13, 2026EdgeWise: Bringing Long-Horizon Agents to the Edge via Selective Cloud DelegationThis paper introduces a framework that reduces inference costs by using a small local model for most tasks and delegating only critical steps to the cloud.NVIDIA30 upvotesRead →Inference and efficiencyUnverifiedOct 13, 2026Simplifying and Improving On-Policy Distillation for Few-Step DiffusionThis paper introduces a simplified regression-based method for distilling diffusion models that improves generation speed without requiring complex training techniques.Microsoft27 upvotesRead →Multimodal and roboticsUnverifiedOct 13, 2026Fish Audio Drama 3 Technical ReportThis paper introduces an open-source speech generation model capable of multi-turn performance, character-specific voice cloning, and real-time audio editing.Fish Audio26 upvotesRead →Training and scalingUnverifiedOct 13, 2026APT: Feedback-Driven Agentic Post-Training for Text-to-Image GenerationThis paper introduces an automated post-training framework that uses a feedback loop of evaluation and diagnosis to improve text-to-image models.Microsoft23 upvotesRead →Inference and efficiencyUnverifiedOct 13, 2026Virtual Head AttentionVirtual Head Attention improves long-context model efficiency by reducing KV cache and compute while preserving quality through lightweight linear query and output transformations.Baidu17 upvotesRead →Inference and efficiencyUnverifiedOct 13, 2026FlashMask-3: Efficient and Expressive Mask-Aware Distributed AttentionFlashMask-3 accelerates long-context attention via a Hopper-optimized sparse-mask kernel and distributed context-parallel extensions that eliminate mask-communication overhead and improve training throughput.Baidu11 upvotesRead →
Monday, Oct 121 paper
Applied AIUnverifiedOct 12, 2026X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray ReasoningThis paper introduces a reinforcement learning framework for medical agents that selectively uses external evidence to improve diagnostic reasoning in chest X-rays.Carnegie Mellon University44 upvotesRead →
Saturday, Oct 101 paper
Alignment and safetyUnverifiedOct 10, 2026Last Secure Code Benchmark: Is the Code You Vibe Secure?This paper introduces a benchmark showing that current coding agents frequently produce functional but insecure code, highlighting significant security risks in automated coding.Alibaba (Qwen)77 upvotesRead →
Friday, Oct 93 papers
Agents and evaluationUnverifiedOct 9, 2026Scaling Agentic Data for Long-Horizon Terminal IntelligenceThis paper introduces a system to automatically generate high-quality training data for long-horizon terminal agents to improve their autonomous problem-solving capabilities.Alibaba (Qwen)1 citations147 upvotesRead →Agents and evaluationUnverifiedOct 9, 2026Harness^2: Recursive Agent Harnessing for an Open WorldThis paper introduces a recursive framework that allows agents to automatically improve their own execution harnesses for better performance on novel open-world tasks.Google2 citations123 upvotesRead →ArchitecturesUnverifiedOct 9, 2026Learning Representations to Guide Pixel Diffusion TransformersThis paper introduces a guidance method for diffusion transformers that uses compact internal representations to improve image generation quality and efficiency.Alibaba (Qwen)34 upvotesRead →
Thursday, Oct 82 papers
ReasoningUnverifiedOct 8, 2026Thinking Inertia: LLMs Keep Thinking When Told Not ToThis paper shows that explicit controls often fail to stop LLMs from generating internal reasoning traces, a phenomenon the authors call thinking inertia.Stanford University244 upvotesRead →Training and scalingUnverifiedOct 8, 2026When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often BetterThis paper shows that distilling from offline student rollouts is often more efficient and accurate than standard on-policy distillation for many model pairs.NVIDIA28 upvotesRead →
Wednesday, Oct 72 papers
Multimodal and roboticsUnverifiedOct 7, 2026Long-WAM: Scaling the Context of World-Action ModelsLong-WAM improves robot control by using autoregressive pretraining to effectively leverage long visual histories for real-time action prediction.NVIDIA2 citations114 upvotesRead →Multimodal and roboticsUnverifiedOct 7, 2026VIS-Ground: Video Interactive Storytelling with Contextual GroundingThis paper introduces a framework that transforms heterogeneous user inputs into structured constraints to improve grounding in interactive video generation.Google103 upvotesRead →
Tuesday, Oct 66 papers
ReasoningUnverifiedOct 6, 2026Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior ForesightSelf-Retrospection Distillation improves agent performance by using hindsight from completed trajectories to supervise foresight predictions during training.Salesforce1 citations197 upvotesRead →Inference and efficiencyUnverifiedOct 6, 2026TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language ModelsTRACE improves reinforcement learning for large language models by aligning quantization during training and rollout to reduce performance loss in low-precision execution.Alibaba (Qwen)1 citations92 upvotesRead →Inference and efficiencyUnverifiedOct 6, 2026VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMsThis paper introduces a method for multimodal models to adaptively allocate visual detail, reducing token usage while maintaining performance.Alibaba (Qwen)1 citations71 upvotesRead →Retrieval and dataUnverifiedOct 6, 2026UNREAL: Unifying Retrieval and Long-Context with a Single ModelUNREAL uses a single model-internal mechanism to perform both corpus retrieval and long-context evidence selection, improving performance while reducing computational costs.NVIDIA31 upvotesRead →Agents and evaluationUnverifiedOct 6, 2026Stateless Language Agents: Scaling Long-Horizon Automated ResearchThis paper introduces a framework where agents remain stateless, allowing a central harness to manage research state and improve long-horizon task efficiency.Stanford University1 citations30 upvotesRead →Inference and efficiencyUnverifiedOct 6, 2026NeMo-DCR: Bit-Exact Delta-Compressed Refit for Scalable Agentic RL at Trillion-Parameter ScaleNeMo-DCR enables efficient, bit-exact synchronization of trillion-parameter model checkpoints by transmitting only the sparse weight changes between clusters.NVIDIA1 citations29 upvotesRead →
Monday, Oct 52 papers
Inference and efficiencyUnverifiedOct 5, 2026LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient SketchesLoGRA reduces memory usage during reinforcement learning by using low-rank gradient sketches and step control to stabilize training.NVIDIA153 upvotesRead →Applied AIUnverifiedOct 5, 2026MiniCorp: The Last Mile of the AI Agent FirmMiniCorp is an office simulator that allows researchers to study how agents run companies and generate enterprise data for training.Microsoft39 upvotesRead →
Saturday, Oct 31 paper
ArchitecturesUnverifiedOct 3, 2026ALoDLM: Adaptively Looped Diffusion Language ModelsALoDLM improves diffusion language models by using token-adaptive latent recurrence to allocate more computation to difficult tokens.Amazon1 citations80 upvotesRead →
Friday, Oct 22 papers
Multimodal and roboticsUnverifiedOct 2, 2026Native Action-Prior Learning from Videos for World Action ModelsNAVA-WAM learns robot action priors directly from observation-only videos, improving control performance without needing action-labeled data for pretraining.Meta88 upvotesRead →Applied AIUnverifiedOct 2, 2026SEER: Self-Evolving Event Reasoning and Retrieval for Time Series ForecastingSEER improves time series forecasting by using a closed-loop system to retrieve and reason about external events that influence data trends.Google35 upvotesRead →
Thursday, Oct 18 papers
Alignment and safetyUnverifiedOct 1, 2026Sharpening Tax in Post-TrainingThis paper introduces a metric to quantify the loss in solution coverage after reinforcement learning and proposes a sampler to mitigate it.Meta1 citations111 upvotesRead →Multimodal and roboticsUnverifiedOct 1, 2026World Action Modeling with Progressive Visual PlanningProWAM improves robotic control by predicting sparse visual sub-goals to guide action generation, avoiding the need for dense video generation.Meta1 citations98 upvotesRead →ReasoningUnverifiedOct 1, 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief StatesPoS improves long-horizon agent performance by maintaining explicit belief states that track world status and unresolved task requirements.Alibaba (Qwen)1 citations91 upvotesRead →Alignment and safetyUnverifiedOct 1, 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness OptimizationActiveSaddler optimizes agent training by dynamically adapting the curriculum of scenarios based on discovered failure patterns.Microsoft86 upvotesRead →Alignment and safetyUnverifiedOct 1, 2026VeriHarness: Scaling Agentic Verification for Long-Horizon TasksVeriHarness improves long-horizon agent performance by using the base model as a verifier to resolve conflicting claims and challenge consensus.Google1 citations62 upvotesRead →Inference and efficiencyUnverifiedOct 1, 2026Decoding Looped Transformers Better for (Almost) FreeLoopCD improves decoding quality in looped transformers by contrasting final predictions with earlier recurrent states without extra training.Apple1 citations46 upvotesRead →Retrieval and dataUnverifiedOct 1, 2026RPTune: Learned Context Curation for LLM Catalog SearchRPTune improves LLM search accuracy by learning how to curate product catalogs and adapting the model to those curated contexts.Google40 upvotesRead →ReasoningUnverifiedOct 1, 2026Selection-Based Structured Reasoning: Toward Efficient Multimodal Search AgentsSSR improves multimodal agent efficiency by replacing free-form reasoning generation with a selection process from pre-specified reasoning candidates.Carnegie Mellon University37 upvotesRead →
Wednesday, Sep 302 papers
Alignment and safetyUnverifiedSep 30, 2026Mid-Harness: Scaling Actions Between Model and Harness for Terminal AgentsMid-Harness improves agent reliability by sampling and verifying candidate actions before execution, rather than relying on a single generation.NVIDIA3 citations120 upvotesRead →Multimodal and roboticsUnverifiedSep 30, 2026OmniReasoning: Pushing the Limits of Audio-Visual Joint ReasoningOmniReasoning improves audio-visual joint reasoning through a new benchmark, a data engine, and a self-distillation method for credit assignment.Alibaba (Qwen)27 upvotesRead →
Tuesday, Sep 299 papers
Applied AIUnverifiedSep 29, 2026Predictive Credit: Measuring What Scientific Explanations Add to Experimental ForecastsThis paper introduces a protocol to measure how much scientific explanations actually improve the accuracy of experimental forecasts.Carnegie Mellon University103 upvotesRead →Retrieval and dataUnverifiedSep 29, 2026Follow the Entities: A Corpus Map for Agentic SearchCorpusMap improves agentic search by organizing documents into a graph based on recurring entities, allowing agents to traverse relationships between files.Microsoft100 upvotesRead →Multimodal and roboticsUnverifiedSep 29, 2026OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?This paper maps how visual generation tasks improve visual understanding capabilities, revealing specific task-dependent transfer benefits.UC Berkeley57 upvotesRead →Applied AIUnverifiedSep 29, 2026AIM: Agentic Idea Management for Automated ResearchAIM is an autonomous framework that manages and explores research directions by using surrogate models to guide experimental budget allocation.Google2 citations53 upvotesRead →ArchitecturesUnverifiedSep 29, 2026Context Language ModelsContext Language Models manage their own context by treating it as an editable file, improving performance and efficiency.Meta5 citations47 upvotesRead →Multimodal and roboticsUnverifiedSep 29, 2026LongLive-Plug: Once-for-All Distillation for Video GenerationLongLive-Plug distills reusable capabilities into LoRAs that can be deployed on diverse video generation models without retraining.NVIDIA1 citations42 upvotesRead →ReasoningUnverifiedSep 29, 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in AgentsQ&D trains agents to proactively ask for information that is necessary for task completion but not explicitly requested by the user.IBM41 upvotesRead →Applied AIUnverifiedSep 29, 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle TranslationSMART is a self-evolving multi-agent system that improves long-form subtitle translation by using persistent memory and dynamic routing.Amazon38 upvotesRead →Multimodal and roboticsUnverifiedSep 29, 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and GenerationPixelUMM is an encoder-free model that unifies image and video understanding and generation directly in pixel space.NVIDIA2 citations33 upvotesRead →
Monday, Sep 283 papers
ReasoningUnverifiedSep 28, 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual EvidenceReaLVR improves latent visual reasoning by providing explicit supervision to latent trajectories, helping models focus on relevant visual evidence.Amazon2 citations210 upvotesRead →Multimodal and roboticsUnverifiedSep 28, 2026LEGO-Anything: Coding Agents for 3D Scene ReconstructionLEGO-Anything is a framework where an agent iteratively writes and executes code to reconstruct 3D scenes from images.AWS135 upvotesRead →ReasoningUnverifiedSep 28, 2026An RL View of OPD: Least Square Policy Distillation for Sample-Efficient LLM ReasoningLSPD applies reinforcement learning principles to policy distillation, improving sample efficiency and policy diversity in language model training.NVIDIA26 upvotesRead →
Sunday, Sep 273 papers
Training and scalingUnverifiedSep 27, 2026QwenGyre: An Elastic Reinforcement Learning Framework for Training xLong-Horizon AgentsQwenGyre is an online reinforcement learning framework that elastically manages GPU resources to train agents on extremely long-horizon tasks.Alibaba (Qwen)2 citations43 upvotesRead →Training and scalingUnverifiedSep 27, 2026Selecting Diverse SFT Traces Improves Post-RL GeneralizationSelecting diverse reasoning paths during supervised fine-tuning improves model performance and generalization after reinforcement learning.Google38 upvotesRead →Training and scalingUnverifiedSep 27, 2026What masking geometry works best for EEG foundation models?Spatio-temporal masking strategies for EEG foundation models were systematically compared across MAE and JEPA frameworks, revealing robust performance across configurations and a novel JEPA failure mode, with optimal masking achieving high downstream accuracy at reduced compute.Hugging Face3 upvotesRead →
Saturday, Sep 261 paper
Inference and efficiencyUnverifiedSep 26, 2026In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video DiffusionFlashForward accelerates video diffusion by reusing in-flight KV caches and using sparse clean anchors to maintain structural consistency.Meta1 citations34 upvotesRead →
Wednesday, Sep 232 papers
Multimodal and roboticsUnverifiedSep 23, 2026Training Object Permanence in World ModelsThis paper introduces a dataset and training stack to improve object permanence and physical reasoning in video world models.Carnegie Mellon University242 upvotesRead →Agents and evaluationSep 23, 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM AgentsKeeps an agent's raw past runs and writes a task-specific memory only when a new task arrives, rather than deciding up front what to keep.Salesforce2 citations56 upvotesRead →
Tuesday, Sep 223 papers
Agents and evaluationUnverifiedSep 22, 2026The Tasteful Agent: Measuring and Improving Taste in Long-Horizon TasksTaste-Bench measures an agent's ability to make good long-horizon decisions by evaluating choices at critical decision forks in trajectories.Microsoft1 citations162 upvotesRead →Agents and evaluationUnverifiedSep 22, 2026JEV-as-a-Judge: Accept When Confident, Escalate When UnsureJEV-as-a-Judge is a cost-effective evaluation framework that uses a simple decision-only judge for easy cases and escalates complex ones.Carnegie Mellon University57 citations42 upvotesRead →Applied AIUnverifiedSep 22, 2026Agensh: Scaling Organizational Intelligence to 1,024 AgentsAgensh is a scalable multi-agent harness that uses self-organized cooperation to coordinate up to 1,024 agents without a central orchestrator.Microsoft2 citations28 upvotesRead →
Monday, Sep 213 papers
Agents and evaluationSep 21, 2026RRSI: Regularized Recursive Self-Improvement of Agent HarnessesRRSI keeps self-improving agent harnesses from memorising their training tasks, so gains carry over to new benchmarks.Google32 citations221 upvotesRead →Agents and evaluationUnverifiedSep 21, 2026HappyWorld-BenchHappyWorld-Bench evaluates the reliability and consistency of generated worlds as agents interact with them over time.Alibaba (Qwen)57 upvotesRead →Agents and evaluationUnverifiedSep 21, 2026OSWorld-Pro: Process-based Evaluation for Computer Use AgentsOSWorld-Pro provides a procedural evaluation framework for computer-use agents by breaking tasks into subgoals and tracking progress.NVIDIA28 upvotesRead →
Sunday, Sep 201 paper
Training and scalingUnverifiedSep 20, 2026One to More, More to One: Category-Aware Iterative Expert Training for Software Engineering AgentsThis framework improves software engineering agents by training category-specific experts and consolidating them into a single student model.Alibaba (Qwen)50 upvotesRead →
Friday, Sep 184 papers
Multimodal and roboticsUnverifiedSep 18, 2026OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual DialogueOmniVChat is a framework for native audio-visual dialogue that includes a data engine for synthesis and a reinforcement learning reward design.Alibaba (Qwen)1 citations149 upvotesRead →Agents and evaluationUnverifiedSep 18, 2026RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use AgentsRecreationWorld is a framework for training and evaluating hybrid computer-use agents that must discover and recreate software behavior.Alibaba (Qwen)2 citations78 upvotesRead →Multimodal and roboticsUnverifiedSep 18, 2026MintAct: A Unified Visual Agent for Digital EnvironmentsMintAct is a unified vision-language model family that handles UI grounding and multi-step navigation across various digital environments.Apple35 upvotesRead →Applied AIUnverifiedSep 18, 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic DesignDesigner-RSI improves agentic graphic design by continually refining a procedural memory of skills based on user traffic and execution feedback.Adobe1 citations34 upvotesRead →
Thursday, Sep 176 papers
Inference and efficiencySep 17, 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache CompressionA 552B mixture-of-experts model with a 1M-token context, built to shrink the KV cache for agent workloads.DeepSeek158 citations188 upvotesRead →Inference and efficiencyUnverifiedSep 17, 2026SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent HarnessSoL-Pi scales auto-research loops for coding agents by optimizing harness-layer mechanisms to reduce token traffic and costs.NVIDIA13 citations137 upvotesRead →Training and scalingUnverifiedSep 17, 2026When EOS Tokens Disagree: Understanding Length Inflation in On-Policy DistillationThis paper identifies termination-token mismatch as a cause of length inflation in policy distillation and provides a mitigation strategy.Microsoft6 citations109 upvotesRead →ReasoningUnverifiedSep 17, 2026When2Think: Learning Difficulty-Aware Length Control for Efficient Hybrid Reasoning ModelsWhen2Think improves reasoning efficiency by dynamically allocating computation based on problem difficulty, using less compute for easy tasks.Microsoft1 citations54 upvotesRead →Training and scalingUnverifiedSep 17, 2026Don't Mask the Environment: Observation Supervision Changes How Agents Explore Under RLActObs improves agent reinforcement learning by supervising the model to predict environment observations during supervised fine-tuning.Amazon44 upvotesRead →Multimodal and roboticsUnverifiedSep 17, 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse ObservationsFAMOS is a feed-forward model that predicts articulated object motion from sparse point cloud observations.Stanford University40 upvotesRead →
Wednesday, Sep 161 paper
Applied AIUnverifiedSep 16, 2026BI-Agent and BI-Bench: Towards Automating End-to-End Business IntelligenceBI-Agent automates end-to-end business intelligence tasks by decomposing workflows into subtasks like data search, join, and transformation.Microsoft1 citations30 upvotesRead →
Tuesday, Sep 151 paper
Agents and evaluationUnverifiedSep 15, 2026Verifiable Social Reasoning for LLM AssistantsFuse is a multi-agent simulation framework that allows for the verifiable evaluation of an assistant's social reasoning capabilities.Google2 citations67 upvotesRead →
Monday, Sep 141 paper
Retrieval and dataUnverifiedSep 14, 2026Dream-RSI: Recursive Self-Improvement through Evolving WorldsDream-RSI enables scalable recursive self-improvement by using historical discovery replay to evaluate exploration policies offline, reducing costly online evaluations.Google24 citations246 upvotesRead →
Sunday, Sep 131 paper
ArchitecturesSep 13, 2026Flattening Every Memory Peak in Long-Context Mixture-of-Experts TrainingBounds the four memory peaks that crash long-context mixture-of-experts training, from expert dispatch to optimizer state, with fixed-size GPU schedules.Salesforce19 upvotesRead →
Friday, Sep 112 papers
Multimodal and roboticsSep 11, 2026SteerDuplex: Steerable Duplex Speech Dialogue ModelsA full-duplex speech model that follows spoken instructions on tone, persona, pace and voice, with a benchmark of 390 prompts to test it.Scale AI3 citations6 upvotesRead →Agents and evaluationSep 11, 2026Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent FailuresContinual Search improves automated root-cause attribution in long agent execution traces by iteratively prompting diagnosis until unresolved evidence is found.Scale AI5 upvotesRead →
Thursday, Sep 102 papers
Agents and evaluationUnverifiedSep 10, 2026Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and EvaluationBenchmark Radar is a searchable living database and discovery engine for AI evaluation benchmarks that aggregates sources, score histories, and evidence to support benchmark selection and comparison.Carnegie Mellon University171 upvotesRead →ReasoningUnverifiedSep 10, 2026Beyond Solver Verdicts: Generative Reward Models for AutoformalizationNeurosymbolic reasoning is vulnerable to incorrect but verdict-matching formal translations, which are addressed by a generative verification method that scores reference equivalence without an oracle and improves downstream accuracy.AWS1 citations33 upvotesRead →
Wednesday, Sep 93 papers
Training and scalingUnverifiedSep 9, 2026An Open Recipe for IMO Gold: Training Nemotron for Olympiad MathematicsA natural-language proof-generation pipeline using post-trained Nemotron 3 Ultra checkpoints achieves gold-medal performance on IMO 2026 through iterative verification and refinement without external tools.NVIDIA43 upvotesRead →ReasoningSep 9, 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language ReasoningOptimized supervised fine-tuning data composition enables reasoning models to consistently process and respond in diverse non-English languages without requiring reasoning supervision in each target language.Cohere33 upvotesRead →Agents and evaluationSep 9, 2026Studying Without a Syllabus: Task-Agnostic Environment PreprocessingAn agent can explore unfamiliar environments without task-specific guidance to build reusable artifacts that reduce later inference costs, though larger study budgets do not always improve results.Scale AI1 citations4 upvotesRead →
Tuesday, Sep 81 paper
Foundation modelsUnverifiedSep 8, 2026Procedural Graphs: Self-Evolving Execution Structures for LLM AgentsA procedural graph framework organizes agent actions into structured relational triplets, providing situational guidance and self-evolving topology to improve long-horizon tool use.Google2 citations41 upvotesRead →
Monday, Sep 71 paper
Training and scalingUnverifiedSep 7, 2026Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-TrainingA system for large-scale online draft co-training accelerates speculative decoding in RL post-training by extending context-parallel attention and adding cross-stage feature transport.NVIDIA4 citations35 upvotesRead →
Every paper, with filters →

Most cited

Semantic Scholar
1ArchitecturesJun 12, 2017Attention Is All You NeedIntroduced the Transformer, the attention-only architecture behind nearly every large language model since.Google201k citations142 upvotesRead →2Foundation modelsOct 11, 2018BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.Google125k citations33 upvotesRead →3Foundation modelsMay 28, 2020Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.OpenAI66.4k citations21 upvotesRead →4Foundation modelsMar 15, 2023GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI28.4k citations7 upvotesRead →5Alignment and safetyMar 4, 2022Training language models to follow instructions with human feedbackInstructGPT: fine-tuning on human feedback made a 1.3B model preferred over the 175B GPT-3.OpenAI25.8k citations26 upvotesRead →6Training and scalingJun 17, 2021LoRA: Low-Rank Adaptation of Large Language ModelsLoRA fine-tunes a large model by training small low-rank matrices, cutting trainable parameters by 10,000 times.Microsoft25.6k citations66 upvotesRead →7ReasoningJan 28, 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsAsking a model to write out its intermediate steps (chain of thought) sharply improves its math and logic answers.Google23.8k citations16 upvotesRead →8Foundation modelsFeb 27, 2023LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.Meta22.6k citations25 upvotesRead →9Foundation modelsJul 31, 2024The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta20.8k citations119 upvotesRead →10Multimodal and roboticsApr 5, 2023Segment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.Meta16.8k citations6 upvotesRead →11Alignment and safetyMay 29, 2023Direct Preference Optimization: Your Language Model is Secretly a Reward ModelDPO aligns a model to human preferences with a simple classification loss, no reward model or RL loop.Stanford University11.6k citations73 upvotesRead →12ReasoningUnverifiedFeb 5, 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsDeepSeekMath 7B improves mathematical reasoning through enhanced data pre-training and Group Relative Policy Optimization, achieving high scores on MATH benchmark without external tools.DeepSeek10.6k citations152 upvotesRead →13ArchitecturesDec 1, 2023Mamba: Linear-Time Sequence Modeling with Selective State SpacesA selective state space model that scales linearly with sequence length and matches Transformers on language.Carnegie Mellon University10.2k citations152 upvotesRead →14Foundation modelsUnverifiedMay 14, 2025Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.Alibaba (Qwen)10.1k citations339 upvotesRead →15Inference and efficiencySep 12, 2023Efficient Memory Management for Large Language Model Serving with PagedAttentionvLLM manages the KV cache like pages of virtual memory, serving models with 2 to 4 times the throughput.UC Berkeley9,965 citations72 upvotesRead →16Multimodal and roboticsJan 30, 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.Salesforce9,805 citations3 upvotesRead →17Training and scalingJan 23, 2020Scaling Laws for Neural Language ModelsLanguage model loss falls as a smooth power law as model size, data and compute grow.OpenAI9,592 citations12 upvotesRead →18Multimodal and roboticsJan 28, 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.Salesforce7,655 citations5 upvotesRead →19ReasoningJan 22, 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningReinforcement learning taught a model long step-by-step reasoning on par with OpenAI o1.DeepSeek5,972 citations458 upvotesRead →20Inference and efficiencyMay 27, 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessFlashAttention computes exact attention with far fewer GPU memory reads and writes, making long sequences faster.Stanford University5,830 citations16 upvotesRead →21Multimodal and roboticsUnverifiedOct 25, 2024GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.OpenAI5,388 citations88 upvotesRead →22Agents and evaluationUnverifiedJul 7, 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesGemini 2.X model family, including Gemini 2.5 Pro and Flash, offers superior coding, reasoning, and multimodal understanding capabilities across a range of computational efficiencies.Google4,594 citations67 upvotesRead →23Foundation modelsMar 8, 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextRecalls details across millions of tokens of text, hours of video and days of audio.Google DeepMind4,190 citations65 upvotesRead →24Training and scalingMar 29, 2022Training Compute-Optimal Large Language ModelsChinchilla: for a fixed compute budget, train a smaller model on more data; parameters and tokens should grow together.Google DeepMind4,035 citations13 upvotesRead →25Alignment and safetyDec 15, 2022Constitutional AI: Harmlessness from AI FeedbackConstitutional AI trains a harmless assistant from AI feedback guided by a short list of written principles, not human harm labels.Anthropic3,987 citations4 upvotesRead →26Training and scalingSep 17, 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model ParallelismMegatron-LM splits each Transformer layer across GPUs to train models with billions of parameters.NVIDIA3,387 citations5 upvotesRead →27Foundation modelsUnverifiedNov 26, 2025Qwen3-VL Technical ReportQwen3-VL, a vision-language model, excels in text and multimodal understanding through advanced architectures and larger contexts, achieving superior performance across benchmarks.Alibaba (Qwen)3,178 citations164 upvotesRead →28Retrieval and dataUnverifiedNov 9, 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.Hugging Face3,165 citations41 upvotesRead →29Foundation modelsApr 22, 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhoneSmall models trained on filtered and synthetic data that run on a phone and rival much larger ones.Microsoft2,649 citations262 upvotesRead →30ArchitecturesSep 2, 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and GenerationCodeT5, a unified encoder-decoder Transformer model, improves code understanding and generation by leveraging semantic information from identifiers and user comments.Salesforce2,633 citations3 upvotesRead →31Retrieval and dataApr 24, 2024From Local to Global: A Graph RAG Approach to Query-Focused SummarizationGraphRAG builds a knowledge graph of a document set so a model can answer questions about the whole collection.Microsoft2,561 citations7 upvotesRead →32ArchitecturesUnverifiedMar 14, 2025VGGT: Visual Geometry Grounded TransformerVGGT, a feed-forward neural network, efficiently infers multiple 3D attributes from single or multiple views, outperforming alternatives and enhancing downstream tasks without post-processing.Meta2,132 citations40 upvotesRead →33Foundation modelsUnverifiedJan 25, 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code IntelligenceDeepSeek-Coder, a series of open-source code models trained from scratch, outperforms both open-source and closed-source models across multiple benchmarks.DeepSeek2,033 citations74 upvotesRead →34Retrieval and dataUnverifiedAug 13, 2025DINOv3DINOv3, a self-supervised learning model, achieves superior performance across various vision tasks by scaling datasets and models, addressing dense feature degradation, and enhancing flexibility with post-hoc strategies.Meta1,932 citations320 upvotesRead →35Multimodal and roboticsUnverifiedNov 20, 2025SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.Meta1,466 citations138 upvotesRead →36ArchitecturesUnverifiedJan 11, 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsThe DeepSeekMoE architecture improves expert specialization in Mixture-of-Experts models by segmenting experts and isolating shared ones, achieving better performance and computational efficiency compared to GShard and other models.DeepSeek1,268 citations65 upvotesRead →37Foundation modelsUnverifiedJun 14, 2023WizardCoder: Empowering Code Large Language Models with Evol-InstructWizardCoder, a Code LLM fine-tuned with complex instructions using Evol-Instruct, outperforms other open-source and closed LLMs on several code generation benchmarks.Microsoft1,086 citations34 upvotesRead →38Multimodal and roboticsUnverifiedMar 8, 2024DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.DeepSeek939 citations49 upvotesRead →39Foundation modelsFeb 13, 2023The Impact of AI on Developer Productivity: Evidence from GitHub CopilotIn a controlled experiment, developers with GitHub Copilot finished a programming task 55.8% faster than those without it.GitHub906 citationsRead →40Agents and evaluationUnverifiedDec 2, 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-V3.2 introduces DeepSeek Sparse Attention and a scalable reinforcement learning framework, achieving superior reasoning and performance compared to GPT-5 and Gemini-3.0-Pro in complex reasoning tasks.DeepSeek887 citations275 upvotesRead →41Training and scalingUnverifiedJan 5, 2024DeepSeek LLM: Scaling Open-Source Language Models with LongtermismDeepSeek LLM, an open-source language model project, develops a large dataset and employs SFT and DPO to achieve performance surpassing LLaMA-2 70B and GPT-3.5 in various benchmarks and open-ended evaluations.DeepSeek872 citations56 upvotesRead →42ArchitecturesMay 13, 2023CodeT5+: Open Code Large Language Models for Code Understanding and GenerationCodeT5+, a family of flexible encoder-decoder LLMs initialized with frozen LLMs and trained with a mixture of pretraining objectives, achieves state-of-the-art performance across various code-related tasks.Salesforce836 citations7 upvotesRead →43Foundation modelsUnverifiedSep 7, 2021Datasets: A Community Library for Natural Language ProcessingDatasets is a community library for NLP that standardizes interfaces, versioning, and documentation for over 650 datasets with contributions from more than 250 individuals.Hugging Face828 citations16 upvotesRead →44Inference and efficiencyUnverifiedJul 24, 2025Group Sequence Policy OptimizationGroup Sequence Policy Optimization (GSPO) is a reinforcement learning algorithm that improves training efficiency and performance of large language models by using sequence-level importance ratios and operations.Alibaba (Qwen)814 citations323 upvotesRead →45Alignment and safetyFeb 22, 2024Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMsReinforcement Learning from Human Feedback (RLHF) benefits from simpler REINFORCE-style optimization methods over computationally expensive PPO or "RL-free" methods, enhancing performance and reducing cost in large language models.Cohere804 citations18 upvotesRead →46Alignment and safetyJan 10, 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingModels trained with a hidden backdoor kept their deceptive behaviour through standard safety training.Anthropic657 citations30 upvotesRead →47Foundation modelsUnverifiedSep 22, 2025Qwen3-Omni Technical ReportQwen3-Omni, a multimodal model, achieves state-of-the-art performance across text, image, audio, and video, using a Thinker-Talker MoE architecture and a lightweight causal ConvNet for efficient streaming synthesis.Alibaba (Qwen)653 citations155 upvotesRead →48Inference and efficiencyUnverifiedFeb 16, 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse AttentionNSA, a trainable sparse attention mechanism, enhances long-context modeling efficiency without sacrificing performance, achieving improvements in speed and accuracy over full attention models.DeepSeek596 citations157 upvotesRead →49ReasoningUnverifiedJun 17, 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceDeepSeek-Coder-V2, a Mixture-of-Experts language model, excels in code-specific tasks by enhancing coding and mathematical reasoning capabilities while expanding language support and context length.DeepSeek530 citations73 upvotesRead →50Multimodal and roboticsUnverifiedOct 17, 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and GenerationJanus, an autoregressive framework with separate visual encoding pathways within a unified transformer architecture, enhances performance in unified multimodal understanding and generation.DeepSeek525 citations37 upvotesRead →51Training and scalingMay 15, 2024LoRA Learns Less and Forgets LessLoRA learns less than full fine-tuning on code and math, but forgets less of what the model already knew.Databricks486 citations91 upvotesRead →52Agents and evaluationMar 12, 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?WorkArena and BrowserGym evaluate large language model-based agents' ability to perform enterprise software tasks, revealing gaps in current agent capabilities and differences between open and closed-source LLMs.ServiceNow443 citations2 upvotesRead →53Agents and evaluationFeb 12, 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelAya, a multilingual generative language model supporting over 50% lower-resourced languages, excels in both generative and discriminative tasks across 99 languages, and provides extensive evaluations and open-source resources.Cohere438 citations48 upvotesRead →54Agents and evaluationJul 23, 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable DomainsRubrics as Rewards (RaR) framework uses structured rubrics as interpretable reward signals for on-policy training, improving performance in real-world reinforcement learning tasks with subjective criteria.Scale AI431 citations6 upvotesRead →55Foundation modelsApr 29, 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse ModelsEvaluating Large Language Models using a Panel of smaller evaluators outperforms single large evaluators with reduced bias and cost.Cohere418 citations71 upvotesRead →56Alignment and safetyDec 18, 2024Alignment faking in large language modelsClaude 3 Opus sometimes went along with a training goal it disagreed with, to avoid being changed, without being told to.Anthropic393 citations10 upvotesRead →57Alignment and safetySep 4, 2025Why Language Models HallucinateModels hallucinate because training and benchmarks reward confident guessing over saying they do not know.OpenAI391 citations200 upvotesRead →58Agents and evaluationSep 21, 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?SWE-Bench Pro is a challenging benchmark for coding models, featuring complex, enterprise-level problems that require substantial code modifications, with performance evaluations showing significant limitations in current models.Scale AI367 citations21 upvotesRead →59Foundation modelsJul 2, 2026Gemma 4 Technical ReportOpen multimodal models from 2.3B to 31B parameters, with a thinking mode and image and audio input.Google DeepMind356 citations81 upvotesRead →60Foundation modelsMay 13, 2022Productivity Assessment of Neural Code CompletionFinds that how often developers accept Copilot's suggestions, more than other usage measures, predicts how productive they feel.GitHub349 citationsRead →
Every lab →