Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

Simplifying and Improving On-Policy Distillation for Few-Step Diffusion research paper by Microsoft, 2026

Microsoft · Inference and efficiency · Oct 13, 2026 · 27 upvotes · unverified

Read on arXiv

What it shows

This paper introduces a simplified regression-based method for distilling diffusion models that improves generation speed without requiring complex training techniques.

By Jiawei Zhang, Ziyu Wan, Nanye Ma and 5 more · arXiv 2610.18472 · PDF

UnverifiedSummarised by a model from the abstract; not yet checked by hand.

More from Microsoft

All 57
Agents and evaluationUnverifiedNov 2, 2026WebHarbor: Docking Real Websites for Evolving GUI Agent EnvironmentsWebHarbor provides realistic, containerized website environments for training and testing computer-using web agents across complex online tasks.Microsoft28 upvotesRead →Agents and evaluationUnverifiedOct 19, 2026Agent World Model in the Wild: Computer-Use Agent Environment SynthesisThis pipeline creates controllable, open-source environments to safely train and test AI agents on complex, long-horizon computer-use tasks.Microsoft69 upvotesRead →Training and scalingUnverifiedOct 16, 2026Self-Evolving Coding Agents via Harness-Policy OptimizationThis framework improves coding agents by recursively alternating between optimizing the agent's policy and the environment harness it uses to interact with code.Microsoft48 upvotesRead →Multimodal and roboticsUnverifiedOct 13, 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal RewardsThis paper introduces a method to improve code-based visual generation by using image-based aesthetic guidance and decoupled rewards to ensure quality and correctness.Microsoft137 upvotesRead →Training and scalingUnverifiedOct 13, 2026APT: Feedback-Driven Agentic Post-Training for Text-to-Image GenerationThis paper introduces an automated post-training framework that uses a feedback loop of evaluation and diagnosis to improve text-to-image models.Microsoft23 upvotesRead →Multimodal and roboticsUnverifiedOct 13, 2026LensErase: A Foundation Model for Erase AnythingThis paper introduces a foundation model designed for versatile image editing and object removal using mask-based inputs and efficient positional encoding.Microsoft52 upvotesRead →Applied AIUnverifiedOct 5, 2026MiniCorp: The Last Mile of the AI Agent FirmMiniCorp is an office simulator that allows researchers to study how agents run companies and generate enterprise data for training.Microsoft39 upvotesRead →Alignment and safetyUnverifiedOct 1, 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness OptimizationActiveSaddler optimizes agent training by dynamically adapting the curriculum of scenarios based on discovered failure patterns.Microsoft86 upvotesRead →

Other inference and efficiency papers

Topic
Inference and efficiencySep 12, 2023Efficient Memory Management for Large Language Model Serving with PagedAttentionvLLM manages the KV cache like pages of virtual memory, serving models with 2 to 4 times the throughput.UC Berkeley9,965 citations72 upvotesRead →Inference and efficiencyMay 27, 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessFlashAttention computes exact attention with far fewer GPU memory reads and writes, making long sequences faster.Stanford University5,830 citations16 upvotesRead →Inference and efficiencyUnverifiedJul 24, 2025Group Sequence Policy OptimizationGroup Sequence Policy Optimization (GSPO) is a reinforcement learning algorithm that improves training efficiency and performance of large language models by using sequence-level importance ratios and operations.Alibaba (Qwen)814 citations323 upvotesRead →Inference and efficiencyUnverifiedFeb 16, 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse AttentionNSA, a trainable sparse attention mechanism, enhances long-context modeling efficiency without sacrificing performance, achieving improvements in speed and accuracy over full attention models.DeepSeek596 citations157 upvotesRead →Inference and efficiencyUnverifiedApr 7, 2025SmolVLM: Redefining small and efficient multimodal modelsSmolVLM, a series of compact multimodal models, achieves high performance with minimal GPU memory usage, making efficient deployment on mobile and edge devices possible.Hugging Face330 citations212 upvotesRead →Inference and efficiencyUnverifiedOct 17, 2025Chronos-2: From Univariate to Universal ForecastingChronos-2, a pretrained model with a group attention mechanism, achieves state-of-the-art performance in zero-shot univariate, multivariate, and covariate-informed forecasting tasks.Amazon276 citations28 upvotesRead →
About this paper
Citations
Not counted yet · Semantic Scholar
Upvotes
27 · Hugging Face
Lab
Microsoft · on Companies · on Acquisitions · on Quarterly · on Paydays · on Releases · on TechConf

Changes

UpvotesNov 2, 2026Hugging Face upvotes fell from 33 to 27.
UpvotesOct 26, 2026Hugging Face upvotes rose from 31 to 33.
New summaryOct 19, 2026This paper introduces a simplified regression-based method for distilling diffusion models that improves generation speed without requiring complex training techniques.
TopicOct 19, 2026Moved from Training and scaling to Inference and efficiency.
New paperOct 19, 2026Found by the weekly Hugging Face scan; not yet checked by hand.