Notable data and AI papers

627 papers · 45 labs

Correction Training for Diffusion Models research paper by UC Berkeley, 2026

UC Berkeley · Architectures · Oct 14, 2026 · 42 upvotes · unverified

Read on arXiv

What it shows

This method adds a correction step to diffusion models to fix errors that accumulate during the image generation process.

By Donghoon Ahn, Runqian Wang, Alexei A. Efros and 2 more · arXiv 2610.14136 · PDF · Code

UnverifiedSummarised by a model from the abstract; not yet checked by hand.

More from UC Berkeley

All 14
Multimodal and roboticsUnverifiedSep 29, 2026OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?This paper maps how visual generation tasks improve visual understanding capabilities, revealing specific task-dependent transfer benefits.UC Berkeley57 upvotesRead →Inference and efficiencyUnverifiedAug 17, 2026FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive ExecutionFreeToken is an edge-native Mixture-of-Experts serving system that dynamically maps computation and model state onto heterogeneous local hardware to run large open-weight models on personal machines.UC Berkeley8 citations86 upvotesRead →Agents and evaluationUnverifiedJun 17, 2026Playful Agentic Robot LearningEmbodied robots learn reusable skills through self-directed play and exploration, then apply these skills to improve performance on downstream tasks without additional training.UC Berkeley37 citations49 upvotesRead →Agents and evaluationJun 3, 2026Agents' Last ExamOver 1,000 real, checkable professional tasks written with 250+ industry experts; the hardest tier is far from solved.UC Berkeley42 citations393 upvotesRead →Inference and efficiencyUnverifiedMar 10, 2026Flash-KMeans: Fast and Memory-Efficient Exact K-MeansFlash-kmeans enables efficient online k-means clustering on GPUs through novel kernel-level optimizations that eliminate I/O bottlenecks and reduce atomic write contention.UC Berkeley16 citations64 upvotesRead →Foundation modelsUnverifiedFeb 26, 2026dLLM: Simple Diffusion Language ModelingA unified open-source framework is presented that standardizes core components of diffusion language modeling for reproduction, customization, and accessible development of both large and small models.UC Berkeley18 citations136 upvotesRead →Inference and efficiencyUnverifiedFeb 13, 2026SLA2: Sparse-Linear Attention with Learnable Routing and QATSLA2 improves sparse-linear attention in diffusion models by introducing a learnable router, direct attention formulation, and quantization-aware fine-tuning for enhanced efficiency and quality.UC Berkeley1 citations59 upvotesRead →Inference and efficiencyUnverifiedFeb 3, 2026Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache QuantizationQuant VideoGen addresses KV cache memory limitations in autoregressive video diffusion models through semantic-aware smoothing and progressive residual quantization, achieving significant memory reduction with minimal latency impact.UC Berkeley29 citations35 upvotesRead →
Topic
ArchitecturesJun 12, 2017Attention Is All You NeedIntroduced the Transformer, the attention-only architecture behind nearly every large language model since.Google201k citations142 upvotesRead →ArchitecturesDec 1, 2023Mamba: Linear-Time Sequence Modeling with Selective State SpacesA selective state space model that scales linearly with sequence length and matches Transformers on language.Carnegie Mellon University10.2k citations152 upvotesRead →ArchitecturesSep 2, 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and GenerationCodeT5, a unified encoder-decoder Transformer model, improves code understanding and generation by leveraging semantic information from identifiers and user comments.Salesforce2,633 citations3 upvotesRead →ArchitecturesUnverifiedMar 14, 2025VGGT: Visual Geometry Grounded TransformerVGGT, a feed-forward neural network, efficiently infers multiple 3D attributes from single or multiple views, outperforming alternatives and enhancing downstream tasks without post-processing.Meta2,132 citations40 upvotesRead →ArchitecturesUnverifiedJan 11, 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsThe DeepSeekMoE architecture improves expert specialization in Mixture-of-Experts models by segmenting experts and isolating shared ones, achieving better performance and computational efficiency compared to GShard and other models.DeepSeek1,268 citations65 upvotesRead →ArchitecturesMay 13, 2023CodeT5+: Open Code Large Language Models for Code Understanding and GenerationCodeT5+, a family of flexible encoder-decoder LLMs initialized with frozen LLMs and trained with a mixture of pretraining objectives, achieves state-of-the-art performance across various code-related tasks.Salesforce836 citations7 upvotesRead →
About this paper
Citations
Not counted yet · Semantic Scholar
Upvotes
42 · Hugging Face
Lab
UC Berkeley

Changes

UpvotesNov 9, 2026Hugging Face upvotes fell from 47 to 42.
UpvotesNov 2, 2026Hugging Face upvotes fell from 50 to 47.
New summaryOct 26, 2026This method adds a correction step to diffusion models to fix errors that accumulate during the image generation process.
TopicOct 26, 2026Moved from Training and scaling to Architectures.
New paperOct 26, 2026Found by the weekly Hugging Face scan; not yet checked by hand.