Correction Training for Diffusion Models research paper by UC Berkeley, 2026
UC Berkeley · Architectures · Oct 14, 2026 · 42 upvotes · unverified
What it shows
This method adds a correction step to diffusion models to fix errors that accumulate during the image generation process.
By Donghoon Ahn, Runqian Wang, Alexei A. Efros and 2 more · arXiv 2610.14136 · PDF · Code
UnverifiedSummarised by a model from the abstract; not yet checked by hand.
More from UC Berkeley
All 14OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?This paper maps how visual generation tasks improve visual understanding capabilities, revealing specific task-dependent transfer benefits.
UC Berkeley57 upvotesRead →FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive ExecutionFreeToken is an edge-native Mixture-of-Experts serving system that dynamically maps computation and model state onto heterogeneous local hardware to run large open-weight models on personal machines.
UC Berkeley8 citations86 upvotesRead →Playful Agentic Robot LearningEmbodied robots learn reusable skills through self-directed play and exploration, then apply these skills to improve performance on downstream tasks without additional training.
UC Berkeley37 citations49 upvotesRead →Agents' Last ExamOver 1,000 real, checkable professional tasks written with 250+ industry experts; the hardest tier is far from solved.
UC Berkeley42 citations393 upvotesRead →Flash-KMeans: Fast and Memory-Efficient Exact K-MeansFlash-kmeans enables efficient online k-means clustering on GPUs through novel kernel-level optimizations that eliminate I/O bottlenecks and reduce atomic write contention.
UC Berkeley16 citations64 upvotesRead →dLLM: Simple Diffusion Language ModelingA unified open-source framework is presented that standardizes core components of diffusion language modeling for reproduction, customization, and accessible development of both large and small models.
UC Berkeley18 citations136 upvotesRead →SLA2: Sparse-Linear Attention with Learnable Routing and QATSLA2 improves sparse-linear attention in diffusion models by introducing a learnable router, direct attention formulation, and quantization-aware fine-tuning for enhanced efficiency and quality.
UC Berkeley1 citations59 upvotesRead →Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache QuantizationQuant VideoGen addresses KV cache memory limitations in autoregressive video diffusion models through semantic-aware smoothing and progressive residual quantization, achieving significant memory reduction with minimal latency impact.
UC Berkeley29 citations35 upvotesRead →
Other architectures papers
TopicAttention Is All You NeedIntroduced the Transformer, the attention-only architecture behind nearly every large language model since.
Google201k citations142 upvotesRead →Mamba: Linear-Time Sequence Modeling with Selective State SpacesA selective state space model that scales linearly with sequence length and matches Transformers on language.
Carnegie Mellon University10.2k citations152 upvotesRead →CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and GenerationCodeT5, a unified encoder-decoder Transformer model, improves code understanding and generation by leveraging semantic information from identifiers and user comments.
Salesforce2,633 citations3 upvotesRead →VGGT: Visual Geometry Grounded TransformerVGGT, a feed-forward neural network, efficiently infers multiple 3D attributes from single or multiple views, outperforming alternatives and enhancing downstream tasks without post-processing.
Meta2,132 citations40 upvotesRead →DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsThe DeepSeekMoE architecture improves expert specialization in Mixture-of-Experts models by segmenting experts and isolating shared ones, achieving better performance and computational efficiency compared to GShard and other models.
DeepSeek1,268 citations65 upvotesRead →CodeT5+: Open Code Large Language Models for Code Understanding and GenerationCodeT5+, a family of flexible encoder-decoder LLMs initialized with frozen LLMs and trained with a mixture of pretraining objectives, achieves state-of-the-art performance across various code-related tasks.
Salesforce836 citations7 upvotesRead →
About this paper
- Citations
- Not counted yet · Semantic Scholar
- Upvotes
- 42 · Hugging Face
- Lab
- UC Berkeley
Changes
Hugging Face upvotes fell from 47 to 42.
Hugging Face upvotes fell from 50 to 47.
This method adds a correction step to diffusion models to fix errors that accumulate during the image generation process.
Moved from Training and scaling to Architectures.
Found by the weekly Hugging Face scan; not yet checked by hand.