Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness research paper by Stanford University, 2022

Stanford University · Inference and efficiency · May 27, 2022 · 5,830 citations · 16 upvotes

Read on arXiv

What it shows

FlashAttention computes exact attention with far fewer GPU memory reads and writes, making long sequences faster.

By Tri Dao, Daniel Y. Fu, Stefano Ermon and 2 more · arXiv 2205.14135 · PDF

Summarised by hand from the abstract.

More from Stanford University

All 12
ReasoningUnverifiedOct 13, 2026Hybrid Reasoning AgentsThis paper introduces an agent architecture that dynamically switches between latent reasoning and text-based interaction to improve performance and inference speed.Stanford University41 upvotesRead →ReasoningUnverifiedOct 8, 2026Thinking Inertia: LLMs Keep Thinking When Told Not ToThis paper shows that explicit controls often fail to stop LLMs from generating internal reasoning traces, a phenomenon the authors call thinking inertia.Stanford University244 upvotesRead →Agents and evaluationUnverifiedOct 6, 2026Stateless Language Agents: Scaling Long-Horizon Automated ResearchThis paper introduces a framework where agents remain stateless, allowing a central harness to manage research state and improve long-horizon task efficiency.Stanford University1 citations30 upvotesRead →Multimodal and roboticsUnverifiedSep 17, 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse ObservationsFAMOS is a feed-forward model that predicts articulated object motion from sparse point cloud observations.Stanford University40 upvotesRead →Alignment and safetyUnverifiedJul 30, 2026AISPA: User-Centric System Prompt Auditing for Large Language Model ApplicationsAISPA is a framework for auditing system prompts in commercial AI products to ensure they are protective of users.Stanford University36 upvotesRead →Agents and evaluationUnverifiedApr 28, 2026Recursive Multi-Agent SystemsRecursiveMAS extends recursive scaling principles from single models to multi-agent systems, enabling collaborative reasoning through iterative latent-space computations with improved efficiency and accuracy.Stanford University12 citations235 upvotesRead →Foundation modelsUnverifiedMar 19, 2026Multi-User Large Language Model AgentsMulti-user large language model agents face challenges in handling conflicting objectives, privacy preservation, and coordination efficiency in multi-principal decision-making scenarios.Stanford University9 citations28 upvotesRead →Retrieval and dataUnverifiedJan 22, 2026Learning to Discover at Test TimeTest-time training enables AI systems to discover optimal solutions for specific scientific problems through continual learning focused on individual challenges rather than generalization.Stanford University118 citations45 upvotesRead →

Other inference and efficiency papers

Topic
Inference and efficiencySep 12, 2023Efficient Memory Management for Large Language Model Serving with PagedAttentionvLLM manages the KV cache like pages of virtual memory, serving models with 2 to 4 times the throughput.UC Berkeley9,965 citations72 upvotesRead →Inference and efficiencyUnverifiedJul 24, 2025Group Sequence Policy OptimizationGroup Sequence Policy Optimization (GSPO) is a reinforcement learning algorithm that improves training efficiency and performance of large language models by using sequence-level importance ratios and operations.Alibaba (Qwen)814 citations323 upvotesRead →Inference and efficiencyUnverifiedFeb 16, 2025Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse AttentionNSA, a trainable sparse attention mechanism, enhances long-context modeling efficiency without sacrificing performance, achieving improvements in speed and accuracy over full attention models.DeepSeek596 citations157 upvotesRead →Inference and efficiencyUnverifiedApr 7, 2025SmolVLM: Redefining small and efficient multimodal modelsSmolVLM, a series of compact multimodal models, achieves high performance with minimal GPU memory usage, making efficient deployment on mobile and edge devices possible.Hugging Face330 citations212 upvotesRead →Inference and efficiencyUnverifiedOct 17, 2025Chronos-2: From Univariate to Universal ForecastingChronos-2, a pretrained model with a group attention mechanism, achieves state-of-the-art performance in zero-shot univariate, multivariate, and covariate-informed forecasting tasks.Amazon276 citations28 upvotesRead →Inference and efficiencyUnverifiedApr 3, 2025Inference-Time Scaling for Generalist Reward ModelingSelf-Principled Critique Tuning enhances pointwise generative reward modeling for large language models, improving scalability and quality compared to existing methods.DeepSeek259 citations59 upvotesRead →
About this paper
Venue
Neural Information Processing Systems
Citations
5,830, 492 influential · Semantic Scholar
Upvotes
16 · Hugging Face
Lab
Stanford University

Changes

CitationsNov 9, 2026Influential citations rose from 482 to 492.
CitationsNov 9, 2026Citations rose from 5,749 to 5,830.
CitationsNov 2, 2026Influential citations rose from 470 to 482.
CitationsNov 2, 2026Citations rose from 5,545 to 5,749.
CitationsOct 12, 2026Influential citations rose from 463 to 470.
CitationsOct 12, 2026Citations rose from 5,460 to 5,545.
CitationsOct 5, 2026Influential citations rose from 454 to 463.
CitationsOct 5, 2026Citations rose from 5,355 to 5,460.
CitationsSep 28, 2026Influential citations rose from 452 to 454.
CitationsSep 28, 2026Citations rose from 5,334 to 5,355.
CitationsSep 25, 2026Influential citations rose from 451 to 452.
CitationsSep 25, 2026Citations rose from 5,331 to 5,334.
New paperSep 24, 2026Added to the list.