Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence research paper by DeepSeek, 2024

DeepSeek · Foundation models · Jan 25, 2024 · 2,033 citations · 74 upvotes · unverified

Read on arXiv

What it shows

DeepSeek-Coder, a series of open-source code models trained from scratch, outperforms both open-source and closed-source models across multiple benchmarks.

By Daya Guo, Qihao Zhu, Dejian Yang and 10 more · arXiv 2401.14196 · PDF · Code

UnverifiedHugging Face's summary; not yet checked by hand.

More from DeepSeek

All 22
Inference and efficiencySep 17, 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache CompressionA 552B mixture-of-experts model with a 1M-token context, built to shrink the KV cache for agent workloads.DeepSeek158 citations188 upvotesRead →Inference and efficiencyUnverifiedJul 6, 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive GenerationDSpark enhances LLM inference speed by combining parallel draft generation with adaptive verification that reduces waste and improves throughput in high-concurrency settings.DeepSeek77 citations49 upvotesRead →Agents and evaluationUnverifiedFeb 25, 2026DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM InferenceDualPath addresses KV-cache storage I/O bottlenecks in multi-turn LLM inference by introducing dual-path loading and dynamic load balancing across prefill and decode engines.DeepSeek22 citations55 upvotesRead →Multimodal and roboticsUnverifiedJan 28, 2026DeepSeek-OCR 2: Visual Causal FlowDeepSeek-OCR 2 introduces DeepEncoder V2 that dynamically reorders visual tokens based on semantic content, enabling more human-like causal reasoning in 2D image understanding through cascaded 1D causal structures.DeepSeek79 citations73 upvotesRead →Training and scalingUnverifiedDec 31, 2025mHC: Manifold-Constrained Hyper-ConnectionsManifold-Constrained Hyper-Connections (mHC) stabilize and scale residual connection architectures by restoring identity mapping properties through manifold projection and infrastructure optimization.DeepSeek108 citations334 upvotesRead →Agents and evaluationUnverifiedDec 2, 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-V3.2 introduces DeepSeek Sparse Attention and a scalable reinforcement learning framework, achieving superior reasoning and performance compared to GPT-5 and Gemini-3.0-Pro in complex reasoning tasks.DeepSeek887 citations275 upvotesRead →ReasoningUnverifiedNov 27, 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical ReasoningA self-verifying large language model for theorem proving improves mathematical reasoning by incentivizing rigorous step-by-step derivations and achieves high scores in international competitions.DeepSeek83 citations98 upvotesRead →Inference and efficiencyUnverifiedOct 21, 2025DeepSeek-OCR: Contexts Optical CompressionDeepSeek-OCR uses optical 2D mapping to compress long contexts, achieving high OCR precision with reduced vision tokens and demonstrating practical value in document processing.DeepSeek200 citations98 upvotesRead →

Other foundation models papers

Topic
Foundation modelsOct 11, 2018BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.Google125k citations33 upvotesRead →Foundation modelsMay 28, 2020Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.OpenAI66.4k citations21 upvotesRead →Foundation modelsMar 15, 2023GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI28.4k citations7 upvotesRead →Foundation modelsFeb 27, 2023LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.Meta22.6k citations25 upvotesRead →Foundation modelsJul 31, 2024The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta20.8k citations119 upvotesRead →Foundation modelsUnverifiedMay 14, 2025Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.Alibaba (Qwen)10.1k citations339 upvotesRead →
About this paper
Venue
arXiv.org
Citations
2,033, 280 influential · Semantic Scholar
Upvotes
74 · Hugging Face
Lab
DeepSeek · on Companies · on breaches · on Rounds · on labs · on Leaders · on Arena · on legislations · on Paydays · on Metered · on problems · on repos · on socials · on standards · on terms

Changes

CitationsNov 9, 2026Influential citations rose from 272 to 280.
CitationsNov 9, 2026Citations rose from 1,959 to 2,033.
CitationsOct 12, 2026Influential citations fell from 273 to 272.
CitationsOct 12, 2026Citations rose from 1,932 to 1,959.
CitationsOct 5, 2026Influential citations rose from 268 to 273.
CitationsOct 5, 2026Citations rose from 1,906 to 1,932.
CitationsSep 28, 2026Citations rose from 1,905 to 1,906.
CitationsSep 25, 2026A first count of 268 influential citations.
CitationsSep 25, 2026A first count of 1,905 citations.
New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.