DeepSeek-VL: Towards Real-World Vision-Language Understanding research paper by DeepSeek, 2024

DeepSeek · Multimodal and robotics · Mar 8, 2024 · 939 citations · 49 upvotes · unverified

DeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.

By Haoyu Lu, Wen Liu, Bo Zhang and 11 more · arXiv 2403.05525 · PDF · Code

UnverifiedHugging Face's summary; not yet checked by hand.

More from DeepSeek

All 22

Inference and efficiencySep 17, 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache CompressionA 552B mixture-of-experts model with a 1M-token context, built to shrink the KV cache for agent workloads.

DeepSeek158 citations188 upvotesRead →Inference and efficiencyUnverifiedJul 6, 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive GenerationDSpark enhances LLM inference speed by combining parallel draft generation with adaptive verification that reduces waste and improves throughput in high-concurrency settings.

DeepSeek77 citations49 upvotesRead →Agents and evaluationUnverifiedFeb 25, 2026DualPath: Breaking the Storage Bandwidth Bottleneck in Agentic LLM InferenceDualPath addresses KV-cache storage I/O bottlenecks in multi-turn LLM inference by introducing dual-path loading and dynamic load balancing across prefill and decode engines.

DeepSeek22 citations55 upvotesRead →Multimodal and roboticsUnverifiedJan 28, 2026DeepSeek-OCR 2: Visual Causal FlowDeepSeek-OCR 2 introduces DeepEncoder V2 that dynamically reorders visual tokens based on semantic content, enabling more human-like causal reasoning in 2D image understanding through cascaded 1D causal structures.

DeepSeek79 citations73 upvotesRead →Training and scalingUnverifiedDec 31, 2025mHC: Manifold-Constrained Hyper-ConnectionsManifold-Constrained Hyper-Connections (mHC) stabilize and scale residual connection architectures by restoring identity mapping properties through manifold projection and infrastructure optimization.

DeepSeek108 citations334 upvotesRead →Agents and evaluationUnverifiedDec 2, 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-V3.2 introduces DeepSeek Sparse Attention and a scalable reinforcement learning framework, achieving superior reasoning and performance compared to GPT-5 and Gemini-3.0-Pro in complex reasoning tasks.

DeepSeek887 citations275 upvotesRead →ReasoningUnverifiedNov 27, 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical ReasoningA self-verifying large language model for theorem proving improves mathematical reasoning by incentivizing rigorous step-by-step derivations and achieves high scores in international competitions.

DeepSeek83 citations98 upvotesRead →Inference and efficiencyUnverifiedOct 21, 2025DeepSeek-OCR: Contexts Optical CompressionDeepSeek-OCR uses optical 2D mapping to compress long contexts, achieving high OCR precision with reduced vision tokens and demonstrating practical value in document processing.

DeepSeek200 citations98 upvotesRead →

Topic

Multimodal and roboticsApr 5, 2023Segment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.

Meta16.8k citations6 upvotesRead →Multimodal and roboticsJan 30, 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.

Salesforce9,805 citations3 upvotesRead →Multimodal and roboticsJan 28, 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.

Salesforce7,655 citations5 upvotesRead →Multimodal and roboticsUnverifiedOct 25, 2024GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.

OpenAI5,388 citations88 upvotesRead →Multimodal and roboticsUnverifiedNov 20, 2025SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.

Meta1,466 citations138 upvotesRead →Multimodal and roboticsUnverifiedNov 20, 2025SAM 3D: 3Dfy Anything in ImagesSAM 3D is a generative model that reconstructs 3D objects from single images using a multi-stage training framework that includes synthetic pretraining and real-world alignment, achieving high performance in human preference tests.

Meta343 citations117 upvotesRead →

About this paper

Venue: arXiv.org
Citations: 939, 107 influential · Semantic Scholar
Upvotes: 49 · Hugging Face
Lab: DeepSeek · on Companies · on breaches · on Rounds · on labs · on Leaders · on Arena · on legislations · on Paydays · on Metered · on problems · on repos · on socials · on standards · on terms

Changes

CitationsNov 2, 2026Influential citations rose from 103 to 107.

CitationsNov 2, 2026Citations rose from 910 to 939.

CitationsOct 12, 2026Influential citations rose from 102 to 103.

CitationsOct 12, 2026Citations rose from 896 to 910.

CitationsOct 5, 2026Influential citations rose from 101 to 102.

CitationsOct 5, 2026Citations rose from 892 to 896.

CitationsSep 28, 2026Influential citations rose from 100 to 101.

CitationsSep 28, 2026Citations rose from 889 to 892.

CitationsSep 25, 2026A first count of 100 influential citations.

CitationsSep 25, 2026A first count of 889 citations.

New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.

What it shows

More from DeepSeek

Other multimodal and robotics papers

Changes