Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities research paper by Google, 2025
Google · Agents and evaluation · Jul 7, 2025 · 4,594 citations · 67 upvotes · unverified
What it shows
Gemini 2.X model family, including Gemini 2.5 Pro and Flash, offers superior coding, reasoning, and multimodal understanding capabilities across a range of computational efficiencies.
By Gheorghe Comanici, Eric Bieber, Mike Schaekermann and 3,300 more · arXiv 2507.06261 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Google
All 45EmbeddingGemma 2: Unified and Efficient Multimodal RepresentationsEmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.
Google34 upvotesRead →StreamVibe: Proactive Video Agents for Evolving User IntentStreamVibe introduces a benchmark, streaming vision-language model, and hierarchical memory harness to enable proactive, intent-aware interaction with implicit and evolving user goals.
Google78 upvotesRead →On-Policy Self-Training: Data-Free Self-Improvement in Large Language ModelsFoundation models can self-improve across text and vision tasks by generating synthetic questions and reasoning traces guided only by high-level topics, without external supervision.
Google31 upvotesRead →DeLoop: Repeated Actions as Self-Supervision for Long-Horizon AgentsThis self-supervised training method teaches AI agents to avoid repetitive, unproductive actions during long tasks by using their own history as feedback.
Google21 upvotesRead →CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation PipelineThis paper introduces a benchmark and generation pipeline to evaluate how agents resolve conflicts and verify information in multi-agent computer-use scenarios.
Google36 upvotesRead →Harness^2: Recursive Agent Harnessing for an Open WorldThis paper introduces a recursive framework that allows agents to automatically improve their own execution harnesses for better performance on novel open-world tasks.
Google2 citations123 upvotesRead →VIS-Ground: Video Interactive Storytelling with Contextual GroundingThis paper introduces a framework that transforms heterogeneous user inputs into structured constraints to improve grounding in interactive video generation.
Google103 upvotesRead →SEER: Self-Evolving Event Reasoning and Retrieval for Time Series ForecastingSEER improves time series forecasting by using a closed-loop system to retrieve and reason about external events that influence data trends.
Google35 upvotesRead →
Other agents and evaluation papers
TopicDeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-V3.2 introduces DeepSeek Sparse Attention and a scalable reinforcement learning framework, achieving superior reasoning and performance compared to GPT-5 and Gemini-3.0-Pro in complex reasoning tasks.
DeepSeek887 citations275 upvotesRead →WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?WorkArena and BrowserGym evaluate large language model-based agents' ability to perform enterprise software tasks, revealing gaps in current agent capabilities and differences between open and closed-source LLMs.
ServiceNow443 citations2 upvotesRead →Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelAya, a multilingual generative language model supporting over 50% lower-resourced languages, excels in both generative and discriminative tasks across 99 languages, and provides extensive evaluations and open-source resources.
Cohere438 citations48 upvotesRead →Rubrics as Rewards: Reinforcement Learning Beyond Verifiable DomainsRubrics as Rewards (RaR) framework uses structured rubrics as interpretable reward signals for on-policy training, improving performance in real-world reinforcement learning tasks with subjective criteria.
Scale AI431 citations6 upvotesRead →SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?SWE-Bench Pro is a challenging benchmark for coding models, featuring complex, enterprise-level problems that require substantial code modifications, with performance evaluations showing significant limitations in current models.
Scale AI367 citations21 upvotesRead →A Careful Examination of Large Language Model Performance on Grade School ArithmeticEvaluation of large language models on a new math benchmark, GSM1k, reveals that many models exhibit signs of overfitting to the existing GSM8k benchmark, leading to performance drops on GSM1k.
Scale AI255 citations33 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 4,594, 1,191 influential · Semantic Scholar
- Upvotes
- 67 · Hugging Face
- Lab
- Google · on Companies · on Acquisitions · on Paydays · on TechConf · on Releases
Changes
Influential citations rose from 1,165 to 1,191.
Citations rose from 4,523 to 4,594.
Influential citations rose from 1,120 to 1,165.
Citations rose from 4,338 to 4,523.
Influential citations rose from 1,095 to 1,120.
Citations rose from 4,244 to 4,338.
Influential citations rose from 1,074 to 1,095.
Citations rose from 4,157 to 4,244.
Influential citations rose from 1,066 to 1,074.
Citations rose from 4,134 to 4,157.
A first count of 1,066 influential citations.
A first count of 4,134 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.