Skip to content
Papers.

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context research paper by Google DeepMind, 2024

Google DeepMind · Mar 8, 2024 · Foundation models · 4,002 citations · 65 upvotes

Read on arXiv

What it shows

Recalls details across millions of tokens of text, hours of video and days of audio.

Summarised by hand from the abstract.

More from Google DeepMind

All 3
PaperCitations
Gemma 4 Technical ReportOpen multimodal models from 2.3B to 31B parameters, with a thinking mode and image and audio input.Foundation models · Jul 2026106
Training Compute-Optimal Large Language ModelsChinchilla: for a fixed compute budget, train a smaller model on more data; parameters and tokens should grow together.Training and scaling · Mar 20223,755

Other foundation models papers

Topic
PaperCitations
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.Google · Oct 2018121k
Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.OpenAI · May 202063.6k
GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI · Mar 202327.3k
LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.Meta · Feb 202321.7k
The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta · Jul 202418.8k
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhoneSmall models trained on filtered and synthetic data that run on a phone and rival much larger ones.Microsoft · Apr 20242,497
About this paper
Authors
Machel Reid, Nikolay Savinov, Denis Teplyashin and 668 more
arXiv
2403.05530 · PDF
Venue
arXiv.org
Citations
4,002, 864 influential · Semantic Scholar
Upvotes
65 · Hugging Face
Lab
Google DeepMind · on Companies · on Acquisitions

Changes

What changed
New paperAdded to the listSep 24, 2026

Sources: each lab's own papers and arXiv, with citation and upvote counts from Semantic Scholar and Hugging Face. One-line summaries are for orientation, not a substitute for the paper. Logos via logo.dev; trademarks belong to their owners.

New papers by email

Monday afternoons, only in weeks with new papers from the labs.

Double opt-in. Unsubscribe any time.