This Time is Different: An Observability Perspective on Time Series Foundation Models research paper by Datadog, 2025
Datadog · Agents and evaluation · May 20, 2025 · 79 citations · 40 upvotes · unverified
What it shows
Toto is a time series forecasting foundation model using a decoder-only architecture, demonstrating state-of-the-art performance on large-scale benchmarks with multivariate observability data.
By Ben Cohen, Emaad Khwaja, Youssef Doubli and 14 more · arXiv 2505.14766 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Datadog
All 3Toto 2.0: Time Series Forecasting Enters the Scaling EraTime series foundation models demonstrate scalable forecasting performance across parameter sizes, with Toto 2.0 achieving state-of-the-art results on multiple benchmarks through a unified training approach.
Datadog39 citations39 upvotesRead →Toto: Time Series Optimized Transformer for ObservabilityToto, a Time Series Optimized Transformer for Observability, achieves state-of-the-art performance in observability and general-purpose forecasting using a vast dataset of time series data.
Datadog47 citations33 upvotesRead →
Other agents and evaluation papers
TopicGemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesGemini 2.X model family, including Gemini 2.5 Pro and Flash, offers superior coding, reasoning, and multimodal understanding capabilities across a range of computational efficiencies.
Google4,594 citations67 upvotesRead →DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-V3.2 introduces DeepSeek Sparse Attention and a scalable reinforcement learning framework, achieving superior reasoning and performance compared to GPT-5 and Gemini-3.0-Pro in complex reasoning tasks.
DeepSeek887 citations275 upvotesRead →WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?WorkArena and BrowserGym evaluate large language model-based agents' ability to perform enterprise software tasks, revealing gaps in current agent capabilities and differences between open and closed-source LLMs.
ServiceNow443 citations2 upvotesRead →Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelAya, a multilingual generative language model supporting over 50% lower-resourced languages, excels in both generative and discriminative tasks across 99 languages, and provides extensive evaluations and open-source resources.
Cohere438 citations48 upvotesRead →Rubrics as Rewards: Reinforcement Learning Beyond Verifiable DomainsRubrics as Rewards (RaR) framework uses structured rubrics as interpretable reward signals for on-policy training, improving performance in real-world reinforcement learning tasks with subjective criteria.
Scale AI431 citations6 upvotesRead →SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?SWE-Bench Pro is a challenging benchmark for coding models, featuring complex, enterprise-level problems that require substantial code modifications, with performance evaluations showing significant limitations in current models.
Scale AI367 citations21 upvotesRead →
About this paper
- Venue
- Neural Information Processing Systems
- Citations
- 79, 14 influential · Semantic Scholar
- Upvotes
- 40 · Hugging Face
- Lab
- Datadog · on Companies · on Acquisitions · on advisories · on awards · on blogs · on calendar · on certifications · on Attested · on Quarterly · on Tier Zero · on Downtime · on Mainstage · on Leaders · on marketplaces · on openperks · on Allied · on Paydays · on problems · on quadrant · on Releases · on repos · on salaries · on Nines · on socials · on standards · on Stories · on TechConf · on terms · on Titlewave
Changes
Influential citations rose from 13 to 14.
Citations rose from 70 to 79.
Influential citations rose from 12 to 13.
Citations rose from 63 to 70.
Influential citations rose from 11 to 12.
Citations rose from 56 to 63.
Citations rose from 55 to 56.
A first count of 11 influential citations.
A first count of 55 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.