Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking research paper by Google, 2026

Google · Multimodal and robotics · May 12, 2026 · 8 citations · 37 upvotes · unverified

Read on arXiv

What it shows

TrackCraft3R enables efficient dense 3D tracking from monocular video by adapting video diffusion transformers to follow physical points across frames using dual-latent representation and temporal RoPE alignment.

By Jisu Nam, Jahyeok Koo, Soowon Son and 4 more · arXiv 2605.12587 · PDF · Code

UnverifiedHugging Face's summary; not yet checked by hand.

More from Google

All 45
Inference and efficiencyUnverifiedOct 27, 2026EmbeddingGemma 2: Unified and Efficient Multimodal RepresentationsEmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.Google34 upvotesRead →Multimodal and roboticsUnverifiedOct 26, 2026StreamVibe: Proactive Video Agents for Evolving User IntentStreamVibe introduces a benchmark, streaming vision-language model, and hierarchical memory harness to enable proactive, intent-aware interaction with implicit and evolving user goals.Google78 upvotesRead →Training and scalingUnverifiedOct 23, 2026On-Policy Self-Training: Data-Free Self-Improvement in Large Language ModelsFoundation models can self-improve across text and vision tasks by generating synthetic questions and reasoning traces guided only by high-level topics, without external supervision.Google31 upvotesRead →Training and scalingUnverifiedOct 14, 2026DeLoop: Repeated Actions as Self-Supervision for Long-Horizon AgentsThis self-supervised training method teaches AI agents to avoid repetitive, unproductive actions during long tasks by using their own history as feedback.Google21 upvotesRead →Agents and evaluationUnverifiedOct 13, 2026CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation PipelineThis paper introduces a benchmark and generation pipeline to evaluate how agents resolve conflicts and verify information in multi-agent computer-use scenarios.Google36 upvotesRead →Agents and evaluationUnverifiedOct 9, 2026Harness^2: Recursive Agent Harnessing for an Open WorldThis paper introduces a recursive framework that allows agents to automatically improve their own execution harnesses for better performance on novel open-world tasks.Google2 citations123 upvotesRead →Multimodal and roboticsUnverifiedOct 7, 2026VIS-Ground: Video Interactive Storytelling with Contextual GroundingThis paper introduces a framework that transforms heterogeneous user inputs into structured constraints to improve grounding in interactive video generation.Google103 upvotesRead →Applied AIUnverifiedOct 2, 2026SEER: Self-Evolving Event Reasoning and Retrieval for Time Series ForecastingSEER improves time series forecasting by using a closed-loop system to retrieve and reason about external events that influence data trends.Google35 upvotesRead →

Other multimodal and robotics papers

Topic
Multimodal and roboticsApr 5, 2023Segment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.Meta16.8k citations6 upvotesRead →Multimodal and roboticsJan 30, 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.Salesforce9,805 citations3 upvotesRead →Multimodal and roboticsJan 28, 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.Salesforce7,655 citations5 upvotesRead →Multimodal and roboticsUnverifiedOct 25, 2024GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.OpenAI5,388 citations88 upvotesRead →Multimodal and roboticsUnverifiedNov 20, 2025SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.Meta1,466 citations138 upvotesRead →Multimodal and roboticsUnverifiedMar 8, 2024DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.DeepSeek939 citations49 upvotesRead →
About this paper
Venue
arXiv.org
Citations
8, 2 influential · Semantic Scholar
Upvotes
37 · Hugging Face
Lab
Google · on Companies · on Acquisitions · on Paydays · on TechConf · on Releases

Changes

CitationsNov 9, 2026Citations rose from 7 to 8.
CitationsNov 2, 2026Citations rose from 5 to 7.
CitationsOct 12, 2026Citations rose from 4 to 5.
CitationsOct 5, 2026Citations rose from 3 to 4.
CitationsSep 25, 2026A first count of 2 influential citations.
CitationsSep 25, 2026A first count of 3 citations.
New paperSep 25, 2026Found by the weekly Hugging Face scan; not yet checked by hand.