Notable data and AI papers

Papers627Labs45

627 papers · 45 labs

StreamVibe: Proactive Video Agents for Evolving User Intent research paper by Google, 2026

Google · Multimodal and robotics · Oct 26, 2026 · 78 upvotes · unverified

Read on arXiv

What it shows

StreamVibe introduces a benchmark, streaming vision-language model, and hierarchical memory harness to enable proactive, intent-aware interaction with implicit and evolving user goals.

By Chengzhi Liu, Yuxiang Lai, Yuzhe Yang and 13 more · arXiv 2610.34662 · PDF

UnverifiedHugging Face's summary; not yet checked by hand.

More from Google

All 45
Inference and efficiencyUnverifiedOct 27, 2026EmbeddingGemma 2: Unified and Efficient Multimodal RepresentationsEmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.Google34 upvotesRead →Training and scalingUnverifiedOct 23, 2026On-Policy Self-Training: Data-Free Self-Improvement in Large Language ModelsFoundation models can self-improve across text and vision tasks by generating synthetic questions and reasoning traces guided only by high-level topics, without external supervision.Google31 upvotesRead →Training and scalingUnverifiedOct 14, 2026DeLoop: Repeated Actions as Self-Supervision for Long-Horizon AgentsThis self-supervised training method teaches AI agents to avoid repetitive, unproductive actions during long tasks by using their own history as feedback.Google21 upvotesRead →Agents and evaluationUnverifiedOct 13, 2026CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation PipelineThis paper introduces a benchmark and generation pipeline to evaluate how agents resolve conflicts and verify information in multi-agent computer-use scenarios.Google36 upvotesRead →Agents and evaluationUnverifiedOct 9, 2026Harness^2: Recursive Agent Harnessing for an Open WorldThis paper introduces a recursive framework that allows agents to automatically improve their own execution harnesses for better performance on novel open-world tasks.Google2 citations123 upvotesRead →Multimodal and roboticsUnverifiedOct 7, 2026VIS-Ground: Video Interactive Storytelling with Contextual GroundingThis paper introduces a framework that transforms heterogeneous user inputs into structured constraints to improve grounding in interactive video generation.Google103 upvotesRead →Applied AIUnverifiedOct 2, 2026SEER: Self-Evolving Event Reasoning and Retrieval for Time Series ForecastingSEER improves time series forecasting by using a closed-loop system to retrieve and reason about external events that influence data trends.Google35 upvotesRead →Retrieval and dataUnverifiedOct 1, 2026RPTune: Learned Context Curation for LLM Catalog SearchRPTune improves LLM search accuracy by learning how to curate product catalogs and adapting the model to those curated contexts.Google40 upvotesRead →

Other multimodal and robotics papers

Topic
Multimodal and roboticsApr 5, 2023Segment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.Meta16.8k citations6 upvotesRead →Multimodal and roboticsJan 30, 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.Salesforce9,805 citations3 upvotesRead →Multimodal and roboticsJan 28, 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.Salesforce7,655 citations5 upvotesRead →Multimodal and roboticsUnverifiedOct 25, 2024GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.OpenAI5,388 citations88 upvotesRead →Multimodal and roboticsUnverifiedNov 20, 2025SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.Meta1,466 citations138 upvotesRead →Multimodal and roboticsUnverifiedMar 8, 2024DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.DeepSeek939 citations49 upvotesRead →
About this paper
Citations
Not counted yet · Semantic Scholar
Upvotes
78 · Hugging Face
Lab
Google · on Companies · on Acquisitions · on Paydays · on TechConf · on Releases

Changes

UpvotesNov 9, 2026Hugging Face upvotes fell from 95 to 78.
New paperNov 2, 2026Found by the weekly Hugging Face scan; not yet checked by hand.