Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving research paper by Google, 2026
Google · Multimodal and robotics · May 21, 2026 · 3 citations · 25 upvotes · unverified
What it shows
Sensor2Sensor generates high-fidelity multi-modal sensor data from in-the-wild dashcam videos using diffusion models and 4D Gaussian Splatting for autonomous driving system training and validation.
By Jiahao Wang, Bo Sun, Yijing Bai and 12 more · arXiv 2605.22809 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Google
All 45EmbeddingGemma 2: Unified and Efficient Multimodal RepresentationsEmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.
Google34 upvotesRead →StreamVibe: Proactive Video Agents for Evolving User IntentStreamVibe introduces a benchmark, streaming vision-language model, and hierarchical memory harness to enable proactive, intent-aware interaction with implicit and evolving user goals.
Google78 upvotesRead →On-Policy Self-Training: Data-Free Self-Improvement in Large Language ModelsFoundation models can self-improve across text and vision tasks by generating synthetic questions and reasoning traces guided only by high-level topics, without external supervision.
Google31 upvotesRead →DeLoop: Repeated Actions as Self-Supervision for Long-Horizon AgentsThis self-supervised training method teaches AI agents to avoid repetitive, unproductive actions during long tasks by using their own history as feedback.
Google21 upvotesRead →CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation PipelineThis paper introduces a benchmark and generation pipeline to evaluate how agents resolve conflicts and verify information in multi-agent computer-use scenarios.
Google36 upvotesRead →Harness^2: Recursive Agent Harnessing for an Open WorldThis paper introduces a recursive framework that allows agents to automatically improve their own execution harnesses for better performance on novel open-world tasks.
Google2 citations123 upvotesRead →VIS-Ground: Video Interactive Storytelling with Contextual GroundingThis paper introduces a framework that transforms heterogeneous user inputs into structured constraints to improve grounding in interactive video generation.
Google103 upvotesRead →SEER: Self-Evolving Event Reasoning and Retrieval for Time Series ForecastingSEER improves time series forecasting by using a closed-loop system to retrieve and reason about external events that influence data trends.
Google35 upvotesRead →
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- Computer Vision and Pattern Recognition
- Citations
- 3, 1 influential · Semantic Scholar
- Upvotes
- 25 · Hugging Face
- Lab
- Google · on Companies · on Acquisitions · on Paydays · on TechConf · on Releases
Changes
Influential citations rose from 0 to 1.
Citations rose from 2 to 3.
Citations rose from 1 to 2.
A first count of 0 influential citations.
A first count of 1 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.