Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generation research paper by Character.AI, 2025
Character.AI · Multimodal and robotics · Sep 30, 2025 · 87 citations · 37 upvotes · unverified
What it shows
Ovi is a unified audio-video generation model using twin-DiT modules with blockwise cross-modal fusion, enabling natural synchronization and high-quality multimodal outputs.
By Chetwin Low, Weimin Wang, Calder Katyal · arXiv 2510.01284 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 87, 35 influential · Semantic Scholar
- Upvotes
- 37 · Hugging Face
- Lab
- Character.AI · on Companies · on Acquisitions · on awards · on breaches · on labs · on lawsuits · on Leaders · on Paydays · on salaries · on socials · on terms · on Titlewave
Changes
Influential citations rose from 33 to 35.
Citations rose from 81 to 87.
Citations rose from 78 to 81.
Influential citations rose from 31 to 33.
Citations rose from 75 to 78.
Citations rose from 74 to 75.
A first count of 31 influential citations.
A first count of 74 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.