OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning research paper by Alibaba (Qwen), 2026
Alibaba (Qwen) · Multimodal and robotics · Sep 30, 2026 · 0 citations · 27 upvotes · unverified
What it shows
OmniReasoning improves audio-visual joint reasoning through a new benchmark, a data engine, and a self-distillation method for credit assignment.
By Junming Lin, Yuxuan Wang, Zhenxin Lei and 11 more · arXiv 2609.39490 · PDF · Code
UnverifiedSummarised by a model from the abstract; not yet checked by hand.
More from Alibaba (Qwen)
All 78Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic ModelsCo-Design Bench evaluates how effectively coding agents update software applications based on user requests with text, images, and other media.
Alibaba (Qwen)23 upvotesRead →Qwen-Image-PE: Learning Visual Design for Text-to-Image Prompt EnhancementQwen-Image-PE improves text-to-image prompts via two-stage training with caption-based reverse distillation and groupwise design rewards, scaling across data, model size, and information density.
Alibaba (Qwen)23 upvotesRead →World-in-Context: Interactive Video World Modeling with In-Context ConditioningWorld-in-Context unifies view, action, and camera controls via explicit tokens and interaction-aware positional encoding to improve interactive video generation and navigation.
Alibaba (Qwen)22 upvotesRead →Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research ReportsThis benchmark evaluates how well AI agents can research and synthesize information from videos to produce interactive reports.
Alibaba (Qwen)19 upvotesRead →UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping AgentsUserArena introduces a real-world interactive benchmark with long-horizon shopping trajectories and an evaluation framework, alongside On-Policy Trajectory Distillation to improve simulator fidelity for agentic recommendations.
Alibaba (Qwen)55 upvotesRead →SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolationThis training method uses a smaller, frozen model to guide the training of a larger diffusion model, improving quality without increasing inference costs.
Alibaba (Qwen)30 upvotesRead →BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesThis benchmark evaluates how well AI models can perform complex 3D creation and editing tasks within the Blender software.
Alibaba (Qwen)23 upvotesRead →CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image GenerationThis paper presents an end-to-end framework for generating commercial-grade e-commerce product images by combining metadata extraction, layout planning, and multi-condition generation.
Alibaba (Qwen)25 upvotesRead →
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 0, 0 influential · Semantic Scholar
- Upvotes
- 27 · Hugging Face
- Lab
- Alibaba (Qwen) · on Companies · on Quarterly
Changes
A first count of 0 influential citations.
A first count of 0 citations.
OmniReasoning improves audio-visual joint reasoning through a new benchmark, a data engine, and a self-distillation method for credit assignment.
Moved from Reasoning to Multimodal and robotics.
Found by the weekly Hugging Face scan; not yet checked by hand.