jina-embeddings-v5-omni: Text-Geometry-Preserving Multimodal Embeddings via Frozen-Tower Composition research paper by Jina AI, 2026
Jina AI · Multimodal and robotics · May 8, 2026 · 11 citations · 10 upvotes · unverified
What it shows
Frozen-encoder model composition enables efficient multimodal embedding by freezing pre-trained text models and adding specialized encoders for images and audio while maintaining text embedding consistency.
By Florian Hönicke, Michael Günther, Andreas Koukounas and 4 more · arXiv 2605.08384 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Jina AI
All 7jina-embeddings-v5-text: Task-Targeted Embedding DistillationCompact text embedding models are developed through a combined training approach using distillation and contrastive loss, achieving state-of-the-art performance while supporting long-context sequences and efficient quantization.
Jina AI28 citations28 upvotesRead →Jina-VLM: Small Multilingual Vision Language ModelJina-VLM, a 2.4B parameter vision-language model, achieves top performance in multilingual visual question answering using a SigLIP2 vision encoder and Qwen3 language backbone with an attention-pooling connector.
Jina AI3 citations17 upvotesRead →jina-reranker-v3: Last but Not Late Interaction for Document RerankingA multilingual document reranker using causal self-attention achieves state-of-the-art performance with a compact architecture.
Jina AI45 citations13 upvotesRead →Efficient Code Embeddings from Code Generation ModelsJina-code-embeddings uses an autoregressive backbone pre-trained on text and code to generate embeddings for code retrieval, question-answering, and similarity identification.
Jina AI23 citations20 upvotesRead →jina-embeddings-v3: Multilingual Embeddings With Task LoRAjina-embeddings-v3, a large-scale text embedding model, achieves state-of-the-art performance in multilingual and long-context retrieval tasks using Low-Rank Adaptation and Matryoshka Representation Learning.
Jina AI221 citations35 upvotesRead →Jina CLIP: Your CLIP Model Is Also Your Text RetrieverA novel multi-task contrastive training method improves CLIP model performance on both text-image and text-text retrieval tasks.
Jina AI61 citations37 upvotesRead →
Other multimodal and robotics papers
TopicSegment AnythingA promptable model and a dataset of over a billion masks that cut out any object in any image.
Meta16.8k citations6 upvotesRead →BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsBLIP-2 efficiently pre-trains vision-language models using off-the-shelf frozen encoders and decoders, achieving state-of-the-art performance with fewer parameters.
Salesforce9,805 citations3 upvotesRead →BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationBLIP, a Vision-Language Pre-training framework, improves performance across both understanding and generation tasks by bootstrapping captions from noisy web data, achieving state-of-the-art results on image-text retrieval, image captioning, and VQA, and showing strong generalization to video-language tasks.
Salesforce7,655 citations5 upvotesRead →GPT-4o System CardGPT-4o is an omnimodal autoregressive model trained to handle text, audio, image, and video inputs, offering high-performance outputs across these modalities, with particular strengths in vision and audio.
OpenAI5,388 citations88 upvotesRead →SAM 3: Segment Anything with ConceptsSegment Anything Model 3 achieves state-of-the-art performance in promptable concept segmentation and tracking by leveraging a unified model architecture with decoupled recognition and localization.
Meta1,466 citations138 upvotesRead →DeepSeek-VL: Towards Real-World Vision-Language UnderstandingDeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
DeepSeek939 citations49 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 11, 1 influential · Semantic Scholar
- Upvotes
- 10 · Hugging Face
- Lab
- Jina AI · on Companies · on Acquisitions · on Downtime · on labs · on marketplaces · on Paydays · on repos · on socials · on standards · on terms
Changes
A first count of 1 influential citations.
A first count of 11 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.