Skip to content
Papers.

jina-embeddings-v3: Multilingual Embeddings With Task LoRA research paper by Jina AI, 2024

Jina AI · Sep 16, 2024 · Training and scaling · 200 citations · 35 upvotes · unverified

Read on arXiv

What it shows

jina-embeddings-v3, a large-scale text embedding model, achieves state-of-the-art performance in multilingual and long-context retrieval tasks using Low-Rank Adaptation and Matryoshka Representation Learning.

UnverifiedHugging Face's summary; not yet checked by hand.

More from Jina AI

All 3
PaperCitations
jina-embeddings-v5-text: Task-Targeted Embedding DistillationCompact text embedding models are developed through a combined training approach using distillation and contrastive loss, achieving state-of-the-art performance while supporting long-context sequences and efficient quantization.Retrieval and data · Feb 2026 · Unverified22
Jina CLIP: Your CLIP Model Is Also Your Text RetrieverA novel multi-task contrastive training method improves CLIP model performance on both text-image and text-text retrieval tasks.Alignment and safety · May 2024 · Unverified61

Other training and scaling papers

Topic
PaperCitations
LoRA: Low-Rank Adaptation of Large Language ModelsLoRA fine-tunes a large model by training small low-rank matrices, cutting trainable parameters by 10,000 times.Microsoft · Jun 202123.3k
Scaling Laws for Neural Language ModelsLanguage model loss falls as a smooth power law as model size, data and compute grow.OpenAI · Jan 20209,065
Training Compute-Optimal Large Language ModelsChinchilla: for a fixed compute budget, train a smaller model on more data; parameters and tokens should grow together.Google DeepMind · Mar 20223,756
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model ParallelismMegatron-LM splits each Transformer layer across GPUs to train models with billions of parameters.NVIDIA · Sep 20193,179
DeepSeek LLM: Scaling Open-Source Language Models with LongtermismDeepSeek LLM, an open-source language model project, develops a large dataset and employs SFT and DPO to achieve performance surpassing LLaMA-2 70B and GPT-3.5 in various benchmarks and open-ended evaluations.DeepSeek · Jan 2024 · Unverified855
LoRA Learns Less and Forgets LessLoRA learns less than full fine-tuning on code and math, but forgets less of what the model already knew.Databricks · May 2024407
About this paper
Authors
Saba Sturua, Isabelle Mohr, Mohammad Kalim Akram and 9 more
arXiv
2409.10173 · PDF
Venue
arXiv.org
Citations
200, 9 influential · Semantic Scholar
Upvotes
35 · Hugging Face
Lab
Jina AI · on Companies · on Acquisitions

Changes

What changed
Influential citationsfirst count: 9Sep 25, 2026
Citationsfirst count: 200Sep 25, 2026
New paperFound by the weekly scan, unverifiedSep 25, 2026

Sources: each lab's own papers and arXiv, with citation and upvote counts from Semantic Scholar and Hugging Face. One-line summaries are for orientation, not a substitute for the paper. Logos via logo.dev; trademarks belong to their owners.

New papers by email

Monday afternoons, only in weeks with new papers from the labs.

Double opt-in. Unsubscribe any time.