Skip to content
Papers.

LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations research paper by MongoDB, 2025

MongoDB · Sep 16, 2025 · Retrieval and data 1 year ago

Read on arXiv

What it shows

LEAF, a knowledge distillation framework for text embeddings, enables flexible asymmetric architectures and robustness, achieving state-of-the-art performance in information retrieval and multi-task settings with minimal training requirements.

Hugging Face's summary; not yet checked by hand.

More from MongoDB

All 2
PaperCitations
ORIGAMI: A generative transformer architecture for predictions from semi-structured dataA transformer that learns directly from nested JSON documents, treating prediction as next-token generation, and stays competitive on tabular benchmarks.Architectures · Dec 20241 year ago-

Other retrieval and data papers

Topic
PaperCitations
From Local to Global: A Graph RAG Approach to Query-Focused SummarizationGraphRAG builds a knowledge graph of a document set so a model can answer questions about the whole collection.Microsoft · Apr 20242 years ago2,198
DINOv3DINOv3, a self-supervised learning model, achieves superior performance across various vision tasks by scaling datasets and models, addressing dense feature degradation, and enhancing flexibility with post-hoc strategies.Meta · Aug 2025 · Unverified1 year ago1,498
DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic DataGenerating extensive Lean 4 proof data from mathematical competition problems improved DeepSeekMath 7B's theorem-proving capabilities over GPT-4 and other methods.DeepSeek · May 2024 · Unverified2 years ago260
Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and RankingThe Qwen3-VL-Embedding and Qwen3-VL-Reranker models form an end-to-end multimodal search pipeline, leveraging multi-stage training and cross-attention mechanisms to achieve high-precision retrieval across diverse modalities.Alibaba (Qwen) · Jan 2026 · Unverified8 months ago231
DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree SearchDeepSeek-Prover-V1.5 improves theorem proving by optimizing training and inference, utilizing reinforcement learning, and proposing RMaxTS for diverse proof paths, achieving state-of-the-art results on miniF2F and ProofNet benchmarks.DeepSeek · Aug 2024 · Unverified2 years ago207
Learning to Discover at Test TimeTest-time training enables AI systems to discover optimal solutions for specific scientific problems through continual learning focused on individual challenges rather than generalization.Stanford University · Jan 2026 · Unverified8 months ago82
About this paper
Authors
Robin Vujanic, Thomas Rueckstiess
arXiv
2509.12539 · PDF
Citations
Not counted yet · Semantic Scholar
Upvotes
0 · Hugging Face
Lab
MongoDB · on Companies · on Quarterly · on Paydays · on Releases · on TechConf

Changes

What changed
New paperAdded to the listSep 26, 2026today

New papers by email

Monday afternoons, only in weeks with new papers from the labs.

Double opt-in. Unsubscribe any time.