Papersby GlyphArctic-Embed: Scalable, Efficient, and Accurate Text Embedding Models research paper by Snowflake, 2024
Snowflake · Retrieval and data · May 8, 2024 · 84 citations · 2 upvotes
What it shows
Open text embedding models from 22M to 334M parameters that led MTEB retrieval for their size at release.
By Luke Merrick, Danmei Xu, Gaurav Nuti and 1 more · arXiv 2405.05374 · PDF
Summarised by hand from the abstract.
More from Snowflake
All 5Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document CollectionsOn 2,250 questions over 800 PDFs, the best agents match human accuracy but lean on brute-force search rather than planning.
Snowflake3 citations66 upvotesRead →Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement LearningLarge language model agents trained in synthetic environments with code-driven simulations and database-backed state transitions demonstrate superior out-of-distribution generalization compared to traditional benchmark-specific approaches.Snowflake81 citations53 upvotesRead →Language Models Model LanguageThe paper advocates for an empiricist approach to evaluating language models, emphasizing frequency of use over traditional theoretical frameworks.Snowflake26 upvotesRead →SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model TransformationSwiftKV lets prompt tokens skip later layers and merges KV caches, cutting prefill cost for long-prompt workloads.Snowflake21 citations2 upvotesRead →
Other retrieval and data papers
TopicBLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.
Hugging Face3,165 citations41 upvotesRead →From Local to Global: A Graph RAG Approach to Query-Focused SummarizationGraphRAG builds a knowledge graph of a document set so a model can answer questions about the whole collection.
Microsoft2,561 citations7 upvotesRead →DINOv3DINOv3, a self-supervised learning model, achieves superior performance across various vision tasks by scaling datasets and models, addressing dense feature degradation, and enhancing flexibility with post-hoc strategies.
Meta1,932 citations320 upvotesRead →Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and RankingThe Qwen3-VL-Embedding and Qwen3-VL-Reranker models form an end-to-end multimodal search pipeline, leveraging multi-stage training and cross-attention mechanisms to achieve high-precision retrieval across diverse modalities.
Alibaba (Qwen)315 citations59 upvotesRead →DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic DataGenerating extensive Lean 4 proof data from mathematical competition problems improved DeepSeekMath 7B's theorem-proving capabilities over GPT-4 and other methods.
DeepSeek284 citations47 upvotesRead →Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningThe initiative builds a human-curated instruction-following dataset spanning 65 languages and creates the largest multilingual collection of instruction-following instances through templating and translating existing datasets across 114 languages, contributing datasets and platforms for participatory research.
Cohere253 citations57 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 84, 9 influential · Semantic Scholar
- Upvotes
- 2 · Hugging Face
- Lab
- Snowflake · on Companies · on Acquisitions · on Quarterly · on Paydays · on Releases · on TechConf
Changes
Citations rose from 81 to 84.
Citations rose from 80 to 81.
Added to the list.