Papersby GlyphAya Dataset: An Open-Access Collection for Multilingual Instruction Tuning research paper by Cohere, 2024
Cohere · Retrieval and data · Feb 9, 2024 · 253 citations · 57 upvotes
What it shows
The initiative builds a human-curated instruction-following dataset spanning 65 languages and creates the largest multilingual collection of instruction-following instances through templating and translating existing datasets across 114 languages, contributing datasets and platforms for participatory research.
By Shivalika Singh, Freddie Vargus, Daniel Dsouza and 30 more · arXiv 2402.06619 · PDF
Hugging Face's summary; not yet checked by hand.
More from Cohere
All 30Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language ReasoningOptimized supervised fine-tuning data composition enables reasoning models to consistently process and respond in diverse non-English languages without requiring reasoning supervision in each target language.
Cohere33 upvotesRead →The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic ReasoningAn open competition on unseen Linguistics Olympiad puzzles, graded by the official jury; small 14B systems beat models twice their size.Cohere1 citationsRead →CALIBER: Calibrating Confidence Before and After Reasoning in Language ModelsTrains reasoning models to state their confidence twice, before thinking and after answering, halving calibration error against the best single-estimate method.Cohere1 citationsRead →AI Exposure Scores: what they measure, what they miss, and what comes nextReviews how widely cited scores of which jobs AI can assist are used in policy, what they miss, and newer measures that address it.CohereRead →The Culture Funnel: You Can't Align What isn't in the DataModern LLM pipelines experience a cultural data funnel where explicit cultural signals diminish during post-training, necessitating shifts in training data approaches for better cultural alignment.Cohere1 citationsRead →Soft-SVeRL: Self-Verified Reinforcement Learning with Soft RewardsTurns each prompt into a checklist scored item by item, giving reinforcement learning partial-credit rewards for tasks that cannot be checked automatically.Cohere1 citationsRead →Agents Explore but Agents Ignore: LLMs Lack Environmental CuriosityLLM-based agents fail to exploit discovered unexpected information despite recognizing it, indicating a lack of environmental curiosity that depends on tools, compute, and training data distribution.Cohere2 citations8 upvotesRead →Tiny Aya: Bridging Scale and Multilingual DepthTiny Aya demonstrates high-quality multilingual capabilities with 3.35 billion parameters through region-aware posttraining and balanced language performance.Cohere18 citations10 upvotesRead →
Other retrieval and data papers
TopicBLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.
Hugging Face3,165 citations41 upvotesRead →From Local to Global: A Graph RAG Approach to Query-Focused SummarizationGraphRAG builds a knowledge graph of a document set so a model can answer questions about the whole collection.
Microsoft2,561 citations7 upvotesRead →DINOv3DINOv3, a self-supervised learning model, achieves superior performance across various vision tasks by scaling datasets and models, addressing dense feature degradation, and enhancing flexibility with post-hoc strategies.
Meta1,932 citations320 upvotesRead →Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and RankingThe Qwen3-VL-Embedding and Qwen3-VL-Reranker models form an end-to-end multimodal search pipeline, leveraging multi-stage training and cross-attention mechanisms to achieve high-precision retrieval across diverse modalities.
Alibaba (Qwen)315 citations59 upvotesRead →DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic DataGenerating extensive Lean 4 proof data from mathematical competition problems improved DeepSeekMath 7B's theorem-proving capabilities over GPT-4 and other methods.
DeepSeek284 citations47 upvotesRead →DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree SearchDeepSeek-Prover-V1.5 improves theorem proving by optimizing training and inference, utilizing reinforcement learning, and proposing RMaxTS for diverse proof paths, achieving state-of-the-art results on miniF2F and ProofNet benchmarks.DeepSeek229 citations64 upvotesRead →
About this paper
- Venue
- Annual Meeting of the Association for Computational Linguistics
- Citations
- 253, 23 influential · Semantic Scholar
- Upvotes
- 57 · Hugging Face
- Lab
- Cohere · on Companies · on Acquisitions · on Releases
Changes
Influential citations rose from 22 to 23.
Citations rose from 247 to 253.
Influential citations rose from 21 to 22.
Citations rose from 238 to 247.
Citations rose from 236 to 238.
Citations rose from 231 to 236.
A first count of 21 influential citations.
A first count of 231 citations.
Added to the list.