Datasets: A Community Library for Natural Language Processing research paper by Hugging Face, 2021
Hugging Face · Foundation models · Sep 7, 2021 · 828 citations · 16 upvotes · unverified
What it shows
Datasets is a community library for NLP that standardizes interfaces, versioning, and documentation for over 650 datasets with contributions from more than 250 individuals.
By Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite and 29 more · arXiv 2109.02846 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Hugging Face
All 10RoboColosseum: Evaluating Physical Intelligence at Scale In-The-WildRoboColosseum is an evaluation framework that tests robot AI models across different environments and physical setups.
Hugging Face50 upvotesRead →What masking geometry works best for EEG foundation models?Spatio-temporal masking strategies for EEG foundation models were systematically compared across MAE and JEPA frameworks, revealing robust performance across configurations and a novel JEPA failure mode, with optimal masking achieving high downstream accuracy at reduced compute.
Hugging Face3 upvotesRead →Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social DisseminationA new benchmark for AI-generated video detection reveals that current detectors fail to generalize across realistic crisis-related videos and become less reliable as content spreads socially.
Hugging Face1 citations285 upvotesRead →Seeing the Needle in the Haystack: Towards Weakly-Supervised Log Instance Anomaly Localization via Counterfactual PerturbationLogMILP is a weakly supervised framework for log anomaly detection that enables both bag-level detection and instance-level localization using prototype-guided structural modeling with counterfactual perturbation consistency regularization.
Hugging Face4 upvotesRead →Qualixar OS: A Universal Operating System for AI Agent OrchestrationQualixar OS enables universal AI agent orchestration through a comprehensive runtime environment supporting diverse LLM providers, agent frameworks, and communication protocols, featuring advanced multi-agent topologies, adaptive routing, and robust validation mechanisms.
Hugging Face20 upvotesRead →FineVision: Open Data Is All You NeedFineVision, a large-scale and curated dataset, enhances vision-language models through rigorous data collection, de-duplication, and human oversight, leading to improved performance.
Hugging Face53 citations81 upvotesRead →SmolVLM: Redefining small and efficient multimodal modelsSmolVLM, a series of compact multimodal models, achieves high performance with minimal GPU memory usage, making efficient deployment on mobile and edge devices possible.
Hugging Face330 citations212 upvotesRead →BLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.
Hugging Face3,165 citations41 upvotesRead →
Other foundation models papers
TopicBERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.
Google125k citations33 upvotesRead →Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.
OpenAI66.4k citations21 upvotesRead →GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.
OpenAI28.4k citations7 upvotesRead →LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.
Meta22.6k citations25 upvotesRead →The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.
Meta20.8k citations119 upvotesRead →Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.
Alibaba (Qwen)10.1k citations339 upvotesRead →
About this paper
- Venue
- Conference on Empirical Methods in Natural Language Processing
- Citations
- 828, 50 influential · Semantic Scholar
- Upvotes
- 16 · Hugging Face
- Lab
- Hugging Face · on Companies · on Acquisitions · on Releases
Changes
Citations rose from 821 to 828.
A first count of 50 influential citations.
A first count of 821 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.