Papersby GlyphHuggingFace's Transformers: State-of-the-art Natural Language Processing research paper by Hugging Face, 2019
Hugging Face · Architectures · Oct 9, 2019 · 251 citations · 34 upvotes · unverified
What it shows
Transformers library provides state-of-the-art Transformer architectures and pretrained models for natural language processing tasks with a unified API and emphasis on extensibility and robust deployment.
By Thomas Wolf, Lysandre Debut, Victor Sanh and 19 more · arXiv 1910.03771 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Hugging Face
All 10RoboColosseum: Evaluating Physical Intelligence at Scale In-The-WildRoboColosseum is an evaluation framework that tests robot AI models across different environments and physical setups.
Hugging Face50 upvotesRead →What masking geometry works best for EEG foundation models?Spatio-temporal masking strategies for EEG foundation models were systematically compared across MAE and JEPA frameworks, revealing robust performance across configurations and a novel JEPA failure mode, with optimal masking achieving high downstream accuracy at reduced compute.Hugging Face3 upvotesRead →Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social DisseminationA new benchmark for AI-generated video detection reveals that current detectors fail to generalize across realistic crisis-related videos and become less reliable as content spreads socially.Hugging Face1 citations285 upvotesRead →Seeing the Needle in the Haystack: Towards Weakly-Supervised Log Instance Anomaly Localization via Counterfactual PerturbationLogMILP is a weakly supervised framework for log anomaly detection that enables both bag-level detection and instance-level localization using prototype-guided structural modeling with counterfactual perturbation consistency regularization.Hugging Face4 upvotesRead →Qualixar OS: A Universal Operating System for AI Agent OrchestrationQualixar OS enables universal AI agent orchestration through a comprehensive runtime environment supporting diverse LLM providers, agent frameworks, and communication protocols, featuring advanced multi-agent topologies, adaptive routing, and robust validation mechanisms.Hugging Face20 upvotesRead →FineVision: Open Data Is All You NeedFineVision, a large-scale and curated dataset, enhances vision-language models through rigorous data collection, de-duplication, and human oversight, leading to improved performance.Hugging Face53 citations81 upvotesRead →SmolVLM: Redefining small and efficient multimodal modelsSmolVLM, a series of compact multimodal models, achieves high performance with minimal GPU memory usage, making efficient deployment on mobile and edge devices possible.Hugging Face330 citations212 upvotesRead →BLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.Hugging Face3,165 citations41 upvotesRead →
Other architectures papers
TopicAttention Is All You NeedIntroduced the Transformer, the attention-only architecture behind nearly every large language model since.
Google201k citations142 upvotesRead →Mamba: Linear-Time Sequence Modeling with Selective State SpacesA selective state space model that scales linearly with sequence length and matches Transformers on language.
Carnegie Mellon University10.2k citations152 upvotesRead →CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and GenerationCodeT5, a unified encoder-decoder Transformer model, improves code understanding and generation by leveraging semantic information from identifiers and user comments.
Salesforce2,633 citations3 upvotesRead →VGGT: Visual Geometry Grounded TransformerVGGT, a feed-forward neural network, efficiently infers multiple 3D attributes from single or multiple views, outperforming alternatives and enhancing downstream tasks without post-processing.
Meta2,132 citations40 upvotesRead →DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language ModelsThe DeepSeekMoE architecture improves expert specialization in Mixture-of-Experts models by segmenting experts and isolating shared ones, achieving better performance and computational efficiency compared to GShard and other models.
DeepSeek1,268 citations65 upvotesRead →CodeT5+: Open Code Large Language Models for Code Understanding and GenerationCodeT5+, a family of flexible encoder-decoder LLMs initialized with frozen LLMs and trained with a mixture of pretraining objectives, achieves state-of-the-art performance across various code-related tasks.Salesforce836 citations7 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 251, 19 influential · Semantic Scholar
- Upvotes
- 34 · Hugging Face
- Lab
- Hugging Face · on Companies · on Acquisitions · on Releases
Changes
Influential citations fell from 326 to 19.
Citations fell from 4,547 to 251.
A first count of 326 influential citations.
A first count of 4,547 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.