Papersby GlyphWhat masking geometry works best for EEG foundation models? research paper by Hugging Face, 2026
Hugging Face · Training and scaling · Sep 27, 2026 · 0 citations · 3 upvotes · unverified
What it shows
Spatio-temporal masking strategies for EEG foundation models were systematically compared across MAE and JEPA frameworks, revealing robust performance across configurations and a novel JEPA failure mode, with optimal masking achieving high downstream accuracy at reduced compute.
By Pierre Guetschel, Bruno Aristimunha, Yassine El Ouahidi and 3 more · arXiv 2609.33487 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Hugging Face
All 10RoboColosseum: Evaluating Physical Intelligence at Scale In-The-WildRoboColosseum is an evaluation framework that tests robot AI models across different environments and physical setups.
Hugging Face50 upvotesRead →Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social DisseminationA new benchmark for AI-generated video detection reveals that current detectors fail to generalize across realistic crisis-related videos and become less reliable as content spreads socially.Hugging Face1 citations285 upvotesRead →Seeing the Needle in the Haystack: Towards Weakly-Supervised Log Instance Anomaly Localization via Counterfactual PerturbationLogMILP is a weakly supervised framework for log anomaly detection that enables both bag-level detection and instance-level localization using prototype-guided structural modeling with counterfactual perturbation consistency regularization.Hugging Face4 upvotesRead →Qualixar OS: A Universal Operating System for AI Agent OrchestrationQualixar OS enables universal AI agent orchestration through a comprehensive runtime environment supporting diverse LLM providers, agent frameworks, and communication protocols, featuring advanced multi-agent topologies, adaptive routing, and robust validation mechanisms.Hugging Face20 upvotesRead →FineVision: Open Data Is All You NeedFineVision, a large-scale and curated dataset, enhances vision-language models through rigorous data collection, de-duplication, and human oversight, leading to improved performance.Hugging Face53 citations81 upvotesRead →SmolVLM: Redefining small and efficient multimodal modelsSmolVLM, a series of compact multimodal models, achieves high performance with minimal GPU memory usage, making efficient deployment on mobile and edge devices possible.Hugging Face330 citations212 upvotesRead →BLOOM: A 176B-Parameter Open-Access Multilingual Language ModelBLOOM, a 176B-parameter open-access language model, achieves competitive performance on various benchmarks and is released publicly with a Responsible AI License.Hugging Face3,165 citations41 upvotesRead →Datasets: A Community Library for Natural Language ProcessingDatasets is a community library for NLP that standardizes interfaces, versioning, and documentation for over 650 datasets with contributions from more than 250 individuals.Hugging Face828 citations16 upvotesRead →
Other training and scaling papers
TopicLoRA: Low-Rank Adaptation of Large Language ModelsLoRA fine-tunes a large model by training small low-rank matrices, cutting trainable parameters by 10,000 times.
Microsoft25.6k citations66 upvotesRead →Scaling Laws for Neural Language ModelsLanguage model loss falls as a smooth power law as model size, data and compute grow.
OpenAI9,592 citations12 upvotesRead →Training Compute-Optimal Large Language ModelsChinchilla: for a fixed compute budget, train a smaller model on more data; parameters and tokens should grow together.
Google DeepMind4,035 citations13 upvotesRead →Megatron-LM: Training Multi-Billion Parameter Language Models Using Model ParallelismMegatron-LM splits each Transformer layer across GPUs to train models with billions of parameters.
NVIDIA3,387 citations5 upvotesRead →DeepSeek LLM: Scaling Open-Source Language Models with LongtermismDeepSeek LLM, an open-source language model project, develops a large dataset and employs SFT and DPO to achieve performance surpassing LLaMA-2 70B and GPT-3.5 in various benchmarks and open-ended evaluations.
DeepSeek872 citations56 upvotesRead →LoRA Learns Less and Forgets LessLoRA learns less than full fine-tuning on code and math, but forgets less of what the model already knew.
Databricks486 citations91 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 0, 0 influential · Semantic Scholar
- Upvotes
- 3 · Hugging Face
- Lab
- Hugging Face · on Companies · on Acquisitions · on Releases
Changes
A first count of 0 influential citations.
A first count of 0 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.