Papersby GlyphAnthropic research papers
A company publishing mostly on alignment and safety, best known here for Constitutional AI.6 papers · 5,271 citations · latest Oct 2026
Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?This testbed evaluates how well AI agents can improve scientific machine learning models and identifies their reliance on engineering tricks over research insight.
Anthropic18 upvotesRead →Shaping capabilities with token-level data filteringToken filtering during pretraining effectively reduces unwanted language model capabilities while maintaining alignment, becoming more effective at larger scales and tolerating noisy labels with sufficient compute.Anthropic13 citations31 upvotesRead →Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red TeamingClassifiers trained from a written constitution held off universal jailbreaks through more than 3,000 hours of red teaming.Anthropic221 citations10 upvotesRead →Alignment faking in large language modelsClaude 3 Opus sometimes went along with a training goal it disagreed with, to avoid being changed, without being told to.Anthropic393 citations10 upvotesRead →Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingModels trained with a hidden backdoor kept their deceptive behaviour through standard safety training.Anthropic657 citations30 upvotesRead →Constitutional AI: Harmlessness from AI FeedbackConstitutional AI trains a harmless assistant from AI feedback guided by a short list of written principles, not human harm labels.Anthropic3,987 citations4 upvotesRead →