Papersby GlyphEat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RL research paper by Carnegie Mellon University, 2026
Carnegie Mellon University · Foundation models · Oct 24, 2026 · 34 upvotes · unverified
What it shows
FORK jointly optimizes recall and precision via rubric-driven necessity credits and factual grading to improve response quality and reduce verbosity in reinforcement learning.
By Hyun Ryu, Jong-Heon Kim, Yiqing Xie and 3 more · arXiv 2610.33512 · PDF · Code
UnverifiedHugging Face's summary; not yet checked by hand.
More from Carnegie Mellon University
All 11Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRandBestRand is a method for selecting small benchmark subsets that reliably estimate full evaluation scores at lower computational costs.
Carnegie Mellon University51 upvotesRead →Into the Unknown: Benchmarking AI agents on open scientific research problemsThis benchmark evaluates how well AI agents can write follow-up scientific research papers based on unpublished directions from domain experts.Carnegie Mellon University62 upvotesRead →X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray ReasoningThis paper introduces a reinforcement learning framework for medical agents that selectively uses external evidence to improve diagnostic reasoning in chest X-rays.Carnegie Mellon University44 upvotesRead →Selection-Based Structured Reasoning: Toward Efficient Multimodal Search AgentsSSR improves multimodal agent efficiency by replacing free-form reasoning generation with a selection process from pre-specified reasoning candidates.Carnegie Mellon University37 upvotesRead →Predictive Credit: Measuring What Scientific Explanations Add to Experimental ForecastsThis paper introduces a protocol to measure how much scientific explanations actually improve the accuracy of experimental forecasts.Carnegie Mellon University103 upvotesRead →Training Object Permanence in World ModelsThis paper introduces a dataset and training stack to improve object permanence and physical reasoning in video world models.Carnegie Mellon University242 upvotesRead →JEV-as-a-Judge: Accept When Confident, Escalate When UnsureJEV-as-a-Judge is a cost-effective evaluation framework that uses a simple decision-only judge for easy cases and escalates complex ones.Carnegie Mellon University57 citations42 upvotesRead →Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and EvaluationBenchmark Radar is a searchable living database and discovery engine for AI evaluation benchmarks that aggregates sources, score histories, and evidence to support benchmark selection and comparison.Carnegie Mellon University171 upvotesRead →
Other foundation models papers
TopicBERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingPre-training a Transformer to fill in masked words, then fine-tuning it, beat task-specific models across language understanding tests.
Google125k citations33 upvotesRead →Language Models are Few-Shot LearnersGPT-3, a 175B-parameter model, does new tasks from a few examples in the prompt, with no fine-tuning.
OpenAI66.4k citations21 upvotesRead →GPT-4 Technical ReportA multimodal model that passes a simulated bar exam with a score around the top 10% of test takers.OpenAI28.4k citations7 upvotesRead →LLaMA: Open and Efficient Foundation Language ModelsOpen models from 7B to 65B trained only on public data; the 13B model beats GPT-3 on most benchmarks.
Meta22.6k citations25 upvotesRead →The Llama 3 Herd of ModelsOpen models up to 405B parameters that match leading closed models on many tasks.Meta20.8k citations119 upvotesRead →Qwen3 Technical ReportQwen3, a unified series of large language models, integrates thinking and non-thinking modes, reduces computational resources, and achieves state-of-the-art performance across various tasks and languages.
Alibaba (Qwen)10.1k citations339 upvotesRead →
About this paper
- Citations
- Not counted yet · Semantic Scholar
- Upvotes
- 34 · Hugging Face
- Lab
- Carnegie Mellon University
Changes
Hugging Face upvotes fell from 47 to 34.
Found by the weekly Hugging Face scan; not yet checked by hand.