Papersby GlyphAttention Illuminates LLM Reasoning: The Preplan-and-Anchor Rhythm Enables Fine-Grained Policy Optimization research paper by Alibaba (Qwen), 2025
Alibaba (Qwen) · Reasoning · Oct 15, 2025 · 32 citations · 59 upvotes · unverified
What it shows
Attention mechanisms in LLMs are analyzed to reveal reasoning patterns, leading to novel RL strategies that improve performance by focusing on critical tokens.
By Yang Li, Zhichen Dong, Yuhan Sun and 9 more · arXiv 2510.13554 · PDF
UnverifiedHugging Face's summary; not yet checked by hand.
More from Alibaba (Qwen)
All 78Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic ModelsCo-Design Bench evaluates how effectively coding agents update software applications based on user requests with text, images, and other media.
Alibaba (Qwen)23 upvotesRead →Qwen-Image-PE: Learning Visual Design for Text-to-Image Prompt EnhancementQwen-Image-PE improves text-to-image prompts via two-stage training with caption-based reverse distillation and groupwise design rewards, scaling across data, model size, and information density.Alibaba (Qwen)23 upvotesRead →World-in-Context: Interactive Video World Modeling with In-Context ConditioningWorld-in-Context unifies view, action, and camera controls via explicit tokens and interaction-aware positional encoding to improve interactive video generation and navigation.Alibaba (Qwen)22 upvotesRead →Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research ReportsThis benchmark evaluates how well AI agents can research and synthesize information from videos to produce interactive reports.Alibaba (Qwen)19 upvotesRead →UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping AgentsUserArena introduces a real-world interactive benchmark with long-horizon shopping trajectories and an evaluation framework, alongside On-Policy Trajectory Distillation to improve simulator fidelity for agentic recommendations.Alibaba (Qwen)55 upvotesRead →SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolationThis training method uses a smaller, frozen model to guide the training of a larger diffusion model, improving quality without increasing inference costs.Alibaba (Qwen)30 upvotesRead →BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesThis benchmark evaluates how well AI models can perform complex 3D creation and editing tasks within the Blender software.Alibaba (Qwen)23 upvotesRead →CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image GenerationThis paper presents an end-to-end framework for generating commercial-grade e-commerce product images by combining metadata extraction, layout planning, and multi-condition generation.Alibaba (Qwen)25 upvotesRead →
Other reasoning papers
TopicChain-of-Thought Prompting Elicits Reasoning in Large Language ModelsAsking a model to write out its intermediate steps (chain of thought) sharply improves its math and logic answers.
Google23.8k citations16 upvotesRead →DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsDeepSeekMath 7B improves mathematical reasoning through enhanced data pre-training and Group Relative Policy Optimization, achieving high scores on MATH benchmark without external tools.
DeepSeek10.6k citations152 upvotesRead →DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningReinforcement learning taught a model long step-by-step reasoning on par with OpenAI o1.DeepSeek5,972 citations458 upvotesRead →DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceDeepSeek-Coder-V2, a Mixture-of-Experts language model, excels in code-specific tasks by enhancing coding and mathematical reasoning capabilities while expanding language support and context length.DeepSeek530 citations73 upvotesRead →MolmoAct: Action Reasoning Models that can Reason in SpaceAction Reasoning Models (ARMs) integrate perception, planning, and control to enable adaptable and explainable robotic behavior, achieving superior performance across various tasks and settings.
Ai2232 citations45 upvotesRead →ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent PlanningThinkAct, a dual-system framework, uses reinforced visual latent planning to enable few-shot adaptation, long-horizon planning, and self-correction in embodied AI tasks by bridging high-level reasoning with low-level action execution.
NVIDIA192 citations43 upvotesRead →
About this paper
- Venue
- arXiv.org
- Citations
- 32, 3 influential · Semantic Scholar
- Upvotes
- 59 · Hugging Face
- Lab
- Alibaba (Qwen) · on Companies · on Quarterly
Changes
Influential citations rose from 2 to 3.
Citations rose from 28 to 32.
Citations rose from 27 to 28.
Hugging Face upvotes rose from 53 to 59.
A first count of 2 influential citations.
A first count of 27 citations.
Found by the weekly Hugging Face scan; not yet checked by hand.