Last Secure Code Benchmark: Is the Code You Vibe Secure? research paper by Alibaba (Qwen), 2026
Alibaba (Qwen) · Alignment and safety · Oct 10, 2026 · 0 citations · 77 upvotes · unverified
What it shows
This paper introduces a benchmark showing that current coding agents frequently produce functional but insecure code, highlighting significant security risks in automated coding.
By Tianyi Wu, Chao Ge, Peng Chen and 12 more · arXiv 2610.14766 · PDF · Code
UnverifiedSummarised by a model from the abstract; not yet checked by hand.
More from Alibaba (Qwen)
All 78Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic ModelsCo-Design Bench evaluates how effectively coding agents update software applications based on user requests with text, images, and other media.
Alibaba (Qwen)23 upvotesRead →Qwen-Image-PE: Learning Visual Design for Text-to-Image Prompt EnhancementQwen-Image-PE improves text-to-image prompts via two-stage training with caption-based reverse distillation and groupwise design rewards, scaling across data, model size, and information density.
Alibaba (Qwen)23 upvotesRead →World-in-Context: Interactive Video World Modeling with In-Context ConditioningWorld-in-Context unifies view, action, and camera controls via explicit tokens and interaction-aware positional encoding to improve interactive video generation and navigation.
Alibaba (Qwen)22 upvotesRead →Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research ReportsThis benchmark evaluates how well AI agents can research and synthesize information from videos to produce interactive reports.
Alibaba (Qwen)19 upvotesRead →UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping AgentsUserArena introduces a real-world interactive benchmark with long-horizon shopping trajectories and an evaluation framework, alongside On-Policy Trajectory Distillation to improve simulator fidelity for agentic recommendations.
Alibaba (Qwen)55 upvotesRead →SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolationThis training method uses a smaller, frozen model to guide the training of a larger diffusion model, improving quality without increasing inference costs.
Alibaba (Qwen)30 upvotesRead →BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World ReferencesThis benchmark evaluates how well AI models can perform complex 3D creation and editing tasks within the Blender software.
Alibaba (Qwen)23 upvotesRead →CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image GenerationThis paper presents an end-to-end framework for generating commercial-grade e-commerce product images by combining metadata extraction, layout planning, and multi-condition generation.
Alibaba (Qwen)25 upvotesRead →
Other alignment and safety papers
TopicTraining language models to follow instructions with human feedbackInstructGPT: fine-tuning on human feedback made a 1.3B model preferred over the 175B GPT-3.
OpenAI25.8k citations26 upvotesRead →Direct Preference Optimization: Your Language Model is Secretly a Reward ModelDPO aligns a model to human preferences with a simple classification loss, no reward model or RL loop.
Stanford University11.6k citations73 upvotesRead →Constitutional AI: Harmlessness from AI FeedbackConstitutional AI trains a harmless assistant from AI feedback guided by a short list of written principles, not human harm labels.
Anthropic3,987 citations4 upvotesRead →Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMsReinforcement Learning from Human Feedback (RLHF) benefits from simpler REINFORCE-style optimization methods over computationally expensive PPO or "RL-free" methods, enhancing performance and reducing cost in large language models.
Cohere804 citations18 upvotesRead →Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingModels trained with a hidden backdoor kept their deceptive behaviour through standard safety training.
Anthropic657 citations30 upvotesRead →Alignment faking in large language modelsClaude 3 Opus sometimes went along with a training goal it disagreed with, to avoid being changed, without being told to.
Anthropic393 citations10 upvotesRead →
About this paper
- Citations
- 0, 0 influential · Semantic Scholar
- Upvotes
- 77 · Hugging Face
- Lab
- Alibaba (Qwen) · on Companies · on Quarterly
Changes
A first count of 0 influential citations.
A first count of 0 citations.
Hugging Face upvotes rose from 75 to 77.
This paper introduces a benchmark showing that current coding agents frequently produce functional but insecure code, highlighting significant security risks in automated coding.
Moved from Agents and evaluation to Alignment and safety.
Found by the weekly Hugging Face scan; not yet checked by hand.