Papersby GlyphIBM research papers
A company publishing mostly on agents and evaluation, best known here for TOUCAN.5 papers · 105 citations · latest Oct 2026
Retrieval Augmented Generation CompositionalityThis study shows that individual RAG techniques do not always work well together and provides a framework to evaluate full retrieval pipelines.
IBM34 upvotesRead →Asking for What Was Never Requested: Horizontal and Vertical Proactivity in AgentsQ&D trains agents to proactively ask for information that is necessary for task completion but not explicitly requested by the user.IBM41 upvotesRead →Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM AgentsAggregate-score leaderboards in agent benchmarks fail to capture deployment-relevant dimensions and show rank instability, necessitating new evaluation frameworks based on predictive validity and out-of-distribution criteria.IBM2 citations42 upvotesRead →From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM AgentsLLM-based systems use executable workflows that interleave various computational components, with recent approaches organized by workflow structure determination timing and optimization dimensions.IBM34 citations57 upvotesRead →TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP EnvironmentsToucan, a large publicly available tool-agentic dataset, enhances the performance of LLM agents by providing diverse, realistic, and complex multi-tool and multi-turn interactions.IBM69 citations29 upvotesRead →