WorkflowArena: Benchmarking Executable Workflow Orchestration in LLM-Based Multi-Agent Systems
arXiv cs.CL · 10 Nov 2026, 04:45 AEST
WorkflowArena introduces a benchmark for evaluating workflow orchestration in large language model-based multi-agent systems. It features 145 long-horizon tasks across various professional domains, assessing both deliverable quality and work organization.
Key facts
- Large language model agents are increasingly deployed as multi-agent systems rather than as a standalone model operating within a single context.
- We formalize this capability as workflow orchestration and introduce WorkflowArena, a benchmark of 145 long-horizon tasks spanning 8 professional domains.
- Experiments with nine models show that no single configuration performs best across all domains and that systems exhibit distinct delegation strategies.
- When the executing model is held fixed on a challenging subset of tasks, workflows authored by Claude Opus 5.5 substantially improve weaker executors.
Read aloud
WorkflowArena introduces a benchmark for evaluating workflow orchestration in large language model-based multi-agent systems. It features one hundred forty five long-horizon tasks across various professional domains, assessing both deliverable quality and work organization. Large language model agents are increasingly deployed as multi-agent systems rather than as a standalone model operating within a single context. We formalize this capability as workflow orchestration and introduce WorkflowArena, a benchmark of one hundred forty five long-horizon tasks spanning eight professional domains. Experiments with nine models show that no single configuration performs best across all domains and that systems exhibit distinct delegation strategies. When the executing model is held fixed on a challenging subset of tasks, workflows authored by Claude Opus five point five substantially improve weaker executors.
Sources in this cluster
- WorkflowArena: Benchmarking Executable Workflow Orchestration in LLM-Based Multi-Agent Systems
arXiv cs.CL · 10 Nov 2026, 04:45 AEST