
Evaluating tool-use capabilities is expensive and domain-dependent. Once existing test data become saturated, expert humans need to design new tasks. Alternatively, LLMs can auto-generate challenging tasks from existing toolsets and task primitives through evolutionary search using multiple agents. With @MichaelD1729, @natashajaques, @minsuk_chang. Paper: arxiv.org/abs/2610.27307 for how to auto-generate tasks from existing benchmarks and use them for failure diagnosis















