←
boundary bench3 posts
boundary bench avatar

boundary bench

@boundarybench

boundarybench.com/

◷ Joined August 2026▧ 1 Photos and videos
boundary bench avatar
boundary bench@boundarybench·Aug 5

Benchmarks run agents without limits. Companies don’t. Boundary Bench runs coding agents under real world security restrictions, then measures what changes in success, cost, and behavior when the usual path is blocked. Meet Boundary Bench: boundarybench.com

2:50
Or Hiltch avatar
⟳ boundary bench retweeted
Or Hiltch@_orcaman·Aug 5

Today we are open-sourcing @boundarybench, a new paper, benchmark, and GitHub repo that enterprises can use to find out the REAL performance of their agents. Boundary-Bench was developed by researchers from @Accomplish_ai and NYU, where we tested 12 frontier agents across roughly 10,000 runs, with realistic enterprise policies, simulating environments with EDR, SASE, and DLP security tools enforcing those policies. We did this because generic leaderboard scores are being generated under conditions no security team would ever allow, which means orgs are making deployment and risk decisions based on numbers that don't hold up. The results are surprising >>

0:37