←
Dev Leibowitz8 posts
Dev Leibowitz avatar✓

Dev Leibowitz ✓

@devleibowitz

AI Engineer @ Novee Security

◷ Joined September 2015▧ 1 Photos and videos
Dev Leibowitz avatar
Dev Leibowitz@devleibowitz·Nov 15

How do you prevent a pentesting agent from leaking data, bombarding third parties, or destroying all accounts it needs to complete the assessment? Read about it in my first blog post @ Novee!👇

Post attachment
Novee Security avatar
⟳ Dev Leibowitz retweeted
Novee Security@novee_security·Nov 15

Dangerbench: we ran our pentesting agent on live apps across 5 frontier models, with and without our layered guardrails. Safety violations: 85 → 0 Verified findings: 169 → 175 The safety-vs-capability tradeoff didn’t show up. Full method and chart: novee.security/blog/safety-i…

Post attachment
Novee Security avatar
⟳ Dev Leibowitz retweeted
Novee Security@novee_security·Nov 11

Most AI benchmarks score bounded, static tasks. That doesn’t match up with offensive security ops. We should be asking, can the model break into a live system it’s never seen and prove what’s exploitable? We built a benchmark that measures it the right way: PWNBench.

Post attachment