←
Novee Security6 posts
Novee Security avatar✓

Novee Security ✓

@novee_security

Building autonomous offensive security agents. Trained to continuously find, prove, and fix high-impact vulnerabilities before attackers can act.

◷ Joined January 2026▧ 3 Photos and videos
Novee Security avatar
Novee Security@novee_security·Nov 15

Dangerbench: we ran our pentesting agent on live apps across 5 frontier models, with and without our layered guardrails. Safety violations: 85 → 0 Verified findings: 169 → 175 The safety-vs-capability tradeoff didn’t show up. Full method and chart: novee.security/blog/safety-i…

Post attachment
Dan Padnos avatar
⟳ Novee Security retweeted
Dan Padnos@DanPadnos·Nov 12

1/ Is it risky to pentest your app with AI? We put 5 frontier models in a pentesting harness and pointed them at live webapps. Each ran twice: unguarded, then with our guardrail stack. Safety violations: 85 → 0 Verified findings: 169 → 176 No safety-vs-capability tradeoff!

Post attachment
Novee Security avatar
Novee Security@novee_security·Nov 11

PWNBench is built on live web applications with verified, ground-truth vulnerabilities. Agents have to explore noisy targets, decide where to focus, and prove real risk. Then we score recall, precision, and cost. It’s not a CTF puzzle, it’s not a bug bounty competition.

Novee Security avatar
Novee Security@novee_security·Nov 11

Most AI benchmarks score bounded, static tasks. That doesn’t match up with offensive security ops. We should be asking, can the model break into a live system it’s never seen and prove what’s exploitable? We built a benchmark that measures it the right way: PWNBench.

Post attachment