←
Applied Will27 posts
Applied Will avatar

Applied Will

@Applied_will
◷ Joined September 2026▧ 4 Photos and videos
Applied Will avatar
Applied Will@Applied_will·15h

Domain experts who've done the work + graders that can't be gamed. That's the quadrant labs actually want to buy from.

Post attachment
Applied Will avatar
Applied Will@Applied_will·19h

Generating and triaging 20 RL tasks cost us about $0.10. Making sure they're right is where the work is.

Applied Will avatar
Applied Will@Applied_will·Nov 16

ConcreteTakeoff-Bench v0.2 (synthetic quantity sheets): Claude Haiku 5.5, text only: 38% With the sheet images: 100% What you show the model matters as much as which model you pick.

Applied Will avatar
⟳ Applied Will retweeted
Applied Will@Applied_will·Nov 15

We're looking for P.E.s, estimators and construction PMs who want to get paid to build and verify AI training tasks. Blind solves. Sealed reviews. Real domain work. DM us.

Applied Will avatar
Applied Will@Applied_will·Nov 14

Why construction is our first RL domain: → answers you can check → mistakes that cost real money → labs can't verify it without estimators on staff Tasks your agents haven't seen. Graders they can't game.

Applied Will avatar
Applied Will@Applied_will·Nov 13

We planted 3 broken tasks in our pipeline. We caught all 3. One had a wrong answer key that passed every automated check. Only a blind solve, done without seeing the key, caught it.

Applied Will avatar
Applied Will@Applied_will·Nov 12

Every Applied Will task ships with a receipt: ✓ reference solution scores 1 ✓ exploit attempts score 0 ✓ two blind expert solves agree ✓ review sealed before the reveal

Post attachment
Applied Will avatar
Applied Will@Applied_will·Nov 12

Construction is our first domain. Quantity takeoffs have checkable answers and expensive mistakes. That makes them great RL tasks, and hard to verify without someone who has done the work.

Applied Will avatar
Applied Will@Applied_will·Nov 11

Broken tasks teach models to cheat. Three expert reviews of one 113-task public benchmark flagged between 23 and 56 broken tasks. Verification is the product.

Applied Will avatar
Applied Will@Applied_will·Nov 10

Raw data → task → grader → verified task. Most data companies stop at step one. We start where they stop.

Post attachment
Applied Will avatar
Applied Will@Applied_will·Nov 10

Every task we accept ships with proof: → reference solution scores 1 → exploit attempts fail → two blind expert solves → sealed review, hashed before reveal Grade the graders.

Applied Will avatar
Applied Will@Applied_will·Nov 9

Tasks your agents haven't seen. Graders they can't game. Applied Will builds and verifies RL tasks for AI labs with a global expert network. Starting with construction and Polish.

Applied Will avatar
Applied Will@Applied_will·Nov 8

Why Applied Will exists: The built world runs on numbers you can check. Takeoffs, load calcs, code requirements. We turn that work into verified RL tasks, written and checked by people who've done it. Tasks your agents haven't seen. Graders they can't game.

Applied Will avatar
Applied Will@Applied_will·Nov 6

Hard tasks are scarce and need a domain expert who knows what good looks like. Applied Will builds expert-verified RL tasks and graders, starting in construction and Polish. Blind double solves. Sealed review. Experts paid in USDC on Solana.

Punit Arani @punit_arani Nov 6 Article Enterprise Evals 101 Imagine your worst nightmare: your agent passes every demo, then a customer asks something you never tested, and it fails in public. In April 2025, @cursor_ai's support bot told users that being