←
doubleAI63 posts
doubleAI avatar

doubleAI

@doubleAI

The frontier AI lab for the hardest problems in science and engineering

◷ Joined March 2026▧ 31 Photos and videos
doubleAI avatar
doubleAI@doubleAI·Nov 6

1/ What if an LLM could not just edit a model's weights, but re-architect it as it trains? We tried just that. The resulting architectures exit the known territory of transformers: the coding agents spliced code directly into the network. On nanochat, the loss fell below ordinary training after each new code layer was introduced. On algorithmic reasoning, accuracy rose from 55% to 84%. We even let DeepSeek-V4.1-Flash act as the agent modifying itself, raising its AIME and HMMT 2026 score from 64% to 71%. To do all this, the agents built a set of tools we’ve never seen before, which we call mechanistic intervention! Blog: doubleai.s.gy/llm-redesign

Post attachment
doubleAI avatar
doubleAI@doubleAI·Nov 11

2/ We measured the engine on @SemiAnalysis_ AgentX. Maxwell's engine handles all loads. As traffic changes, it switches strategy, swaps kernels and reschedules requests, all without downtime while serving. That's a step change. The published vLLM and SGLang results are tuned one load at a time, so each point on their curves is its own configuration. Maxwell's whole curve is one running engine.

0:07
doubleAI avatar
doubleAI@doubleAI·Nov 11

1/ We set Maxwell to optimize DeepSeek-V4.1-Flash serving on B200s. Maxwell’s engine outputs 3x more tokens per GPU than vLLM at the same speed per user, or serves 2x speed per user for typical loads. It beats every published B200 setup, and is even faster than all comparable GB300 results. Blog: doubleai.s.gy/gb300

0:06
0:06
doubleAI avatar
doubleAI@doubleAI·Nov 6

5/ We are even seeing signs of open-weight models being able to perform these changes on themselves. We asked DeepSeek-V4.1-Flash to make itself better at competition maths. It analysed its activations and found where its own hidden states signal a wrong answer on these tasks. It then wrote a code layer that helped boost its performance on AIME 2026 and HMMT 2026 by predicting such failures before committing to an answer.

Post attachment
doubleAI avatar
doubleAI@doubleAI·Nov 6

4/ A forward pass of a neural network is known to produce ‘jagged’ results on algorithmic tasks. We let an agent train a network on CLRS-Text, a benchmark of such classical tasks, with the goal of fixing this. The agent injected code snippets into the architecture during training. The resulting hybrid generalised nearly perfectly. The overall accuracy improved from 55% to 84%, and on unseen input sizes from 33% to 79%.

doubleAI avatar
doubleAI@doubleAI·Nov 6

3/ The timing of architecture changes mattered. The agent planted new code layers at the start of training instead, and recall dropped from 72% to 55%. This points towards a different way of training: just as a network's weights evolve over training, so should its code and architecture. Agents must decide to introduce code exactly when the network is ready for it.

Post attachment
doubleAI avatar
doubleAI@doubleAI·Nov 6

2/ How does the agent plant code into the live network? In the nanochat experiment the agent used a technique it discovered called `phantom gradients`. It uses these gradients to find demand in the network that is unmet by SGD, and to rank candidate code layers. It then integrates them into the network behind a zero-initialized gate, and lets SGD take it from there.

doubleAI avatar
doubleAI@doubleAI·Oct 20

1/ Together with @ltx_io, we used Maxwell, our Code Execution Model, to make video generation in LTX-2.5 1.87x faster. With Maxwell, generating a five-second 4K clip on 2xB200s went from 250 seconds to only 134. No quantization or loss of quality at all. The code is open source.

0:14
doubleAI avatar
doubleAI@doubleAI·Oct 19

What if code could think while it runs? Meet Maxwell: the world’s first Code Execution Model. A new species of AI that lives inside the machine. We believe it’s the key to unlocking 100% of compute. Requests for early access are open, link below.

1:41
doubleAI avatar
doubleAI@doubleAI·Oct 13

4/ Brute-force search is hopeless here. Double Agent first proved structural facts about the geometry of checks on a chessboard, formalized them in Lean, and reduced the rest to SAT. Result: no such sequence can exceed 364 checks, with every proof machine-verified. The exact maximum remains open. Code and proofs: doubleai.s.gy/chess

doubleAI avatar
doubleAI@doubleAI·Oct 13

3/ Harder question: what if both players keep answering check with check? The longest known sequence is 54 consecutive checks, in a composed position by Alexey Khanyan (2013).

0:16
doubleAI avatar
doubleAI@doubleAI·Oct 13

2/ The answer: 63. Every one of them gives check to Black’s king. That beats Norbert Ringeltaube’s record of 60, and Double Agent proved that 63 is the maximum possible. The position can be reached in a legal game.

Post attachment