←
Lukas Muttenthaler1,175 posts
Lukas Muttenthaler avatar

Lukas Muttenthaler

@lukas_mut

Senior ML Researcher @AIgnostics & @ExplainableML | ex-@GoogleDeepMind | PhD in ML from @TUBerlin @bifoldberlin @MPI_CBS | Representations in 🧠 & 🤖| #FirstGen

◷ Joined May 2019▧ 49 Photos and videos
Lukas Muttenthaler avatar
Lukas Muttenthaler@lukas_mut·12 Nov 2025

🥳I am incredibly humbled and grateful to share that our work, "Aligning machine and human visual representations across abstraction levels," has been published today in @Nature: nature.com/articles/s41586-0… For more information see @AndrewLampinen’s post below ⬇️

What aspects of human knowledge do vision models like CLIP fail to capture, and how can we improve them? We suggest models miss key global organization; aligning them makes them more robust. Check out @lukas_mut's work, finally out (in @Nature!?) + our new blogpost! 1/4

Post attachment
Jeffrey Wang avatar
⟳ Lukas Muttenthaler retweeted
Jeffrey Wang@jeffreygwang·Nov 11

(9/10) We find that CoT controllability can be distilled: training on rollouts from a more controllable teacher results in a more controllable student!

Vincent Sitzmann avatar
⟳ Lukas Muttenthaler retweeted
Vincent Sitzmann@vincesitzmann·Oct 21

Excited to introduce reactive optimizers: We let an agent reactively adapt the optimizer code during the training run! The agent acts like a team of scientists constantly choosing the best algorithm, learning rate, momentum, etc, based on its own analysis of step-to-step training dynamics! The results are really exciting. Besides out-performing standard "best-practice" recipes across everything we threw at it, the agent gains a few "superpowers" that no human could have designed into the optimizer... (1/n)

1/9 Current optimizers are static during training. What if the optimizer could think and react while the network trains? We let an agent watch the training dynamics and rewrite the optimizer's source code as training goes: a reactive optimizer. In every language and image setting we tried that has no tuned recipe, it matches or beats the best recipe one can one-shot, and it guards against loss spikes and overfitting by itself. In the near future, optimization decisions may belong to agents, not humans. 📝 xingjianbai.com/reactive-opt… 💻 Try it on your task: github.com/xingjian-bai/opal 🧵

0:25
Geoffrey Irving avatar
⟳ Lukas Muttenthaler retweeted
Geoffrey Irving@geoffreyirving·Oct 22

I think we should stop AI progress now, first unilaterally by key AI companies and then scaling up to more US companies and then China via international agreements. The reason for now is not that current AI models are the ones that could kill everyone, but because the coordinate steps take time. Immediate action means we have more time for the second steps. When I tell this story to AI company folk, the typical response is "Yes pausing is good, but we should wait until the last minute when the very next model will be dangerous, and stop then." What I realized recently is that this is being implicitly way more optimistic about government speed than I am (and I joined the UK government and was happy there for 2.5 years). They are imagining a world where, the moment the danger is imminent, a bunch of international coordination can happen on a dime. Which is entirely inconsistent with their actual views about government! I'm the one that is more optimistic about government; why am I the one advocating for more time cushion to let the government story play out?

Aidan Clark avatar
⟳ Lukas Muttenthaler retweeted
Aidan Clark@_aidan_clark_·Oct 21

Elon is a genius at the intersection of innovation and organization but he’s also a terrible human being who consistently is willing to do evil things to punish those who oppose him and I’m disappointed in anyone who lets the former justify spending labor to empower the latter.

Jacob Prince avatar
⟳ Lukas Muttenthaler retweeted
Jacob Prince@_jacobprince_·Oct 9

Leading AI models appeared to predict brain activity equally well… …until we asked them to synthesize images that precisely control neural firing, like these 👇 Across 25 neural sites, closed-loop experiments revealed striking hidden differences in model-brain alignment. 🧵

Lukas Muttenthaler avatar
Lukas Muttenthaler@lukas_mut·Oct 10

I really really hope that my friends in big tech don’t start calling artificial intelligence super intelligence because Trump wants them to

Cas (Stephen Casper) avatar
⟳ Lukas Muttenthaler retweeted
Cas (Stephen Casper)@StephenLCasper·Sep 30

It seems like a hard time to be an undergrad concerned with making AI go better. I have talked with a lot of undergrads at several university AI safety clubs in the past month. Consistently across universities, there is a general shared sense of undergraduate dread about next-gen AI coming soon and what it means for their careers. Lots of them are wondering if agents are too good at research, timelines are too short, or if power in AI is too concentrated for them to have any impact. Some of them are wondering if the appropriate reaction is to go apply to Anthropic, indulge in accelerationism, and/or start smoking. Lots of my conversations with them gravitate toward talking about how AI will be (and ought to be) a never-ending institutional challenge and that, yes, they will have a chance to matter and for their life and work to mean something. I guess that's what my version of hope for the future looks like lately.

Dario Amodei avatar
⟳ Lukas Muttenthaler retweeted
Dario Amodei@DarioAmodei·Sep 12

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…

Jacob Coxon avatar
⟳ Lukas Muttenthaler retweeted
Jacob Coxon@hilbertspaess·Sep 9

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.

Lukas Muttenthaler avatar
Lukas Muttenthaler@lukas_mut·Jul 22

🔮At #ICML2026 we presented Attentive Multi-Layer Fusion for Vision Transformers, an efficient method for fusing information from multiple layers of ViTs for downstream task predictions. It’s almost as performant as fine-tuning but only an inch more expensive than linear probing!

2/ Wed, Jul 8, 2026 • 10:30 AM – 12:15 PM KST · HALL A #2711 · POSTER Attentive Multi-Layer Fusion for Vision Transformers @lciernik, Marco Morik, @lukas_thede, @LucaEyring, Shinichi Nakajima, @zeynepakata, @lukas_mut Paper: arxiv.org/abs/2601.09322 Code: github.com/lciernik/attentiv…

Explainable Machine Learning avatar
⟳ Lukas Muttenthaler retweeted
Explainable Machine Learning@ExplainableML·Jul 3

2/ Wed, Jul 8, 2026 • 10:30 AM – 12:15 PM KST · HALL A #2711 · POSTER Attentive Multi-Layer Fusion for Vision Transformers @lciernik, Marco Morik, @lukas_thede, @LucaEyring, Shinichi Nakajima, @zeynepakata, @lukas_mut Paper: arxiv.org/abs/2601.09322 Code: github.com/lciernik/attentiv…

Marcel Binz avatar
⟳ Lukas Muttenthaler retweeted
Marcel Binz@marcel_binz·Jun 9

Excited to announce that I'll be starting my own lab in Tübingen this October! Hiring at all levels: Postdoc, PhD & RA. Want to work on computational cognitive science at scale? Apply: core-cognition.github.io/ Reposts and shares much appreciated 🙏

Post attachment
Andrew Lampinen avatar
⟳ Lukas Muttenthaler retweeted
Andrew Lampinen@AndrewLampinen·Jun 1

Really glad to see this work out (and honored to be included on it) — I think it does a great job of concretizing some of the intuitions I've had about effects of scaling! Check out the thread for a great summary

We take for granted that larger models are better than smaller ones, but why is this so? Our new paper, led by Jing Huang and @EkdeepL, traces this to a data-induced competition for resources (neurons), using formal analysis, idealized tasks, and real pretraining.

Post attachment
Badr AlKhamissi avatar
⟳ Lukas Muttenthaler retweeted
Badr AlKhamissi@bkhmsi·Apr 27

Good morning #ICLR2026 ☀️ The Re-Align workshop kicks off in 30 minutes! A full day on what we can actually do with representational alignment, from brains to language models to agents. Schedule in the thread 👇

Post attachment