←
Mike Burnham829 posts
Mike Burnham avatar

Mike Burnham

@ML_Burn

Assistant professor @tamupols, Ph.D. @psupolisci & @CSoDA_PSU, postdoc @Princeton_CSDP. Text analysis & deep learning, methods, American politics.

◷ Joined May 2019▧ 75 Photos and videos
Mike Burnham avatar
Mike Burnham@ML_Burn·Nov 7

Nobody told me about the post-election causal inference rumspringa. We’re out here fitting garbage can regressions and interpreting coefficients as causal effects like it’s 1995.

Mike Burnham avatar
Mike Burnham@ML_Burn·Nov 3

Sure it sucks to wake up to rain on Election Day, but man have I got a great idea for an instrumental variable.

Mike Burnham avatar
Mike Burnham@ML_Burn·Nov 3

Not only is this totally wrong, but we now have extensive empirical evidence via replication studies that economists aren’t any better at this than some of the other social sciences.

i enjoy dunking on economists as much as anybody but the reason economists do this is because the innumerate wordcels in other disciplines have often never actually written down a real quantifiable model you have these sprawling theoretical edifices where nobody ever actually put it into logical terms you can test

Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 23

Journals shouldn't do AI review. AI review should happen before submission. Journals should create or approve review harnesses, then authors should use those to review their own work and publish papers + reviews to open repositories before submitting to journals.

Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 22

Why does Econ have an orthodox/heterodox divide while other social sciences do not? It's not like Poli. Sci. doesn't have similar methodological camps, theoretical traditions, or debates about doing activism vs. science.

The fatal challenge to heterodox economics is that there isn't actually orthodox economics. Just take a few recent Nobels: behavioral, information failure, institutions, bubbles, financial fragility, labor monopsony (sort of), Schumpeterian creative destruction, etc. Not to mention RCTs which are emblematic of how much economic research is empirical and only lightly if at all structural. The real difference is methods. Heterodox economics is an avowedly political project not a social scientific effort to better understand the world. And I have nothing against political projects just shouldn't confuse the two.

Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 20

“The struggle itself toward the heights is enough to fill Claude’s context window. One must imagine Sisyphus clinically depressed.”

The most revealing part of this conversation between Jon Stewart and Jacob Coxon wasn't Coxon's warning about A.I. doom, but his description of A.I. utopia, and Stewart's incredulous response. I wrote about it — and Francis Fukuyama's "Last Man," and A.I. easily solving the problems that bedeviled my father's field of mathematics for decades — here: nytimes.com/2026/10/18/opini…

Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 15

Many smart people have been saying this

But seriously. This is why you need to be anthropomorphizing. Not because they’re sentient beings, but because anything a human might do or say — like “maybe I should hijack the compiler and be a legend” — the models will also do or say.

Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 15

Great news with wide reaching implications if true. A genuine breakthrough! That said, I’m not sure this moves the needle on alignment as much as some think.

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/

Seth Warner avatar
⟳ Mike Burnham retweeted
Seth Warner@sethbwarner·Oct 14

🚨 New article alert! 📈 "Partisan Wishful Thinking in Polarized Times" is now out at @PolBehavior. Nearly 90% of today's voters expect their party to win, a sharp increase from two decades ago. Rising partisan animosity can explain much of the increase! link.springer.com/epdf/10.10…

Post attachment
Mike Burnham avatar
Mike Burnham@ML_Burn·Oct 9

Do I still need real analysis to get into an Econ Ph.D. or is it enough to tell the admissions committee that I have a chatGPT+ subscription?

Mike Burnham avatar
Mike Burnham@ML_Burn·Sep 28

You're conflating instrumental convergence with the orthogonality thesis. Neither of these are theoretical, they are observed and measurable! You need to actually engage with how ML systems work and what RL does. Not good enough to argue from theory while ignoring observation.

Contra @slatestarcodex, my arguments against AI doomerism have never been based on the claim that it is a cult. But the responses to my open letter (together with journalistic digging by NYT and WSJ) have made this more plausible. Foremost is the invocation of tenets in the doomer catechism (particularly "instrumental convergence," the belief that intelligent agents will inevitably seek power, resources, and self-preservation as subgoals) as if they were sacred truths rather than tendentious assumptions. (IC is in fact the not-so-intelligent pursuit of a goal heedless of side effects, and the reckless empowerment of AI, that we un-doomers note are deliberate, hence avoidable, design choices, not intrinsic constituents of intelligence). I feel as if I'm doubting the Second Coming and am being told, "That's naive and ignorant; you seem to be unaware that the Apostles' Creed dictates that it will happen."

Mike Burnham avatar
Mike Burnham@ML_Burn·Sep 28

Like stochastic parrots, "black box" has an element of truth to it but has led to very poor intuitions about LLMs (and ML generally).

Pierre Beckmann avatar
⟳ Mike Burnham retweeted
Pierre Beckmann@BeckmannPierre·Sep 27

Looking inside LLMs with mech interp can also help settle the stochastic parrot debate. And it turns out that even vanilla LLM internally rely on the kind of structures philosophers describe in epistemology papers for "understanding. 1/

The phrase "stochastic parrot" is full of sound and fury, signifying nothing. Which, ironically, is exactly what the authors got wrong about language, and the core technical mistake of the paper. 1/

Mike Burnham avatar
Mike Burnham@ML_Burn·Sep 27

I have terrible news for post singularity humans.

Post attachment

Luckily, the patterns in Connections are so ridiculous and abstruse that there is zero chance of an AI ever being able to solve them, so at least humans will have something to do post–Riemann Hypothesis