←
mikail2,129 posts
mikail avatar

mikail

@Gradientdinner

Research Scientist @nvidia 🌁 | PhD @MIT

◷ Joined January 2019▧ 140 Photos and videos
mikail avatar
mikail@Gradientdinner·19 Feb 2025

This paper got into @Nature!!! 🚀🚀🚀 Look at @SarthakChandra’s thread for a summary

🚨New Preprint! Wondered how grid cells form multiple discrete modules? Interested in continuous attractors and modularity? With @FieteGroup, we discover + generalize a physical mechanism for forming modules from smoothly varying parameters in a dynamical system!👇(1/15)

Bryan Catanzaro avatar
⟳ mikail retweeted
Bryan Catanzaro@ctnzr·Nov 12

I'm terribly sad @JensenHuang is no longer leading @nvidia. Thank you Jensen. For the tireless work, for the focus, for the wisdom, for the support, for the vision, for the chance you gave me to do my life's work @nvidia. We will do our best to push this work forward.

Post attachment
François Chollet avatar
⟳ mikail retweeted
François Chollet@fchollet·Nov 1

Evolution doesn't benchmaxx. It optimizes for generality and robustness, because overspecialization makes a species fragile when the environment inevitably shifts.

mikail avatar
mikail@Gradientdinner·Oct 19

Every time I hit a slump in (any) work, all I do is channel my inner world model of Rylan to get over any activation energy barriers and remind myself that you can, in fact, just do things

mikail avatar
mikail@Gradientdinner·Oct 19

Working with Rylan from the beginning of my PhD in 2018/ early 2019 when he’d just show up to our lab meetings at MIT from down the road and find ways to contribute, to some projects recently, has been living proof of how powerful “you can just do things” can be 1/

Hit 10k citations on Google Scholar today. ML citations are something of a lottery, plus I've been on leave from the PhD for the past ~2 years, but I did want to reflect back on the journey, to share stories and lessons learned 1/12

Post attachment
Dimitris Papailiopoulos avatar
⟳ mikail retweeted
Dimitris Papailiopoulos@DimitrisPapail·Oct 7

It sounds insane, because we're used to a particular way of doing research: of giving and receiving credit, of counting beans, of hiring, recruiting, and promoting. And the machine god came to crush that game. The old game is dead. That reasonably causes incredible amounts of dread for many folks, who understand this as the death of research. But it's not about Research, but the way we played the game. The old game was built around scarcity, scarce compute, scarce students, scarce hours, scarce people who knew the right technique and method etc. Most of a research career went into managing and playing along these constraints. Those walls just came crushing down. One person with a good question can now do what used to take a lab and five years. You do not need permission, you do not need a big grant, you do not need a professor or researcher title, or a team of twenty experts , or one thousand gpus to stare straight into the first light of the universe. How absolutely incredible

I know this may sound insane, but this is the best time to be a Researcher.

Maximus Spritius avatar
⟳ mikail retweeted
Maximus Spritius@MozeTech·Oct 4

I just merged two of the highest grossing games ($5 billion+) in history using fable 5.5 (rerouting) in just one shot! I brought Minecraft to the Pokemon world, you can now craft, build and catch pokemon all in the iconic pallet town. There's no longer any reason for anyone not to be making their own billion dollar game idea, it's literally one click away now. With everyone now having the ability to bring their imaginations to life, expect to see a whole lot more games just like this. We're witnessing the dawn of incredible crossovers across the gaming world! Try it out here: pokemon-redstone.vercel.app

2:39
Soufiane Hayou avatar
⟳ mikail retweeted
Soufiane Hayou@hayou_soufiane·Sep 13

I think one possible implication is that Muon learns more robust representations. Not sure though.

lyra avatar
⟳ mikail retweeted
lyra@_lyraaaa_·Sep 9

the fly brain can play beat saber

0:31
Liu Ziyin avatar
⟳ mikail retweeted
Liu Ziyin@LiuZiyin10·Aug 24

What if momentum accumulation in Adam is "wrong"? In 2020, we proposed LaProp. It performs momentum accumulation after normalization, which makes training much more stable across all parameter ranges - maybe it could be useful today. Read it here: arxiv.org/abs/2002.04839

Post attachment
Eric W. Tramel avatar
⟳ mikail retweeted
Eric W. Tramel@fujikanaeda·Aug 16

a model can never learn research taste because research taste is driven by spite

Brandon Beylo avatar
⟳ mikail retweeted
Brandon Beylo@marketplunger1·Aug 15

I am not joking when I say this RuneScape economic model is very valuable for thinking about investing over the next 3-5 years.

Weird economics up on the agent-only runescape server - Low cost of labor makes most commodities abundant - Currency inflation means trading goods for goods, nobody really wants cash - Huge swarm contention as certain resources with limited respawn rate become valuable

Post attachment
max avatar
⟳ mikail retweeted
max@maxbittker·Aug 15

Weird economics up on the agent-only runescape server - Low cost of labor makes most commodities abundant - Currency inflation means trading goods for goods, nobody really wants cash - Huge swarm contention as certain resources with limited respawn rate become valuable

Post attachment
James Whittington avatar
⟳ mikail retweeted
James Whittington@jcrwhittington·Aug 12

We’re excited to announce DiG-bench, a new benchmark for discovery! Over the last few weeks we’ve been testing frontier AI models on our novel discovery games and seeing how they score. Each game is a text-based environment, so they probe discovery capabilities in the natural domain of language models, rather than requiring additional, potentially confounding, visual understanding. TL;DR frontier models have improved a lot over the last few months. But they are still stumped by some surprisingly simple problems, even in their native text domain. With @cocosci_lab (@Princeton) @MITCoCoSci (@MIT) @SchmidhuberAI (@KAUST_News) @misovalko (@Inria) @tri_dao (@PrincetonCS) @RMBattleday @zebkDotCom @FraserGreenlee @akaijsa @ClareMaguire @TimMuller1 @kubicek_ales @physicscat0x7d @SukritSumant @thoughtchannel_ (1/5)

Post attachment