I gave a keynote at Reverie where I covered the most important topic in building AI systems of today: love ❤️ and how to get that into space.
youtu.be/tj9I3DrzNvQ
For the next presentation If get invited, I will talk about purpose - if anyone wants to hear me yap.
Next guest up in this weekly series is @kanavg1, cofounder of @coreauto on Friday, Nov 20th at noon.
For this session, we'll be chatting about all things RL (methods, synthetic data, loops, automation etc)
Format:
> 60 minute sessions (IRL only) in SF
> For the first 45 mins, I get to ask the guest spicy questions about their expertise
> For the last 15 mins, they get to ask me anything they want to learn about venture
> All off the record, chatham house rules
> Open to 15 guests who listen in and can ask some of their own questions
Register here if you want to join, and subscribe to the Luma for future guests: luma.com/2enjjc82
Core Automation is literally assembling the avengers of optimization theory, John Langford is the core contributor for the Microsoft Dion repository (he also merged a PR of mine once ^-^)
John -> Core Automation coreauto.com/
After Microsoft (hunch.net/?p=13764006), I was attracted to a place which was very willing to try new things and exceptionally enabling in doing so.
It is a subtle topic, but right now I believe it is clear for everyone in the field that main differentiator in developing AI at this specific moment of 2026 is *how* you use AI to develop it
I asked 51 people in AI who has a good read on RSI (recursive self-improvement) and where it's going:
5 votes:
- Jerry Tworek, Core Automation (@MillionInt)
4 votes:
- Jun Park, Hillclimb (@jparkjmc)
3 votes each:
- John Schulman, Thinking Machines (@johnschulman2)
- Rohan Anil, Core Automation (@_arohan_)
- Daniel Chang, ex-Mercor (@dnnssl2)
- Laksh Aithani, Abundance (@LakshAithani)
- Richard Socher, Recursive (@RichardSocher)
2 votes each:
- Andrej Karpathy, Anthropic (@karpathy)
- Behnam Neyshabur, Mirendil (@bneyshabur)
- Han Fang, Meta Superintelligence Labs (@Han_Fang_)
- Herbie Bradley (@herbiebradley)
- Jennifer Zhou, Preference Model (@chem_safety)
- Paul Christiano, Alignment Research Center (@paulfchristiano)
75 people were picked. The other 62 got 1 vote each and are in the next posts.
51 people voted, each picking from people they've met. I didn't vote.
Hi! this is Rohan Anil, I develop training algorithms among other things - my work trains various frontier models.
At CoreAuto, I was fascinated by the problem of training on compute islands, eventually in space training.
I hope you all enjoy this write up!🪐🛰️
coreauto.com/hitchhikers-gui…
This list loses credibility by putting Riley Walz on the same scale as normal cool people.
Everybody else here is awesome, but not at all the same. Its like Forbes 30u30 when they have Elizabeth Holmes and then 29 other people.
They should make his image 2x as bigger and maybe add a rainbow chromatic shader behind him.
Bit more than a decade in training, no pain no train. 💪
@BEBischof nerd sniped me into this talk with offer to have a Cat to give the keynote.
Still Training: A Decade of Learning the Hard Way @ Reverie by LanceDB on Nov 5 in SF 🌉
You get to hear me about distributed training from the trenches:
Hardware codesign, async and sync training -- when we almost decided to put async into chips
From big batch gradient descent with parallel boosting from stochastic optimization with duals to online learning where we had regrets, to higher order methods that scale that was almost second order that nobody believed it.