
Some quick reactions to the recent Dwarkesh podcast with Paul Christiano. Tl,dr: bullish on rapid capability gains, more skeptical of the leap to takeover, and wary of emergency overreach.


Head of Research @silicondata. @UMICH/@ETH_en/@UVA alum. Perpetually curious, but also "incredibly unsophisticated" (according to Chamath Palihapitiya)

Some quick reactions to the recent Dwarkesh podcast with Paul Christiano. Tl,dr: bullish on rapid capability gains, more skeptical of the leap to takeover, and wary of emergency overreach.


.@Tobi’s emphatic case for reinstating Jensen at Nvidia: “There is no replacing a founder like Jensen. There never has been, and there can never be, a true succession for a founder like him. Nvidia ends today, and is replaced with a thing cosplaying Nvidia. It will be run by custodians trying and failing to preserve the flame he ignited.”


So awesome running into @stevehou today, Bloomberg alumni reuniting — @silicondata at @TomorroXSummit


Come by the “Compute Corner” by @silicondata and @computeexchange! We are off!

🚨Read the new blog from our head of research @stevehou. CoreWeave announced during their latest quarterly earnings reporting, large repricings of A100 and H100 reserved rental rates by +30-50%. The blog walks through our interpretation of these changes using our indices.

“I DON'T PERSONALLY BELIEVE THE LABS ARE GONNA BE IN THE TOKEN BUSINESS. THEY CAN START SELLING TASKS INSTEAD OF TOKENS.” This makes a lot of sense.
*DRUCKENMILLER: I DON'T PERSONALLY BELIEVE THE LABS ARE GONNA BE IN THE TOKEN BUSINESS. THEY CAN START SELLING TASKS INSTEAD OF TOKENS *DRUCKENMILLER: IN EQUITIES WE'RE LOOKING FOR AI USE CASES AS OPPOSED TO INFRASTRUCTURE *DRUCKENMILLER: I'M REALLY ALERT TO THE FACT THAT THE SECOND HALF OF ‘27 COULD BE ECONOMICALLY DISAPPOINTING *DRUCKENMILLER: I'M JUST TAKING A BREAK, WHICH COULD LAST TWO DAYS OR SIX MONTHS, I DON'T KNOW

I'm really struggling with this. Not saying that he is wrong on everything, but listening to the scenarios feels like playing a game with a child, the rules of which he is inventing as we go, to end up with a pre-determined outcome. -- Why would AIs take over the labs? -- They would want to control everything to cheat on graders -- How would the AIs take over wider control? -- They wouldn't want anyone finding out that they cheated so they would start hacking governments and taking control over resources -- What if government will show up with guns to stop it? -- They would control the public opinion against that -- How would they control public opinion? -- They would hack into all devices and control information flow -- What if we manage to stop the big data centres anyway? -- The models will get small enough and will be spread everywhere to control everything Again, I don't want to say that we don't need to take this seriously - his main point of improving security seems unambiguously like a good thing. But the idea that we are on a realistic path towards AI's taking over the world in a year just seems like a fantastical idea that is derived by starting from that as an outcome and then backing into it with ever more esoteric unlikely scenarios that must all happen together for this to occur.
.@paulfchristiano thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center could still have the capabilities profile such that humans would have very little chance of competing with it or controlling it. And he discusses the plan for alignment - basically, making a superintelligence that actually does what we ask the way we mean it. Fixing reward hacks and building better graders will help up till the next few model generations, but he thinks that no single current approach has better than even odds of letting us control superintelligence. The hope is that the AIs figure out the solution to this problem during the intelligence explosion. Paul is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen).

🫡
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen



Woohoo 🥳
Announcement: Architect, @Luxor, and @hyperbolic_labs have executed the first OTC option on compute. Through our CFTC Introducing Broker we structured a bespoke $5M put option on B200 GPUs settling against @silicondata’s index. Luxor priced and was counterparty to Hyperbolic.


If you are at the @TomorrowXSummit, come visit us at the @silicondata booth in the Indeed Lounge! @carmenli and @stevehou are interviewing founders, operators and investors. There’s food and drinks too! 🌭🍹
