
NEW: @Aligned_SI's Plan To Get P(Doom) Below 0.01% Dr. Craig Kaplan's is the founder of Superintelligence.com, an extremely valuable domain for the newly-rebranded field of “super intelligence”. Craig has been building intelligent systems since the 1980s. He did his PhD research at Carnegie Mellon with Nobel laureate Herbert Simon, one of the founders of AI, and he built PredictWallStreet, a collective-intelligence platform that powered more than $2 billion in stock trades before it was acquired. He takes AI extinction risk seriously. His P(Doom) is 10%. But unlike me, he thinks he knows how to fix it. He plans to put “personal superintelligence” into the hands of millions which he believes will lower P(Doom) below 1%. These are part of a larger plan to create “superintelligent networks” which lower P(Doom) below 0.01%. Craig says a network like that is safer because the AIs can check each other’s work faster than humans can think. Craig and I clash on whether intelligence makes an AI more thoughtful, whether a superintelligence will want to grab the stars, and whether peaceful “stoner” AIs can survive next to a “Caesar” AI that wants to conquer the universe. We cover: ⬜ The three-phase plan to cut P(Doom) 1,000x ⬜ Collective intelligence vs. black-box AI ⬜ “Personalized Superintelligence” ⬜ Lessons from PredictWallStreet ⬜ Craig's mainline doom scenario ⬜ Raising ASI like a child ⬜ Orthogonality thesis ⬜ Caesar AI vs. stoner AI Craig called our debate one of his best podcast appearances because of the pushback. We didn’t reach much consensus, but it was a high-quality good faith Doom Debate. Take a look and decide who *you* agree with!

















