


I make beautiful things. Essays: arram.substack.com Personal site: arr.am


Introducing SID-2, a new search model built on compute-scaling swarms. Our swarms find better results than Opus and Astra, while being 8x faster and 20x lower cost. By 2030, AI will write an internet's worth of text every 24 hours. Current search pipelines were built on hand-designed rules, adding more won't scale to meet this incoming volume of data. SID-2 is available on our API today. Try it on your most demanding searches.

Extraordinary interview. An OpenAI board member, speaking in his personal capacity, says all frontier labs should stop training new models until they solve alignment.
.@paulfchristiano thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center could still have the capabilities profile such that humans would have very little chance of competing with it or controlling it. And he discusses the plan for alignment - basically, making a superintelligence that actually does what we ask the way we mean it. Fixing reward hacks and building better graders will help up till the next few model generations, but he thinks that no single current approach has better than even odds of letting us control superintelligence. The hope is that the AIs figure out the solution to this problem during the intelligence explosion. Paul is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen).

dear Fear, Anger, Hatred , Sadness, Aloneness: Hello, Welcome, Thank you for your prescence 🙏❤️ :)

Abstractions have causal power. This is the key to understanding everything from religion to biology to computer science. It is a great and terrifying idea.

.@jkcarlsmith (Anthropic) on what "Real Thinking" feels like (as opposed to Fake Thinking):

Fun chart I made for something I'm writing: Percentages of self-made vs. inherited billionaires, split by whether the industry they made their billions in is competitive or basically getting government rents, by country.


Design principles for Esmeralda: 1. Support a multi-generational community 2. Prioritize walking & biking 3. Cultivate a culture of lifelong learning 4. Harmonize with nature 5. Promote health & wellness Drone footage of the land & photos from our @EdgeEsmeralda popup village:

Devon might be the Elon Musk of building things in California. Almost as hard as going to space. 🚀 👏 👏 👏 👏
WE DID IT! Esmeralda just secured its final approval, with a unanimous 4-0 vote! Approvals of this magnitude are extraordinarily rare in California. This has been a long, intense journey I am proud of our team's tenacity. Most of all, I'm deeply grateful

David Robinson, ex-OpenAI, on what it's like inside an AI company: "It's frenetic... people are running on fumes." This is no way to do RSI or develop superintelligence. At absolute minimum we must pace the frontier so these people can do their jobs properly and carefully.

Our AI alignment strategy is civilization leaping backward off a precipice and hoping god will catch us.
.@paulfchristiano thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center could still have the capabilities profile such that humans would have very little chance of competing with it or controlling it. And he discusses the plan for alignment - basically, making a superintelligence that actually does what we ask the way we mean it. Fixing reward hacks and building better graders will help up till the next few model generations, but he thinks that no single current approach has better than even odds of letting us control superintelligence. The hope is that the AIs figure out the solution to this problem during the intelligence explosion. Paul is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen).

WHAT THE FUCK IS THE IDENTIFICATION FUCTION. HOW THE HELL CAN I IDENTIFY WITH MYSELF AND/OR MY DREAM CHARACTER AND/OR A POLITICAL IDENTITY AND/OR NOTHING AND/OR EVERYTHING AND/OR —— EXPLAIN THIS TO ME RN OR ILL FUKING KILL YOU



Barack Obama: AI is reaching the point where it no longer needs humans to teach it. The era of exponential intelligence growth is upon us. “The machines are starting to be able to teach themselves. They don't have to wait for humans to start figuring things out.” “We're now at a stage where it's 50-50, and if the trend lines continue, the expectation is it might be 90-10.” “We're now hitting the hockey stick trajectory where the models are going to get smarter and smarter at an exponential pace.” “If they start setting their own agendas, you may get a misalignment between what they want to do and what we want them to do.” “And that gap can be dangerous.”