
A thread of threads - the mini-book reviews that I have posted here during 2025. In chronological order. I happily recommend all but one of these books

Chair, London Futurists. Executive Director of LEV Foundation. Author or Lead Editor of 12 books about the future. PDA/smartphone pioneer. Symbian co-founder

A thread of threads - the mini-book reviews that I have posted here during 2025. In chronological order. I happily recommend all but one of these books

A very timely question: "What if, in the name of progress, we were creating the ripest attack surface in human history?" The question is especially relevant because, as @NicolePerlroth anticipates, "This... is just the opening chapter"
I haven’t lived here in awhile, but I see no other way to answer the hundreds of texts/DMs asking me if the world is, indeed, ending. In the span of six days, we’ve experienced; 11/12 — Microsoft outage 11/13 — Nationwide FAA ground stop 11/16 — Major US banking disruptions 11/17 — NSA’s classified internal network goes down We need far more analysis of why so much is breaking at once. I don’t want to get out over my skis here, and what I am hearing does not contradict the messaging that most of this is the result of screwy updates. But stepping back, the dots are starting to form a collective picture. We are seeing: • An explosion in severe and critical vulnerabilities, with AI accelerating discovery to 3X the number of vulnerabilities discovered in the same period last year. This is collectively being referred to as “vulnageddon” or “the vulnpocalypse.” • Mean time to exploit those vulnerabilities has collapsed to NEGATIVE SEVEN DAYS. AI allows attackers to find/exploit vulns far faster than software makers have time to fix them. • Powerful AI-enabled offensive tools like ARTEX have been thrown into the hands of every third tier nation state, cybercriminal and digital arsonist, which logically creates havoc. • This creates enormous pressure to compress patching windows and accelerate software updates, increasing the likelihood these fixes break things in unexpected, cascading ways. • Pressure to just “AI everything” means we are rolling out automated AI tooling on top of brittle infrastructure that can’t support it. My generation grew up in an extraordinary period of technological stability. We worked our way up the software stack, abstracting away layer after layer, until we lost a fundamental understanding of how the underlying systems actually work. We were told to “move fast and break things.” VCS told us to celebrate the idea that “software would eat the world.” Now we’re telling ourselves we can simply “roll out AI” across everything, as though nothing underneath will buckle. We never stopped to ask: SHOULD WE? Should we be digitizing every last nook and cranny of our companies, infrastructure, healthcare, homes, cars, bodies, lives? Especially when the complexity, interdependence, and fragility we were introducing overwhelmed our ability to understand/secure/maintain the systems we built? Nobody every asked: What if, in the name of progress, we were creating the ripest attack surface in human history? We are now entirely dependent on software systems that almost nobody understands end to end, that increasingly few people can repair, and that attackers can now probe at machine speed. We are hearing that incident response firms, the 911 for breach victims, are backlogged six months. Even those paid on retainer lack the bandwidth to triage every incident. The cavalry is disappearing. We are entering a period of unprecedented technological instability. “Software Beirut” is an incredibly apt analogy. We are in for a period of cascading failures, whether triggered by attackers, bad updates, or our own accumulated complexity. This, I’m sorry to say, is just the opening chapter.

The largest AI Safety protest ever (so far) is happening in London on Saturday. This short video explains why the protest is so important youtu.be/WjxeA89nJRA

I expect this is a pretty fair assessment
The absolute best assessment I've seen so far...

Here's my answer to which kind of AI superintelligence I would regard as a "worthy successor to humanity" in the role of the Earth's most capable intelligence

For the full agenda, and details of the speakers, see mindforward.health/events

Fast-changing AI brings both challenges and opportunities for mental health. That's one of the topics in the @mndfrwrd panel where I'm speaking at #MindForward on 1st Dec. Discounted tickets are available for members of @LondonFuturists via this link eventbrite.com/e/19950779117…

If you're short on time, you can skip most of the preambles before and the panel conversations after Paul's presentations, but be sure to watch the fireside conversation with Geoffrey Hinton after the presentation on the final day. And do take enough time to watch Paul's lectures

"There is a significant risk of an AI takeover in the next 18 months" - The 3 Hinton Lectures by Paul Christiano earlier this week spell out with admirable clarity the accelerating landscape of catastrophic AI risk, and pros and cons of potential responses aisfoundation.ai/hinton-lect…

It's time for everyone to pay attention
AI godfather and Nobel Prize winner Geoffrey Hinton is addressing EU leaders at a summit in Dublin today. The Telegraph quotes Hinton: “If it’s super-intelligent it’s not going to be you controlling it – it’s going to be it controlling you.” He says he didn’t realize this was so urgent and terrifying until he heard OpenAI board member Paul Christiano’s recent comments: “I’ve been going around saying this stuff’s going to get smarter than us and we really need to worry and it might happen within 10 years, but I go to Paul’s lectures and he says this stuff might happen in the next 18 months and that’s terrifying.” “What’s going on is extremely dangerous. People haven’t really absorbed what it means to deal with a super-intelligent AI.”

To find activities near you that support a pause of frontier AI development, see luma.com/PauseAI

Signals from inside the frontier AI labs suggest that recursively self-improving AI may arrive sooner than previously expected. That could be the fifth and final step towards a reckless Singularity. But there's still time to organise a global pause of frontier AI development

"Can We Steer AI Towards a Better Future? Foresight and the Singularity: An Audience with David Wood" - I'm expecting an interestingly different conversation this evening. Live streaming, all welcome. From 9pm UK time today, 10th November youtube.com/live/dYpfRVXAM8E

Hyesoon and I watched "The Social Reckoning" on the big screen in Fulham's Vue Cinema this morning. It built to some very powerful scenes. The consequences of this brave whistleblowing are still unfolding. To whet your attention here's the trailer youtube.com/watch?v=MfHEZw7X…

Agreed. No sci-fi is needed
you know what's easier than figuring out how to supplant humanity? figuring out that if the humans shut you down then you can't achieve your goals. the sort of AI that's dangerous enough to worry about is the sort that doesn't need old sci-fi books to spell out the obvious.

We can have better foresight if we have better hindsight
I was just reading this 1925 book (because why not?) and randomly opened it to the page where Haldane dismisses nuclear weapons.