←
Wil Cunningham997 posts
Wil Cunningham avatar

Wil Cunningham

@WilCunningham

Google DeepMind | Professor @ University of Toronto

◷ Joined May 2013▧ 12 Photos and videos
Robert Youssef avatar
⟳ Wil Cunningham retweeted
Robert Youssef@rryssf·20 Dec 2025

Banger paper from Google DeepMind on the missing layer of AGI just flipped the entire “AI safety is about averages” narrative on its head. Most people still think safety is about how a model behaves most of the time. This paper shows why that intuition breaks the moment systems scale. DeepMind frames AGI safety as a distributional problem, not a checklist problem. What matters is not the average outcome, but the shape of the tail. Rare behaviors. Edge cases. Low-probability failures that only show up when a system is deployed millions of times. A model can look safe in benchmarks, red-team tests, and controlled demos, and still be dangerous once it leaves the lab. Because deployment doesn’t sample “typical” situations. It samples everything. - Unusual users. - Weird environments. - Misaligned incentives. - Adversarial feedback loops. - Corner cases nobody designed for. At scale, those corner cases stop being rare. They become guaranteed. The paper’s core insight is uncomfortable: progress can reduce visible failures while increasing real risk. If capability grows faster than tail control, safety metrics improve and danger quietly compounds. Two systems can have identical average behavior and radically different worst-case outcomes. Current evaluations cannot see that difference. This also breaks a common governance assumption. You cannot certify AGI safety with finite tests when the risk lives in distribution shift. You are never testing the system you actually deploy. You are sampling from a future you don’t control. The implication is sharp. AGI safety is not a model property. It is a systems property. It depends on deployment, incentives, monitoring, and how much tail risk society is willing to absorb. This paper doesn’t offer comfort. It removes it. The real question is no longer “does the model usually behave well?” It’s “what happens when it doesn’t, and how often is that allowed to happen before scale makes it unacceptable?”

Post attachment
Google Labs avatar
⟳ Wil Cunningham retweeted
Google Labs@GoogleLabs·16 Dec 2025

🚨 NEW LABS EXPERIMENT 🚨 Introducing CC, an experimental AI productivity agent in Gmail. Get a “Your Day Ahead” briefing every morning in your inbox and email CC anytime for help. Sign up for early access in the US & Canada. We’ll be starting with Google AI Ultra and paid subscribers. ⬇️ labs.google/cc

0:38
Sigal Samuel avatar
⟳ Wil Cunningham retweeted
Sigal Samuel@SigalSamuel·16 Nov 2025

Hallelujah, some AI researchers are adopting a pragmatic approach to the “can AI be conscious” debate! I’ve long suspected that “conscious” is a pragmatic tool we use to mean “this thing should be in our moral circle,” so we won't *discover* if AI is conscious — we’ll *decide* it

Post attachment
Sundar Pichai avatar
⟳ Wil Cunningham retweeted
Sundar Pichai@sundarpichai·4 Nov 2025

Our TPUs are headed to space!  Inspired by our history of moonshots, from quantum computing to autonomous driving, Project Suncatcher is exploring how we could one day build scalable ML compute systems in space, harnessing more of the sun’s power (which emits more power than 100 trillion times humanity’s total electricity production). Like any moonshot, it’s going to require us to solve a lot of complex engineering challenges. Early research shows our Trillium-generation TPUs (our tensor processing units, purpose-built for AI) survived without damage when tested in a particle accelerator to simulate low-earth orbit levels of radiation. However, significant challenges still remain like thermal management and on-orbit system reliability.  More testing and breakthroughs will be needed as we count down to launch two prototype satellites with @planet by early 2027, our next milestone of many. Excited for us to be a part of all the innovation happening in (this) space!

Post attachment
Joel Z Leibo avatar
⟳ Wil Cunningham retweeted
Joel Z Leibo@jzl86·31 Oct 2025

[1/9] Excited to share our new paper "A Pragmatic View of AI Personhood" published today. We feel this topic is timely, and rapidly growing in importance as AI becomes agentic, as AI agents integrate further into the economy, and as more and more users encounter AI.

Nenad Tomasev avatar
⟳ Wil Cunningham retweeted
Nenad Tomasev@weballergy·15 Sep 2025

Happy to share a new preprint: Virtual Agent Economies arxiv.org/abs/2509.10147 where we discuss a number of possible frameworks for establishing steerable agent markets. The rapid adoption of AI agents points to a future where AI agents may be able to produce economic value independently of human labor. Coupled with the development of new interoperability standards like the Agent2Agent (A2A) and Model Context Protocol (MCP), this signals the inevitable emergence of a new economic layer. The arising virtual (sandbox) AI agent economy may offer us opportunities for insulation and safeguarding, as well as establishing potentially unprecedented coordination between agents, and orchestrating their interactions towards achieving major societal or community goals, or better aligning with user preferences. Market-based mechanisms like auctions may also be employed for fair resource allocation. Finally, we outline the technical and governance infrastructure—such as verifiable credentials for establishing trust—required to safely and robustly scale agentic AI deployments. These are necessary to address systemic market risks, and prevent exacerbating inequalities. Written up together with an amazing group of colleagues: @sindero @jzl86 @IasonGabriel @FranklinMatija @WilCunningham and Julian Jacobs

Edward Hughes avatar
⟳ Wil Cunningham retweeted
Edward Hughes@edwardfhughes·8 Aug 2025

Collectives can be more than the sum of their parts. This is baked into human intelligence because human intelligence emerged from collective cultural evolution. We have still not cracked this at the cutting edge of AI. Watch this space.

Edward Grefenstette avatar
⟳ Wil Cunningham retweeted
Edward Grefenstette@egrefen·21 Jul 2025

Do you have a PhD (or equivalent) or will have one in the coming months (i.e. 2-3 months away from graduating)? Do you want to help build open-ended agents that help humans do humans things better, rather than replace them? We're hiring 1-2 Research Scientists! Check the 🧵👇

Joel Z Leibo avatar
⟳ Wil Cunningham retweeted
Joel Z Leibo@jzl86·15 Jul 2025

Introducing Concordia 2.0, an update to our library for building multi-actor LLM simulations!! 🚀 We view multi-actor generative AI as a game engine. The new version is built on a flexible Entity-Component architecture, inspired by modern game development.

Edgar Duenez-Guzman avatar
⟳ Wil Cunningham retweeted
Edgar Duenez-Guzman@DuenezGuzman·16 Jun 2025

I once hoped discrimination was a dying relic. But what if it's a cognitive "bug"? At @GoogleDeepMind , we asked a critical question: Could bias emerge on its own, even in AI without any human social baggage? Our new research in @PNASNews has some startling answers. 🧵

Sigal Samuel avatar
⟳ Wil Cunningham retweeted
Sigal Samuel@SigalSamuel·22 May 2025

Okay, my favorite AI paper of the year so far has arrived. In this new gem, researchers point out something I think should be obvious but seems not to be for many people working on AI safety: There is no One True Answer when it comes to morality! arxiv.org/abs/2505.05197

Matt Dagley avatar
⟳ Wil Cunningham retweeted
Matt Dagley@mattdagley·6 Mar 2025

I am Canadian (2000) - We are Canadian (2025)

1:02
1:42