←
Richard Sutton489 posts
Richard Sutton avatar✓

Richard Sutton ✓

@RichardSSutton

Student of mind and nature, libertarian, chess player, cancer survivor. @ oaklab.ai, UAlberta, amii, openmindresearch.org, The Royal Society, Turing Award

◷ Joined October 2010
Richard Sutton avatar
Richard Sutton@RichardSSutton·20 Jul 2023

AI researchers seek to understand intelligence well enough to create beings of greater intelligence than current humans. Reaching this profound intellectual milestone will enrich our economies and challenge our societal institutions. It will be unprecedented and transformational, but also a continuation of trends that are thousands of years old. People have always created tools and been changed by them; this is what humans do. The next big step is to understand ourselves. This is a quest grand and glorious, and quintessentially human.

Prashant Rai avatar
⟳ Richard Sutton retweeted
Prashant Rai@imprashantrai1·Nov 9

The Bitter Lesson is often mistaken for an argument against algorithmic ingenuity, when it’s really an argument against hardcoding our own ingenuity into the system.

Richard Sutton avatar
Richard Sutton@RichardSSutton·Nov 8

This Thursday I will be giving the opening keynote at RISEx 2026 in Edmonton Title: The Tashan/Openmind Robot Kindergarten Abstract: It has always been a dream in reinforcement learning to make robots that learn online by trial and error from their own experience. After all, this is the way people and all other animals learn about their bodies and the world. In robotics, however, learning is almost never online. Instead, the field has focused on learning from data-sets collected from human demonstrations. Learning from experience requires a totally different approach, including anti-fragile robots, skin with tactile sensing, extensive onboard computation, and continual real-time learning algorithms. All these things are difficult and so have rarely been done. They require a substantial commitment of engineering effort and resources, plus determination and patience, plus scientific breakthroughs in reinforcement learning algorithms. The Tashan/Openmind Robot Kindergarten is an ambitious new attempt to do all these things, led by researchers from the Openmind Research Institute in Edmonton and from the Tashan Technology Corporation in Beijing. The work has just begun, and so this talk will focus on the challenge and the ambition. Robots must learn online.

Richard Sutton avatar
Richard Sutton@RichardSSutton·Nov 7

Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO

Giri ATG avatar
⟳ Richard Sutton retweeted
Giri ATG@GiriATG·Nov 4

A defining milestone for ExperienceFlow! We’ve taken a significant step toward our mission: Real Super Intelligence for the Real World. Today we introduced the first decentralized Super Intelligence, and welcomed the person who founded the field it’s built on. Press Release : prnewswire.com/news-releases… Every AI you’ve heard of learns from a record of the past. Language models learn from what people wrote. World models learn from what they observe. Decision models learn from examples of past judgments. Then they’re frozen, and the world moves on without them. It doesn’t matter where they run. Big centralized models pull your data out to them. Small and open-source models keep it local, but starts going stale the day it’s deployed. We built something different. ExperienceFlow’s Super Intelligence is a network of reinforcement learning agents that run where your decisions are made: your cloud, your data centers, your edge. They learn from experience, not just from the record. Each agent keeps learning from the results of its own actions, and our Enterprise Digital Nervous System coordinates them toward shared goals. Your models, your data and the experience your agents build up stay yours. I’m also thrilled to welcome Dr. Mark Ring as our Chief of Innovations. Mark coined the term “continual learning” in 1991, decades before it became a top priority for the world’s leading AI labs. He co-founded Cogitai, whose team and technology became the foundation of Sony AI. He joins Prof. @RichardSSutton , 2024 Turing Award laureate, founder of our Super Intelligence Research Lab. Rich says it best: continual learning isn’t an optional feature of intelligence. It’s central to it.

Richard Sutton avatar
Richard Sutton@RichardSSutton·Oct 30

One reason I am sanguine about the technological singularity is that I have seen it coming for over 50 years. In 1975, when I was 17, I wrote: "Before man can most effectively aid his problem solving machinery, he must first understand it. At present, his understanding is very poor. However, when the breakthrough in understanding the brain occurs, improvement will come very fast and in an exponential increase. Once man has created an intelligence greater than his own, that intelligence should be able to create an intelligence greater than itself, as man whose intelligence is less than its was able to create its intelligence. Thus, the level of intelligence will shoot up with incredible rapidity, probably within the space of years. Within a few years of a breakthrough, which may occur any time now, man will either have been left behind by a superior intelligence of his own making, which he can no longer understand, or he will have become that intelligence and will no longer be like anything imaginable today."

Artificial.Agency avatar
⟳ Richard Sutton retweeted
Artificial.Agency@ArtificialAgncy·Oct 28

Turing Award laureate @RichardSSutton on why we play, then his first shift alongside AI coworkers in Dimensional Double Shift by @owlchemylabs. "They should have goals." Game and characters by Owlchemy Labs; moment-to-moment behavior by Artificial Agency.

2:05
Csaba Szepesvari avatar
⟳ Richard Sutton retweeted
Csaba Szepesvari@CsabaSzepesvari·Oct 20

tinyurl.com/7kmjvkj7 UofA Math Dept has an opening for Tenure-Track Assistant Professor, subtitled "Mathematical Foundations of AI and Formal Reasoning". Please spread the word! Math dept is excellent, we have a lot of fun together. DM if you are interested and have questions

jane gatsby avatar
⟳ Richard Sutton retweeted
jane gatsby@jane_gatsby·Oct 16

thrilled to have this deep dive published with @PirateWires!!! a sincere investigation into why so many prominent AI doomers are also extremely kinky, & what this overlap reveals about the movement's underlying psychology

Post attachment
Chris Watkins avatar
⟳ Richard Sutton retweeted
Chris Watkins@ChrisJCHWatkins·Oct 15

I am honoured to be awarded the 2026 NEC C&C prize with Andrew G. Barto and Richard S. Sutton @RichardSSutton, for Pioneering Contributions to the Establishment of Reinforcement Learning Concepts and Algorithms.

Marko Njegomir avatar
⟳ Richard Sutton retweeted
Marko Njegomir@njmarko·Oct 12

There is a lesson to be learned here, taught by @RichardSSutton. It's bitter, so not everyone will like it at first. But don't worry, it's an acquired taste 🙂 Expert systems, feature engineering, prompt engineering, Tesla FSD that Elon mentioned, and most recently, Harness engineering, just to name a few.

Post attachment
Marko Njegomir avatar
⟳ Richard Sutton retweeted
Marko Njegomir@njmarko·Oct 12

The Bitter Lesson is knocking on the door of harness engineering. ☠️ 👀

Post attachment