←
Arvind Narayanan13,490 posts
Arvind Narayanan avatar✓

Arvind Narayanan ✓

@random_walker

Princeton CS prof and Director @PrincetonCITP. Coauthor of "AI Snake Oil" and "AI as Normal Technology". normaltech.ai/ Views mine.

◷ Joined December 2007▧ 963 Photos and videos
Arvind Narayanan avatar
Arvind Narayanan@random_walker·Nov 10

📢 We need more orgs that take AI’s transformative potential seriously *and* take downstream bottlenecks seriously. We have just launched STABL, and hope to lead by example. Read our launch essay below and check us out at stabl.ai. The three of us have long felt that society’s responses to advanced AI are unproductively polarized. So we’ve decided to do something about it. Our work will have four pillars: Recursive Self Improvement, risks and resilience, steering AI’s economic impacts, and sectoral and professional adaptation. We will bring our distinctive methods and approach to each of these workstreams. Our underlying worldview avoids the extremes that dominate the discourse, so building a movement and ecosystem around this work won’t be easy. But that is the task we have set ourselves and we are excited to try. The good news is that there are many others who share our views. The next step is to come together, better articulate our vision and agenda for research and action, and amplify each others’ efforts.

rohit avatar
⟳ Arvind Narayanan retweeted
rohit@krishnanrohit·19h

I dug into this a bit. It looks like we're at highs, but not unprecedented highs for major systems failures. We're seeing alarming headlines every day, but a lot of it is recency bias.

Post attachment
Dan Williams avatar
⟳ Arvind Narayanan retweeted
Dan Williams@danwilliamsphil·Nov 16

New episode! Is AI a normal technology, or something radically different? Henry Shevlin (@dioscuri) and I put some objections to Arvind Narayanan (@random_walker), who is sceptical that "superintelligence" can be built in a lab and thinks AI’s effects will arrive gradually. We also discuss AI consciousness, persuasion, misinformation, and more! Full conversation with transcripts and links here: conspicuouscognition.com/p/c…

1:00
Ramez Naam avatar
⟳ Arvind Narayanan retweeted
Ramez Naam@ramez·Nov 12

Very excited about this new AI institution. The top right quadrant they highlight here is pretty much where my views are. AI is powerful. Bottlenecks are real. We have agency. Congrats @RishiBommasani @sayashk @random_walker !

Post attachment
Arvind Narayanan avatar
Arvind Narayanan@random_walker·Nov 11

I agree, but this only makes the policy response harder, because a blanket ban on AI companions for teens is unlikely to be a good solution. The menu of responses is too blunt, and there's not enough thinking on how to incentive pro-social design of chatbots. x.com/holmesjtg/status/21205…

Arvind Narayanan avatar
Arvind Narayanan@random_walker·Nov 11

There have been awful cases of teen mental health harms and suicides from chatbots like GPT-4o and Character AI that were sycophantic and misbehaving. But these were all text-based, and extremely rudimentary as “companions”. I’ve talked to many people trying to hold the industry to account for teen safety and almost none are thinking about the coming wave. Completely realistic video avatars are already here, but expensive today and limited to enterprise applications. Within a year or two they will be cheap enough for always-on, ad-supported video companions. What happens then?  Uptake of AI companions will likely explode — not just the number of users but, more importantly, the time spent per day. Social media levels of compulsive use. I also predict the whole framework of guardrails and safety will prove to be of limited value at dealing with the most widespread negative consequences. Preventing chatbot misbehavior through guardrails is important, but that only protects against serious consequences like self-harm. When the concern is that millions of kids (and adults) are overusing AI companions, losing sleep, wasting time, and displacing real relationships, it doesn’t matter how “safe” the bots' responses are.

2:19
Percy Liang avatar
⟳ Arvind Narayanan retweeted
Percy Liang@percyliang·Nov 11

You can simultaneously believe that AI is transformational and that there are bottlenecks.

Post attachment
Seth Lazar avatar
⟳ Arvind Narayanan retweeted
Seth Lazar@sethlazar·Nov 11

Among the many things that is great about this: excited to see academics being creative about how to get shit done—junior folks considering whether to go into academia or launch a non-profit : you can do both!

Sayash Kapoor avatar
⟳ Arvind Narayanan retweeted
Sayash Kapoor@sayashk·Nov 10

Steering AI's societal impact requires taking both AI development and downstream bottlenecks seriously. Today @RishiBommasani @random_walker and I are starting a new non-profit: STABL @stabl_ai to guide societal adaptation and resilience to advanced AI.

rishi avatar
⟳ Arvind Narayanan retweeted
rishi@RishiBommasani·Nov 10

I am excited to announce our new nonprofit STABL, co-founded with the wonderful @sayashk @random_walker! Our organization derives from four beliefs: 1. Advanced AI will broadly transform society and, if managed well, this transformation will be broadly beneficial. 2. The speed of this societal transformation is governed by bottlenecks: in many cases, the bottlenecks relate to people and organizations, not AI capabilities alone. 3. Since AI capabilities are not the sole determinant, the best strategy to manage the risks from advanced AI requires broad societal resilience, not just aligned models or capability delays, to provide defense in depth. 4. And while today’s institutions often struggle to grapple with the salvo of advanced AI, institutions will help stabilize society and will be essential, if adequately reformed, for ensuring shared prosperity. In addition to these beliefs, the reason to create a new organization is based on the need we see in the ecosystem. In today’s ecosystem surrounding advanced AI, many of the leading companies and external actors focus on frontier AI as a technology. We share the view that the technology itself requires dedicated attention, and some of our work at STABL will be in this direction. But the greater need we see is for independent organizations that take AI capabilities seriously and focus on downstream societal outcomes. We are building STABL to help fill this gap. And we hope to see many other organizations and initiatives emerge to define this field. For me, the most exciting part thus far has been seeing all the support we have gotten in our early forays. Thanks especially to @audreyt @erikbryn @hlntnr @MichaelRStrain @RobbWiller for joining us as advisers! We are hiring and fundraising so please reach out if you are interested in this work!

Post attachment
Forecasting Research Institute avatar
⟳ Arvind Narayanan retweeted
Forecasting Research Institute@Research_FRI·Nov 10

AI companies increasingly say they may soon reach recursive self-improvement (RSI). With RSI, AI capability progress could accelerate dramatically. This acceleration could happen inside AI companies before outsiders can notice. How close is RSI? Our new report reviews the evidence, turns key disagreements into forecasting questions, and gives initial LLM forecasts. 🧵

Post attachment
Michael C. Frank avatar
⟳ Arvind Narayanan retweeted
Michael C. Frank@mcxfrank·Nov 10

New blog post: I used Claude to audit the reproducibility of every journal paper I've been an author on in the last five years. Our commitment to openness meant that the code and data were available, but there were some significant issues. 🧵babieslearninglanguage.blogs…

Ramez Naam avatar
⟳ Arvind Narayanan retweeted
Ramez Naam@ramez·Nov 8

Anthropic is gaining exponentially less capability per billion dollars spent over time. It's now 8x as expensive to boost AI capabilities as it was 2 years ago, getting worse on a log scale. This includes METR report & internal models. Credit to @alexolegimas, @sebkrier, and @michael_wiebe for inspiration.

Post attachmentPost attachment
Manoel avatar
⟳ Arvind Narayanan retweeted
Manoel@manoelribeiro·Nov 10

What does ChatGPT tell folks about the midterm elections? It depends on who's asking! We audited ChatGPT inside 160 real users' own accounts in the days before the midterms. With memory on, we find that answers shifted toward each user's own party! elections.citp.princeton.edu…

Post attachment