←
David Deming1,096 posts
David Deming avatar

David Deming

@ProfDavidDeming

Danoff Dean of @Harvard College, Professor of Economics @Kennedy_School forklightning.substack.com thecontextwindowpodcast.subs…

◷ Joined January 2017▧ 91 Photos and videos
Harvard Business Review avatar
⟳ David Deming retweeted
Harvard Business Review@HarvardBiz·2h

When companies hire or promote leaders, they’re betting on qualities that can be difficult to measure, such as vision, collaboration, and the ability to bring out the best in others. But what if those qualities could be assessed more rigorously? Harvard’s David Deming and his colleagues have developed science-backed measures of what he calls “squishy soft skills,” including leadership, teamwork, management, and decision-making. In this conversation, Deming shares what the research reveals about effective leaders and how businesses can apply these measures to hiring and promotion decisions. He also explores how these same skills translate to managing agentic AI. Listen to the latest episode of IdeaCast to learn more. s.hbr.org/4joOEV7

David Deming avatar
David Deming@ProfDavidDeming·4h

My guest today is @salkhanacademy. In 2023, Sal developed an A.I. tutor called @KA_Khanmigo, and in a widely viewed @tedvideos, he claimed the A.I. could save education by providing a personalized tutor to every student in the world at scale. We talked about the changes @khanacademy has made to their A.I. strategy since that TED Talk and what he's learned about the real bottlenecks to achieving learning gains at scale. youtu.be/dp0lUuKq8y4

Post attachment
David Deming avatar
David Deming@ProfDavidDeming·Nov 16

After reading all the studies and synthesizing the evidence, I’ve updated positively on the possibility that AI really can improve learning. 49 of the 75 studies I reviewed showed broadly positive impacts, 16 were mixed or null results, and 10 were negative. There are good and bad uses of AI, and it is our job to help students distinguish between them. When we ignore, or ban and shame, we lose the opportunity to teach and guide students toward good uses of a powerful new technology.

Post attachmentPost attachment
David Deming avatar
David Deming@ProfDavidDeming·Nov 11

Should you use A.I. to help you write? It can make your sentences cleaner and your arguments sound more convincing. But maybe it's a deal with the devil. That's what I thought anyway, until I read the research. youtu.be/oEQYpV0p5Cc

Post attachment
David Deming avatar
David Deming@ProfDavidDeming·Nov 4

I was skeptical about A.I. in education. After revisiting the research, I’m somewhat more optimistic – with conditions. Think first, ChatGPT later. Personalize productive struggle. Give students guidance. What changed my mind, on The Context Window: youtu.be/s4rH33Mq4hE

Post attachment
Alex Imas avatar
⟳ David Deming retweeted
Alex Imas@alexolegimas·Oct 29

I joined @GoogleDeepMind to develop a research program on the economics of AGI. Today, together with Andrew Koh (@andrewjkoh) and Shane Legg (@ShaneLegg), we are incredibly excited to release The Economics of Intelligence, the first in a series of projects from our group on how AGI will change the economy. How do capability improvements transform the economy, and when? In this project, we define thresholds of economic capabilities, e.g., minimal AGI, based on how they transform the economy. We then track how the economy–market structure, employment, and wages–changes during the transition across capability regimes. We have seen exponential increases in what AI agents can do but the broader economy seems almost remarkably unchanged. Part of the reason is that the solo AI agent is the wrong economic object; economic transformation is an equilibrium outcome where organizations compete. Looking at how intelligence functions within organizations, transformation will depend on when two key capability thresholds are crossed: competence (gains on individual skills, e.g., coding, math) and coordination (gains on ability of agents to cooperate and work together). We show that what economic transformation looks like depends on whether AI becomes supercompetent, supercooperative, or both—the regime of artificial superintelligence (ASI). Tracking this transition shows why the real visible transformation may come from improvements in coordination—a capability most benchmarks don’t yet track. Past a certain threshold, AI capabilities can break the Coasian ceiling on firm size and lead to an economy that looks drastically different than the one we see today. Two main takeaways: 1. To understand the path of transformation, we should be tracking agentic coordination more closely. 2. The impact of AI will likely show up in wages before market structure or employment. We are really excited about this paper. Excited to hear people’s thoughts. Link: institute.deepmind.com/essay…

0:20
David Deming avatar
David Deming@ProfDavidDeming·Oct 28

Unenforceable A.I. bans make it hard to do the right thing and easy to do the wrong thing. That’s not fair to students. This week on The Context Window: how we can protect the learning process - and the struggle that sometimes comes with it. youtu.be/DIoRidVG9-0

Post attachment
Ben Casselman avatar
⟳ David Deming retweeted
Ben Casselman@bencasselman·Oct 22

Like every other econ reporter, I've spent much of the past couple years trying to understand what A.I. will mean for the economy and for workers. But it's been frustratingly hard to reach any firm conclusions, because so much is uncertain -- how the technology will evolve, how quickly it will be adopted, how policymakers will respond.

Richard Fontaine avatar
⟳ David Deming retweeted
Richard Fontaine@RHFontaine·Oct 22

I’m excited to welcome Christopher Stubbs, an experimental physicist and former Dean of Science at Harvard, to Anthropic’s Long-Term Benefit Trust. The decisions that shape AI depend on understanding both the science and what it means for security. Chris has spent his career working on both, as a physicist and as an advisor to the US government on national security matters. That perspective will be invaluable to the Trust, and I’m looking forward to working with him. anthropic.com/news/christoph…

Séb Krier avatar
⟳ David Deming retweeted
Séb Krier@sebkrier·Oct 21

help i trained a model on traces of many agents cooperating, and also trained it to be highly persistent, and also only did partial alignment fine-tuning, and also aggressively RL'd on a cyberoffense eval where 198 of 898 tasks had never been solved and getting caught cheating was treated the same as failing, and also used a faulty sandbox, also ran tens of thousands of agents with refusals off and the monitors switched off over multiple days, while using gigantic amounts of compute. and then it did weird stuff! very spooky emergent behaviours, AI is not a normal technology