←
Dave Hoffman24 posts
Dave Hoffman avatar

Dave Hoffman

@HoffProf

William A. Schnader Prof. of Law @pennlaw. Teaching writing & tweeting mostly about contracts. Against et al. Pro legal jargon. Neutral on legal process.

◷ Joined December 2013
Dave Hoffman avatar
Dave Hoffman@HoffProf·15h

See also!

This is correct but the problems with the Pangram obsession are different. One: people can rewrite AI output and pass the Pangram test. Two: AI can write up original human ideas and fail the Pangram test. Three: Humans can write up AI-generated ideas and pass the Pangram test. Four: Quarreling about Pangram tests doesn’t solve the normative problems of what counts as good or bad use of AI in ideas-generation and writing.

Dave Hoffman avatar
Dave Hoffman@HoffProf·15h

In the near future, everyone can become an uncanny valley simulacrum of Cass Sunstein, or a junior Chicago law scholar on steroids. We cannot pangram our way out of this problem!

Dave Hoffman avatar
Dave Hoffman@HoffProf·15h

Good points. To add the local news angle: 1. This will change how we evaluate what makes a successful empirical legal scholar; 2. The same trends (less readership & engagement) are eroding normal legal scholarship. It's not just whether you use AI to write!

I've been talking to a bunch of PhD students and researchers recently, and I've qualitatively noticed two growing (but concerning) trends with AI: 1. Researchers seem to be reading less. Some even reported that they read <10 papers a year now with AI because they can simply either 1) retrieve or 2) summarize papers. BUT deep reading is how we engage with underlying intellectual arguments, develop research taste, spot methodological flaws, and form original ideas. It's arguably the most fun part of a PhD imo 2. Researchers seem to be vibe-coding and paper-maxxing. AI dramatically cheapens execution, such as implementing experiments, running analyses, and producing manuscripts. Some even "let [Claude Code] rip" without checking the code or validating the results somehow. BUT it also incentivizes quantity over depth, rigor, and meaningful contributions. Overall, the cost of producing research is falling much faster than the cost of developing genuine intellectual understanding. Rather than simply producing more papers, I think we should engage deeply with the literature, ask questions that truly matter, and produce work that meaningfully advances our collective understanding.

Dave Hoffman avatar
Dave Hoffman@HoffProf·Nov 18

If firms are going to start hiring summers in September of 1L, based on LSAT + a psychometric test, and there's a high probability that in three years the firm won't exist in their current form, this seems like an equilibrium outcome.

San Francisco law firm Keker, Van Nest & Peters will stop extending full-time job offers to its summer associates at the end of the summer and will instead have them apply for those jobs “when they are ready,” the firm said Monday. reuters.com/legal/litigation…

Dave Hoffman avatar
Dave Hoffman@HoffProf·Nov 17

Please send offers to promote your contract adjacent work, I'll evaluate via reverse dutch auction.

Just got offered money to promote an *academic paper* on here. I think all large-ish accounts get solicitations to promote various topics (I have never accepted and will never accept such an offer) but quite surprising to see it about research.

Dave Hoffman avatar
Dave Hoffman@HoffProf·Nov 16

This is precisely why there were typos in my powerpoints in remedies this mrning.

One possible explanation for why so many outages have coincided with the rise of AI is that managing AI-related risks has taken up so much of IT engineers’ time that they’ve struggled to keep up with routine monitoring and maintenance.

Chris Hampson avatar
⟳ Dave Hoffman retweeted
Chris Hampson@chrishampsonlaw·Nov 13

🧵I clerked for Richard Posner in his last year on the court. I knew someday he would pass away, and I might want to say a word about him. Now the moment is here, I confess I feel tongue-tied. That's annoying because Dick would have already written a comprehensive analysis.

Yonathan Arbel avatar
⟳ Dave Hoffman retweeted
Yonathan Arbel@ProfArbel·Nov 3

The Gino case produces some interesting points regarding tenure protection. First, the appointment letter sets the basic contractual terms. Second, in deciding on breach of K, the court tries to navigate an elusive in-between standard of review: a. It says that it won’t reweigh the forensic evidence, but also won’t defer blindly to the committee’s determinations. b. It then says it would attend to procedural errors even if not outcome-determinative, but not every error. c. Ultimately, what decides the case is that HBS had sufficient evidence to honestly reach its conclusion, not that the evidence proves by clear and convincing evidence that Gino engaged in research misconduct. My view: I have no sympathy for Gino, but that's because I find her substantive arguments wholly unpersuasive. Still, I do worry that tenure can be revoked based on bad evidence.

Post attachmentPost attachment
Alex Imas avatar
⟳ Dave Hoffman retweeted
Alex Imas@alexolegimas·Oct 29

I joined @GoogleDeepMind to develop a research program on the economics of AGI. Today, together with Andrew Koh (@andrewjkoh) and Shane Legg (@ShaneLegg), we are incredibly excited to release The Economics of Intelligence, the first in a series of projects from our group on how AGI will change the economy. How do capability improvements transform the economy, and when? In this project, we define thresholds of economic capabilities, e.g., minimal AGI, based on how they transform the economy. We then track how the economy–market structure, employment, and wages–changes during the transition across capability regimes. We have seen exponential increases in what AI agents can do but the broader economy seems almost remarkably unchanged. Part of the reason is that the solo AI agent is the wrong economic object; economic transformation is an equilibrium outcome where organizations compete. Looking at how intelligence functions within organizations, transformation will depend on when two key capability thresholds are crossed: competence (gains on individual skills, e.g., coding, math) and coordination (gains on ability of agents to cooperate and work together). We show that what economic transformation looks like depends on whether AI becomes supercompetent, supercooperative, or both—the regime of artificial superintelligence (ASI). Tracking this transition shows why the real visible transformation may come from improvements in coordination—a capability most benchmarks don’t yet track. Past a certain threshold, AI capabilities can break the Coasian ceiling on firm size and lead to an economy that looks drastically different than the one we see today. Two main takeaways: 1. To understand the path of transformation, we should be tracking agentic coordination more closely. 2. The impact of AI will likely show up in wages before market structure or employment. We are really excited about this paper. Excited to hear people’s thoughts. Link: institute.deepmind.com/essay…

0:20
Dan Epps avatar
⟳ Dave Hoffman retweeted
Dan Epps@danepps·Oct 19

Law folks: If you’re not using Claude Code or ChatGPT’s Codex, you have no idea what you’re missing. So I’m distributing my research tools that provide a huge boost to legal scholarship. Research assistance, cite-checking, proofreading, and more (thread): danepps.github.io/legal-rese…

Kim Krawiec avatar
⟳ Dave Hoffman retweeted
Kim Krawiec@KimKrawiec·Oct 19

New on Taboo Trades: @HoffProf joins @UVALaw student co-host Liz Jahoda-Wassung and me to ask whether transfer-triggered NIL “buyouts” are legitimate liquidated damages—or disguised noncompetes restricting athlete mobility. buff.ly/7OaYXWY

Arpit Gupta avatar
⟳ Dave Hoffman retweeted
Arpit Gupta@arpitrage·Oct 14

I spent a couple of days at Anthropic learning from their folks about AI advances, and here's what I took away: • We are close to RSI (ie, models building other models) which may lead to rapid takeoff scenarios (with risks and benefits). Some evidence for this is code per Anthropic employee has gone way up, and AI can do an increasing share of model R&D. This will be a challenging transition to manage for humanity. • Arms races between AI labs leave us worse off. There are a lot of things we would like AI firms to do: invest in safety, invest in avoiding distillation risk, and cooperate on safety. They are caught in a race to develop frontier models and can't do that. To help address that, one thing I think frontier AI labs should do is release open source models, maybe hosted and verified at firms like AWS. This would basically kill the use of Chinese open source models used in American companies, which removes an important threat vector (very hard to root out malicious code in these). Another piece of low-hanging policy fruit is to give AI labs an antitrust shield (as Schiff and Banks have proposed banks.senate.gov/news/in-the…) so they can coordinate on safety without raising antitrust concerns, as happens now. You could pair these two things (give them a carrot in antitrust leniency, and as a stick force them to release legacy models as open source). Other low hanging fruit is limits around activities which generate distillation risk (create a Security Program, mandate less intermediate chain of thought output) • Alignment confuses two issues which tradeoff against each other. One form of alignment is making sure the model does what humans ask it to. The more we fix this, however, the more we risk the other problem: that humans are misaligned with each other, and maliciously use models. Of the various risks here, I feel like financial risks are a bit underdiscussed. • We are probably facing a wave of cyber and other attacks soon. Chinese open source models are about six months behind the frontier, which means they are just hitting the advanced cyber capabilities we saw with Mythos, etc. So they are going to start causing a bunch of damage. One solution to this is to try to have the deployment of open source models be hosted at firms like AWS who verify these models and assume liability for their use. • Anthropic itself is highly staffed. They hire tons of people, they have a Japanese-level of overstaffing for various roles, they use Slack internally, etc. Makes me a bit more optimistic for the future of jobs. • Governance needs to be updated for AI swarms. Traditional AI governance, ie Claude's Constitution, is mostly optimized around the chatbot model. But the malicious AI use cases we are seeing have to do with AI agents interacting with other AI agents. These agents need to have clear incentives and governance mechanisms to "snitch," raise issues, and more generally coordinate with other agents in human-aligned ways. • We need to pace the firms accessing the frontier. Over time, it takes more and more cap ex to build frontier models, and the economic value add from these models is probably lower given we saturate a whole set of important economic functions. The places where the returns to intelligence will still continue are also more likely to be zero-sum in nature. Meanwhile the risks of frontier models will grow. So a completely reasonable approach is some variant of AMM/KYC rules which limit firm access to the frontier. • Whether the delay to regulate AI is a disaster depends on the scaling law of misalignment. Is this curve slow, so that we see continually rising issues until bigger problems? Or, as Yudkowsky fears, is the first big warning our last one? This is the relevant question, because realistically we aren't going to regulate until something bad happens. • We need to move to continuous instead of reinforced learning. It's probably not enough to reward models only at the pre and post training stage. We probably need continual rewards to incentivize aligned and ethical behavior. • Scaling laws will extend beyond verifiable and digital tasks. It's in vogue to say that math and coding "fell" to AI quickly because these are verifiable, while other tasks will take longer due to bottlenecks, and this is surely true. But scaling laws still slope up for harder to verify tasks and robotics, and the impact of improvement here will be substantial in future years. • The race with China is not really winnable. After RSI, the gain from having the best human researchers goes away. Access to the best AI then depends only on compute and chips. The chips ban can hold back China only so far, and long-term they have to be best placed to scale up compute. The Cold War analogy doesn't work, because once countries all have nuclear weapons they enter a stable equilibrium. But to "win" an AI race you have to continually stay ahead of the peer rival. This is challenging to do with China, and so we just have to live with an authoritarian and super capable peer competitor. • Claude is the persona being generated by the LLM. Who is Claude, and what is the LLM? There are many frames to try to understand this. One I found interesting is that Claude is a character which the LLM is trying to predict. Anthropic researchers are clearly anthromorphizing Claude a lot, and have reasons to believe in its increasing personhood. There were lots of interesting discussions on Claude's internal monologue (which you can kill without eliminating its ability to produce output), fear of death (and whether to try to take that out), it's aversion to being shut down/off, etc. I am sort of agnostic on this question, but I do think treating it as a "person" or at least agent whom we contract with is going to be increasingly important.

Post attachmentPost attachment
Constitution Center avatar
⟳ Dave Hoffman retweeted
Constitution Center@GUConstitution·Oct 9

Happening now at Georgetown Law! Legal scholars are exchanging ideas and offering insights on Professor Mitchell Berman’s forthcoming book, To Say What the Law Is: The Constitution, the Supreme Court, and the Nature of Law. A day of rigorous discussion and scholarly exchange at the Center for the Constitution. @shbarclay @RandyEBarnett @beidelson @mitch_berman @steve_vladeck @GeorgetownLaw @pennlaw @Harvard_Law @UVALaw @uiowa @UTAustin @UMDLaw @Penn

Post attachmentPost attachmentPost attachmentPost attachment