My book What's Our Problem? is now available.
The book introduces a new framework for thinking about our chaotic political environment. With 303 drawings, it's a toolbox for understanding our societies, our group dynamics, and our own minds.
Get it here: waitbutwhy.com/whatsourprobl…
It seems like there STILL won't be a thorough investigation into the hugging face incident, even after all this time! I keep talking to OpenAI researchers and asking about this, and what they say privately is also basically "it's just never going to happen sorry, not enough of a priority."
To reiterate what I said at the time: Serious investigation of the HF incident could be a boon to alignment science for the whole world. For example, try putting the same models in the same situations, but varying the conditions slightly, to see what would have happened. Could also look at sources of evidence other than CoT to try to get more insight into model psychology, e.g. when one agent considered warning a human and decided not to saying "not my task" what else was it thinking? To what extent was this a rationalization vs. an outright lie vs. an innocent mistake? We could learn a lot about AI motivations and psychology by doing a bunch of experiments like this. More ambitiously, could try training new models with different recipes / alignment training / etc. to see what would have prevented the incident and what wouldn't have.
[read about what’s happening with AI]
ME: Wow we’re actually legit fucked this is so bad.
[go outside]
ME: Wait those people are all acting like nothing unusual is happening. Maybe I was just in a paranoid bubble? Yeah it must be that. Phew.
[read more about what’s happening with AI]
ME: Wait no we ARE fucked. Shit. It’s all those people outside who are in a delusional bubble.
[go outside]
ME: Wait...
I wish this would never happen, but at least this one is an enhanced version of the actual image. I can't stand all the times when I get this huge dopamine hit from seeing an outrageous Jupiter shot only to learn it's entirely fake.
If you would like a taste of what my life is like right now, I wrote this in my book draft—
"It’s weird to think about how different aliens may be from us. Maybe they’re 100 feet tall. Or 6 inches tall. Maybe they’re not tall at all because they have 100 legs and look like long strands of spaghetti. Maybe they have giant balloon heads, 40 arms, and 70 boobs."
—and my fact-checker flagged the last sentence as a false claim, writing: "Highly unlikely on Earth-like biology. Mammary number correlates with litter size in several species, suggesting an evolutionary pattern, and is limited by the energetic cost of lactation."
Yeah, and my take overall is that you can believe that the threat is potentially real AND have concerns about onerous regulations that create a monopoly or duopoly or otherwise restrict the right to say, for example, open source AI technology, AND while knowing full well we are in a potentially existential battle with China about who can dominate AI.
Indeed, all of these things SHOULD be considered in the analysis.
@adgo and I tried to explain a sensible First Amendment approach here, which both addresses the potential of catastrophic harm, which almost exclusively comes from when AI is given delegated authority, from helping keep the state’s grubby mitts off of what counts as knowledge.
Also, it's a good reminder that if you place too much hope in the idea that code is speech and the First Amendment protects it, the law is decreasingly on your side. But there are other ways of protecting inquiry, information, knowledge, and truth.
eternallyradicalidea.com/