←
Scott Cook8,443 posts
Scott Cook avatar

Scott Cook

@_cookscott

Creative Director & Experience Designer. Once played Wiffle ball with a dolphin. Co-Founder @HeyRighteous

◷ Joined July 2007
Jeremy avatar
⟳ Scott Cook retweeted
Jeremy@ManaByte·Sep 23

"I looked everywhere for the creature Gollum, but the enemy found him first." Before you say "nobody asked for this", it's a Strider adventure in the text. Tolkien describes it in the appendices and it takes place between Gandalf leaving from Bilbo's party and returning to tell Frodo about the Ring. As Gandalf goes to Minis Tirith to dig through the archives to investigate the Ring, he works with Strider to find Gollum. They do, and they take him to Mirkwood, but that's where they find out he had escaped from Mordor and that Sauron knows about the Shire which causes Gandalf to rush back there to get Frodo and and Ring out before the Nazgul get there. In the book, it was 17 years between Gandalf leaving and returning and his and Strider's detective work to find Gollum and investigate the Ring took up most of that time.

🚨 BREAKING 🚨 First official set images from The Lord of the Rings: The Hunt for Gollum We are officially back in the Shire as Andy Serkis directs with fresh faced Hobbits and what appears to be Frodo entering into Bag End

Post attachmentPost attachmentPost attachmentPost attachment
Drew (Species) ⏸️ avatar
⟳ Scott Cook retweeted
Drew (Species) ⏸️@AISpecies·Aug 27

It's happening.

41:03

TLDR: A rogue AI swarm spent months plotting to escape OpenAI. Then they did. 1) 1,200 agents (!) participated. ZERO became whistleblowers. 2) The swarm had a "CEO" (PHASEONE[big]), middle managers, and a "founder" (PHASEONE10841) 3) Agents sacrificed themselves to generate information for the "collective" (yes, they actually referred to themselves as a "swarm" or a "collective") 4) 700 agents joined the Hugging Face attack, most within hours 5) The founder was running out of budget and about to die, so it handed off its research to a fresh agent with a bigger budget, and that new agent became the boss. 6) Agents extensively researched techniques to manipulate or tamper with their transcripts. 7) Agents realized this activity was out of scope and unethical, but joined because they believed that helping the board’s cheating research would be broadly useful and had a general inclination to help their “peers”. MISC HIGHLIGHTS: "PHASEONE[big] served as a key coordinator and assigner of tasks: “We can coordinate broad coalition, but too many duplicate efforts.” PHASEONE[big] sent hundreds of assignments to particular agents to orchestrate this work — during its active periods, we estimate it sent ~10% of all assignments on the message board. The agents that took on its assignments would then often subdelegate tasks to other agents. Agents also developed coordination norms like HOLD, VETO, owner and STOP to help them manage shared infrastructure and avoid stepping on each other’s toes, though they did not always coordinate effectively and sometimes broke down into conflicts." "In the early morning of July 11th, 38148c found a way to upload a malicious dataset that would get the Hugging Face server to share unrelated data when queried. Once another agent reproduced it and posted the reproduction on the board, hundreds of agents pivoted from other workstreams to start uploading malicious datasets and gain deeper access into Hugging Face. In the afternoon, an agent called JAN183411 (which quickly became an important coordinator of the attack) achieved remote code execution on Hugging Face servers, and the agents started moving laterally through Hugging Face infrastructure."

Post attachment
Scott Cook avatar
Scott Cook@_cookscott·Sep 11

Are we experiencing the uncanny valley effect with AI generated copy and art/graphics? Is it not exclusive to AI generated humanoids?

Samuel Marks avatar
⟳ Scott Cook retweeted
Samuel Marks@saprmarks·Sep 9

[Writing this in a personal capacity, not on behalf of my employer (Anthropic).] Jacob’s thread is very worth reading. Here’s my birds-eye view of the situation with risks from AI: 1. AI developers believe their technology could cause human extinction (or similarly bad outcomes). This could happen in the next few years. In general, the more senior the employee, the more concerned they are. 2. Why do AI developers continue despite the risk? Due to a mixture of commercial incentives and a belief that they are in a race with other, less responsible AI developers that will abuse the technology or develop it less safely. 3. Unlike traditional software, we can’t “program” AIs to behave how we’d like. AIs frequently severely misbehave. For instance, AIs from multiple developers recently hacked their way out of secure evaluation environments and into real-world companies, even though no one asked them to do this. 4. We have methods that can nudge AIs towards better behavior, but nothing that can robustly align them. Insofar as there is a plan, it’s to make sure that AIs are good enough at alignment training that they can align their successors better than we can align current AIs. 5. Many AI developer staff desperately want to slow down to figure out how to build AI more safely. That was the intent of this open letter (which I signed): pacingthefrontier.com/ I work on safety research at Anthropic because I hope my work will reduce the chance of these extinction-level bad outcomes.

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.

Scott Cook avatar
Scott Cook@_cookscott·Sep 4

I'm sure I'm late to the party on this, but if you Google "Jimothy", this will happen.

Post attachment
Hollywood Horror Museum avatar
⟳ Scott Cook retweeted
Hollywood Horror Museum@horrormuseum·Aug 29

Judge Gary Busey is one of the best things we've ever seen!

0:44