
I am willing to go out on a limb and say that openai will not be able to formalize “this ai will not murder you” in lean. If they try, they’ll just run into all of the old problems w gofai alignment people used to talk about in 1999 or whatever.
imo this is confused thinking; you can automate safety research while being able to verify the results and therefore not having handed off human oversight. in fact, our powers of formal verification will only grow the better we understand these systems






