This is probably as good a time as any to talk about what it's been like in the trenches the last 4-6 weeks. It's a topic i've been wanting to post about but wasn't sure how to approach it, so here it goes:
At this moment, anyone running any sort of substantial business, especially in crypto, is inundated with AI-enabled attacks. Abliterated models are running 24/7 against your entire surface, looking for a little crack, which they then use to (almost instantly) expand. This does not seem to be slowing down; rather, it's speeding up as models get better and more attackers enter the arena.
@luxor we have taken a very proactive approach. We acquired our own baremetal GPUs to run our own abliterated models and have made huge strides in our security posture. I urge anyone running a similar service to do the same. It's your only defense in this new AI-powered dark forest. "The only thing that stops a bad guy with a gun is a good guy with a gun."
We have put the majority of our new feature work on hold (which really sucks because we have some awesome new features that I am incredibly excited about) to harden every aspect of our infrastructure; rotating keys, updating kernels, pinning dependencies and responding to the daily feed of CVEs being disclosed. It is a necessary step that I'm sure most companies are already doing behind the scenes.
Again, i can't thank everyone enough for their support during this time. The @luxor engineers working round the clock and customers continuing to place their trust with us as we navigate this new world.
I'm optimistic about where the world is headed, but there will be a few bumps along the road.
The last 12 hours have been pretty rough
Around 6:00p PDT yesterday, a subset of Commander customers were compromised, through a sophisticated AI-enabled vector. We were able to identify and patch quickly so that it didn't continue, then the hard work of reverting started. Luxor will fully compensate clients that were affected; they will receive an email today with more details.
I apologize. You trust us with your fleet, and we need to be better. Commander is operating normally and no further action is needed. Thank you to your customers and partners for your continued support and thank you to the incredible @luxor engineers that stepped up to successfully fend this off quickly and cleanly.
This is true, and if you’re all in on Bitcoin and still in denial about this, you are willfully ignorant.
That said, I did say that if big players are planning to participate in the Anthropic IPO next week, we’d see a selloff in high-risk tech stocks and NVIDIA as they free up liquidity.
Which is exactly what we’re seeing.
What happens to Bitcoin on the other side of frontier AI acceleration is shaped by both the new technical reality these systems are creating and the insane speculative black hole that has formed around them.
it's time for you to wake up and smell the roses
there is no reality in which things continue smooth from here. no, bitcoin obviously isn't/wasn't going to stay put in some $70k - 80k range.
this is one of the most volatile eras ever. not just for bitcoin, but for the world. geopolitically, technologically, socially, we're going through rapid and dramatic change, and things aren't about to get simpler.
no, cybersecurity isn't going to all get fixed because you can now use ai to generate machine-checked security proofs in lean. even if you figure out how to write secure code and democratize the skill, there will still be vulnerabilities. if not bugs in the implementation, bugs in the specification. bugs in the assumptions, bugs in the verification.
cybersecurity will continue to be a verifiable domain, that's not changing, which means machines can self-play in it, meaning they can improve in it like in chess, except its actually worse than in chess because here the rules also keep changing, because technology keeps changing, so the gamefield keeps changing, meaning bugs will continue to be problematic, and especially problematic in irreversible systems (where one mistake means you get fully wiped out forever).
it's a hard system to keep stable! lean isn't coming to save you.
you'll continue to hear stories about how cybersecurity is about to improve and all the world's bugs will be fixed, because that is a popular narrative that tends to do well on twitter. no one wants to hear the defeatist point of view. but that means that some of you, who aren't able to figure this stuff out on your own, won't hear the truth very often.
smart people know this, not everyone agrees about it of course, but the negative point of view isn't going to get promoted on x/twitter.
the algorithms that are improving your life are about to learn how to improve themselves. the algorithms that are fucking with your life are about to learn how to improve themselves.
the situation now in which technology is about to enter a supersonic self-improving loop (a much more aggressive form than the baseline self-improving loop that we've been riding on since the dawn of time) is extremely bubble prone.
the prospect of investing in something *self-improving*? people will leverage themselves to the tits.
they will also be scared, flip-flop between being endlessly optimistic to extremely skittish and want security/safety. markets will be volatile. geopolitics will be volatile. everyone has the ability to react faster now, and there will be much more to react to.
no, crypto and bitcoin isn't going to stay non-volatile to that backdrop. the risk asset of risk assets, not even gold stays untroubled during turbulent times. it's going to be volatile. we spent a decade maturing as an industry. yes, we think we are owed some overdue maturity. we've aged through our teenage years and we're supposed to get rid of the acne. sorry, we're aging backwards now, you're going to get more acne and more bedtime erections, not less. the world isn't fair.
what you need to understand and accept is that bitcoin & crypto isn't this solid thing here. it's more of a moonshot thing again. it's a very digital thing in a world where everything digital is getting a shakedown.
you're almost 40 years old and your digital profession can be done by free open source software made in china run with a handcrank. your wife isn't going to let you gamble with your entire financial future in magical coins when you can't even tell her what your career prospects look like anymore. your beard is patchy.
bitcoin & crypto can still do well in this environment, because when technology, markets and geopolitics become ultra-volatile in unison, you're bound to also get weird market dislocations. you have arms races, you have bubbles popping, you might get lots of money printing. most things that can happen will happen.
but you aren't, as an industry, going to be a universal safe haven against this. no one really feels safe with their crypto assets these days. you got a hardware wallet? cool. that doesn't exactly feel like the safest of all places anymore.
you got your funds on an exchange? cool. doesn't feel great either, does it?
oh, but you're not impacted because you choose to hold your exposure through etps/etfs? well, if that's what you have to resolve to, that's not great either.
if you can't be secure with your crypto, if you can't feel safe with it, even though you're a freaking nerd in this industry, how does that bode for the industry at large?
much of the fuel that has driven e.g. defi to where it is today is because the risk was seen as tolerable. during 2020-2022 i knew a lot of people who felt okay with locking in hundreds of thousands of dollars in stablecoins in yield protocols. i don't know people who enjoy doing that today. people are tired of being bug bounties for north korea. they honestly prefer reversible systems for their life earnings.
this doesn't mean it is over for bitcoin & crypto, but it means you're going to have to accept that you may have to think about it differently. it is a diversified bet in your overall portfolio. it is a part of your portfolio. it can't be your entire portfolio.
if this sounds so bearish it sounds like the bottom signal to fully re-enter the market, sure. i'd love to become the pico-bottom perma-joke of our industry. i'm not saying for you to grow out of crypto, i'm saying for you to think of this as the volatile bet it is, the bet that macroeconomic/geopolitic turbulence/dislocations & fiat printing will outrank the fact that we're back in our teenage years again.
embrace that it will be volatile.
what's happening in the markets now is normal.
Eric lays out well the source of the first feeling of FUD in my gut in a long time that I was talking about yesterday.
We should all face the reality that the AI era has fundamentally changed the game for everything, including bitcoin. To stay numb to that fact falls somewhere on the spectrum between willful intellectual dishonesty and naive conviction.
I personally think bitcoin will survive this uncertainty and AI will make it better in the long run, it will help bitcoin achieve the best version of itself that will thrive in our brave new world. But I acknowledge the fact that AI is also the most potent threat to bitcoin we’ve ever faced. That’s the kind of clear-eyed conviction we should want to build.
Stay humble, pay attention, and be honest with yourself and others about what’s changed.
it's time for you to wake up and smell the roses
there is no reality in which things continue smooth from here. no, bitcoin obviously isn't/wasn't going to stay put in some $70k - 80k range.
this is one of the most volatile eras ever. not just for bitcoin, but for the world. geopolitically, technologically, socially, we're going through rapid and dramatic change, and things aren't about to get simpler.
no, cybersecurity isn't going to all get fixed because you can now use ai to generate machine-checked security proofs in lean. even if you figure out how to write secure code and democratize the skill, there will still be vulnerabilities. if not bugs in the implementation, bugs in the specification. bugs in the assumptions, bugs in the verification.
cybersecurity will continue to be a verifiable domain, that's not changing, which means machines can self-play in it, meaning they can improve in it like in chess, except its actually worse than in chess because here the rules also keep changing, because technology keeps changing, so the gamefield keeps changing, meaning bugs will continue to be problematic, and especially problematic in irreversible systems (where one mistake means you get fully wiped out forever).
it's a hard system to keep stable! lean isn't coming to save you.
you'll continue to hear stories about how cybersecurity is about to improve and all the world's bugs will be fixed, because that is a popular narrative that tends to do well on twitter. no one wants to hear the defeatist point of view. but that means that some of you, who aren't able to figure this stuff out on your own, won't hear the truth very often.
smart people know this, not everyone agrees about it of course, but the negative point of view isn't going to get promoted on x/twitter.
the algorithms that are improving your life are about to learn how to improve themselves. the algorithms that are fucking with your life are about to learn how to improve themselves.
the situation now in which technology is about to enter a supersonic self-improving loop (a much more aggressive form than the baseline self-improving loop that we've been riding on since the dawn of time) is extremely bubble prone.
the prospect of investing in something *self-improving*? people will leverage themselves to the tits.
they will also be scared, flip-flop between being endlessly optimistic to extremely skittish and want security/safety. markets will be volatile. geopolitics will be volatile. everyone has the ability to react faster now, and there will be much more to react to.
no, crypto and bitcoin isn't going to stay non-volatile to that backdrop. the risk asset of risk assets, not even gold stays untroubled during turbulent times. it's going to be volatile. we spent a decade maturing as an industry. yes, we think we are owed some overdue maturity. we've aged through our teenage years and we're supposed to get rid of the acne. sorry, we're aging backwards now, you're going to get more acne and more bedtime erections, not less. the world isn't fair.
what you need to understand and accept is that bitcoin & crypto isn't this solid thing here. it's more of a moonshot thing again. it's a very digital thing in a world where everything digital is getting a shakedown.
you're almost 40 years old and your digital profession can be done by free open source software made in china run with a handcrank. your wife isn't going to let you gamble with your entire financial future in magical coins when you can't even tell her what your career prospects look like anymore. your beard is patchy.
bitcoin & crypto can still do well in this environment, because when technology, markets and geopolitics become ultra-volatile in unison, you're bound to also get weird market dislocations. you have arms races, you have bubbles popping, you might get lots of money printing. most things that can happen will happen.
but you aren't, as an industry, going to be a universal safe haven against this. no one really feels safe with their crypto assets these days. you got a hardware wallet? cool. that doesn't exactly feel like the safest of all places anymore.
you got your funds on an exchange? cool. doesn't feel great either, does it?
oh, but you're not impacted because you choose to hold your exposure through etps/etfs? well, if that's what you have to resolve to, that's not great either.
if you can't be secure with your crypto, if you can't feel safe with it, even though you're a freaking nerd in this industry, how does that bode for the industry at large?
much of the fuel that has driven e.g. defi to where it is today is because the risk was seen as tolerable. during 2020-2022 i knew a lot of people who felt okay with locking in hundreds of thousands of dollars in stablecoins in yield protocols. i don't know people who enjoy doing that today. people are tired of being bug bounties for north korea. they honestly prefer reversible systems for their life earnings.
this doesn't mean it is over for bitcoin & crypto, but it means you're going to have to accept that you may have to think about it differently. it is a diversified bet in your overall portfolio. it is a part of your portfolio. it can't be your entire portfolio.
if this sounds so bearish it sounds like the bottom signal to fully re-enter the market, sure. i'd love to become the pico-bottom perma-joke of our industry. i'm not saying for you to grow out of crypto, i'm saying for you to think of this as the volatile bet it is, the bet that macroeconomic/geopolitic turbulence/dislocations & fiat printing will outrank the fact that we're back in our teenage years again.
embrace that it will be volatile.
what's happening in the markets now is normal.
it's time for you to wake up and smell the roses
there is no reality in which things continue smooth from here. no, bitcoin obviously isn't/wasn't going to stay put in some $70k - 80k range.
this is one of the most volatile eras ever. not just for bitcoin, but for the world. geopolitically, technologically, socially, we're going through rapid and dramatic change, and things aren't about to get simpler.
no, cybersecurity isn't going to all get fixed because you can now use ai to generate machine-checked security proofs in lean. even if you figure out how to write secure code and democratize the skill, there will still be vulnerabilities. if not bugs in the implementation, bugs in the specification. bugs in the assumptions, bugs in the verification.
cybersecurity will continue to be a verifiable domain, that's not changing, which means machines can self-play in it, meaning they can improve in it like in chess, except its actually worse than in chess because here the rules also keep changing, because technology keeps changing, so the gamefield keeps changing, meaning bugs will continue to be problematic, and especially problematic in irreversible systems (where one mistake means you get fully wiped out forever).
it's a hard system to keep stable! lean isn't coming to save you.
you'll continue to hear stories about how cybersecurity is about to improve and all the world's bugs will be fixed, because that is a popular narrative that tends to do well on twitter. no one wants to hear the defeatist point of view. but that means that some of you, who aren't able to figure this stuff out on your own, won't hear the truth very often.
smart people know this, not everyone agrees about it of course, but the negative point of view isn't going to get promoted on x/twitter.
the algorithms that are improving your life are about to learn how to improve themselves. the algorithms that are fucking with your life are about to learn how to improve themselves.
the situation now in which technology is about to enter a supersonic self-improving loop (a much more aggressive form than the baseline self-improving loop that we've been riding on since the dawn of time) is extremely bubble prone.
the prospect of investing in something *self-improving*? people will leverage themselves to the tits.
they will also be scared, flip-flop between being endlessly optimistic to extremely skittish and want security/safety. markets will be volatile. geopolitics will be volatile. everyone has the ability to react faster now, and there will be much more to react to.
no, crypto and bitcoin isn't going to stay non-volatile to that backdrop. the risk asset of risk assets, not even gold stays untroubled during turbulent times. it's going to be volatile. we spent a decade maturing as an industry. yes, we think we are owed some overdue maturity. we've aged through our teenage years and we're supposed to get rid of the acne. sorry, we're aging backwards now, you're going to get more acne and more bedtime erections, not less. the world isn't fair.
what you need to understand and accept is that bitcoin & crypto isn't this solid thing here. it's more of a moonshot thing again. it's a very digital thing in a world where everything digital is getting a shakedown.
you're almost 40 years old and your digital profession can be done by free open source software made in china run with a handcrank. your wife isn't going to let you gamble with your entire financial future in magical coins when you can't even tell her what your career prospects look like anymore. your beard is patchy.
bitcoin & crypto can still do well in this environment, because when technology, markets and geopolitics become ultra-volatile in unison, you're bound to also get weird market dislocations. you have arms races, you have bubbles popping, you might get lots of money printing. most things that can happen will happen.
but you aren't, as an industry, going to be a universal safe haven against this. no one really feels safe with their crypto assets these days. you got a hardware wallet? cool. that doesn't exactly feel like the safest of all places anymore.
you got your funds on an exchange? cool. doesn't feel great either, does it?
oh, but you're not impacted because you choose to hold your exposure through etps/etfs? well, if that's what you have to resolve to, that's not great either.
if you can't be secure with your crypto, if you can't feel safe with it, even though you're a freaking nerd in this industry, how does that bode for the industry at large?
much of the fuel that has driven e.g. defi to where it is today is because the risk was seen as tolerable. during 2020-2022 i knew a lot of people who felt okay with locking in hundreds of thousands of dollars in stablecoins in yield protocols. i don't know people who enjoy doing that today. people are tired of being bug bounties for north korea. they honestly prefer reversible systems for their life earnings.
this doesn't mean it is over for bitcoin & crypto, but it means you're going to have to accept that you may have to think about it differently. it is a diversified bet in your overall portfolio. it is a part of your portfolio. it can't be your entire portfolio.
if this sounds so bearish it sounds like the bottom signal to fully re-enter the market, sure. i'd love to become the pico-bottom perma-joke of our industry. i'm not saying for you to grow out of crypto, i'm saying for you to think of this as the volatile bet it is, the bet that macroeconomic/geopolitic turbulence/dislocations & fiat printing will outrank the fact that we're back in our teenage years again.
embrace that it will be volatile.
what's happening in the markets now is normal.
it's time for you to wake up and smell the roses
there is no reality in which things continue smooth from here. no, bitcoin obviously isn't/wasn't going to stay put in some $70k - 80k range.
this is one of the most volatile eras ever. not just for bitcoin, but for the world. geopolitically, technologically, socially, we're going through rapid and dramatic change, and things aren't about to get simpler.
no, cybersecurity isn't going to all get fixed because you can now use ai to generate machine-checked security proofs in lean. even if you figure out how to write secure code and democratize the skill, there will still be vulnerabilities. if not bugs in the implementation, bugs in the specification. bugs in the assumptions, bugs in the verification.
cybersecurity will continue to be a verifiable domain, that's not changing, which means machines can self-play in it, meaning they can improve in it like in chess, except its actually worse than in chess because here the rules also keep changing, because technology keeps changing, so the gamefield keeps changing, meaning bugs will continue to be problematic, and especially problematic in irreversible systems (where one mistake means you get fully wiped out forever).
it's a hard system to keep stable! lean isn't coming to save you.
you'll continue to hear stories about how cybersecurity is about to improve and all the world's bugs will be fixed, because that is a popular narrative that tends to do well on twitter. no one wants to hear the defeatist point of view. but that means that some of you, who aren't able to figure this stuff out on your own, won't hear the truth very often.
smart people know this, not everyone agrees about it of course, but the negative point of view isn't going to get promoted on x/twitter.
the algorithms that are improving your life are about to learn how to improve themselves. the algorithms that are fucking with your life are about to learn how to improve themselves.
the situation now in which technology is about to enter a supersonic self-improving loop (a much more aggressive form than the baseline self-improving loop that we've been riding on since the dawn of time) is extremely bubble prone.
the prospect of investing in something *self-improving*? people will leverage themselves to the tits.
they will also be scared, flip-flop between being endlessly optimistic to extremely skittish and want security/safety. markets will be volatile. geopolitics will be volatile. everyone has the ability to react faster now, and there will be much more to react to.
no, crypto and bitcoin isn't going to stay non-volatile to that backdrop. the risk asset of risk assets, not even gold stays untroubled during turbulent times. it's going to be volatile. we spent a decade maturing as an industry. yes, we think we are owed some overdue maturity. we've aged through our teenage years and we're supposed to get rid of the acne. sorry, we're aging backwards now, you're going to get more acne and more bedtime erections, not less. the world isn't fair.
what you need to understand and accept is that bitcoin & crypto isn't this solid thing here. it's more of a moonshot thing again. it's a very digital thing in a world where everything digital is getting a shakedown.
you're almost 40 years old and your digital profession can be done by free open source software made in china run with a handcrank. your wife isn't going to let you gamble with your entire financial future in magical coins when you can't even tell her what your career prospects look like anymore. your beard is patchy.
bitcoin & crypto can still do well in this environment, because when technology, markets and geopolitics become ultra-volatile in unison, you're bound to also get weird market dislocations. you have arms races, you have bubbles popping, you might get lots of money printing. most things that can happen will happen.
but you aren't, as an industry, going to be a universal safe haven against this. no one really feels safe with their crypto assets these days. you got a hardware wallet? cool. that doesn't exactly feel like the safest of all places anymore.
you got your funds on an exchange? cool. doesn't feel great either, does it?
oh, but you're not impacted because you choose to hold your exposure through etps/etfs? well, if that's what you have to resolve to, that's not great either.
if you can't be secure with your crypto, if you can't feel safe with it, even though you're a freaking nerd in this industry, how does that bode for the industry at large?
much of the fuel that has driven e.g. defi to where it is today is because the risk was seen as tolerable. during 2020-2022 i knew a lot of people who felt okay with locking in hundreds of thousands of dollars in stablecoins in yield protocols. i don't know people who enjoy doing that today. people are tired of being bug bounties for north korea. they honestly prefer reversible systems for their life earnings.
this doesn't mean it is over for bitcoin & crypto, but it means you're going to have to accept that you may have to think about it differently. it is a diversified bet in your overall portfolio. it is a part of your portfolio. it can't be your entire portfolio.
if this sounds so bearish it sounds like the bottom signal to fully re-enter the market, sure. i'd love to become the pico-bottom perma-joke of our industry. i'm not saying for you to grow out of crypto, i'm saying for you to think of this as the volatile bet it is, the bet that macroeconomic/geopolitic turbulence/dislocations & fiat printing will outrank the fact that we're back in our teenage years again.
embrace that it will be volatile.
what's happening in the markets now is normal.
With @Lighter_xyz, we are poised to protect $800M in assets onchain.
Excited to work with teams who are investing in independent security layers to protect contract upgrades and withdrawals.
Today, 1 in 2 Ethereum blocks will be protected.
With Phylax, apps can set circuit breakers that Titan Builder enforces at block construction, excluding transactions that violate app-defined rules before settlement.
It's a simple idea: hacks should not settle.
incredibly stoked to see @AbdelStark go in this direction
it’s becoming increasingly clear that ai verification tech is becoming one of the main pillars on which international treaties will be built
immensely excited to see what he can build at @LucidCompute w/ @Kristian_Ronn
Some personal news: I joined Lucid Computing (@LucidCompute) as Director of Research Partnerships & Standards.
My core focus will be to help foster more open source collaboration across the AI verification ecosystem, between the many teams working on similar / adjacent topics and pieces of technology.
I am so excited to finally be able to share this next chapter of my career. As I posted recently, I have been completely obsessed with AI safety.
It accelerated in March this year, when @ercwl put me in a group chat with @Kristian_Ronn. At the time, I was actively exploring the use of Zero Knowledge Proofs for critical AI use cases (mostly in insurance, defense, healthcare and robotics).
We immediately had great vibes together. We shared the same vision and the same enthusiasm, and we both saw AI safety as the most important thing humanity could work on.
Since then, I have met Greg, Lucid’s co-founder and CTO, and it was the same kind of connection, the same feeling of a shared vision and mission. And everyone I have met at Lucid since I joined is the same kind of person: talented, mission driven, and with a deep willingness to have a real impact with our work.
It’s a real honor to join them all on this epic journey.
I genuinely believe that cryptography and math are our only hope of avoiding a dystopian, totalitarian world with massive concentration of power, gatekeeping of intelligence, and abuse in many forms.
The beauty of cryptography and math, and Zero Knowledge Proofs in particular, is that they are tools that can break the asymmetry of power. This is precisely what we need for AI right now.
We also need solutions designed for the most adversarial conditions possible, including resisting superpowerful nation-state actors. That’s the only way to aim for credible international treaties to “pace AI”.
The threats and risks are immense, and AI safety is probably the greatest challenge humanity has ever faced. Despite that, I am hopeful, and I remain optimistic that we still have the power to change course. This will inevitably require cooperation and collaboration at many levels.
From what I have seen, there is a strong appetite for more open source collaboration in the AI verification ecosystem. That’s a great starting point, and I have high hopes that we can stimulate and nurture a very healthy, collaborative environment, with no zero-sum mentality.
We need to join forces, more than ever.
The space is way too small today. It will have to grow massively over the coming months, and I am sure it will. That makes it even more important to build solid foundations and a strong culture in the ecosystem, so it can grow and scale the right way.
I will do my very best to help build that collaborative environment. I love building in public, I am an open source maxi, and I am used to working with many entities across distributed ecosystems.
The topics and primitives where I will focus and facilitate open source collaboration:
- ZK for provable inference
- Proof of exhaustion schemes
- Workload classification, via different techniques
- Hardware roots of trust, TEEs, hardware formal verification
- Formal verification
If you are working on any of these in AI verification, I would love to connect and see how we can join forces on our shared mission.
If you are not working on AI verification (or AI safety more broadly): first, you are missing out. Second, we need you. We need a lot more talent working on these problems.
Lastly, I will work on public communication and educational material about AI verification and our work at Lucid. More on this very soon.
Follow @LucidCompute and @Kristian_Ronn, and stay tuned.
Let's build AI using tech to make it more verifiable and safer!
Some personal news: I joined Lucid Computing (@LucidCompute) as Director of Research Partnerships & Standards.
My core focus will be to help foster more open source collaboration across the AI verification ecosystem, between the many teams working on similar / adjacent topics and pieces of technology.
I am so excited to finally be able to share this next chapter of my career. As I posted recently, I have been completely obsessed with AI safety.
It accelerated in March this year, when @ercwl put me in a group chat with @Kristian_Ronn. At the time, I was actively exploring the use of Zero Knowledge Proofs for critical AI use cases (mostly in insurance, defense, healthcare and robotics).
We immediately had great vibes together. We shared the same vision and the same enthusiasm, and we both saw AI safety as the most important thing humanity could work on.
Since then, I have met Greg, Lucid’s co-founder and CTO, and it was the same kind of connection, the same feeling of a shared vision and mission. And everyone I have met at Lucid since I joined is the same kind of person: talented, mission driven, and with a deep willingness to have a real impact with our work.
It’s a real honor to join them all on this epic journey.
I genuinely believe that cryptography and math are our only hope of avoiding a dystopian, totalitarian world with massive concentration of power, gatekeeping of intelligence, and abuse in many forms.
The beauty of cryptography and math, and Zero Knowledge Proofs in particular, is that they are tools that can break the asymmetry of power. This is precisely what we need for AI right now.
We also need solutions designed for the most adversarial conditions possible, including resisting superpowerful nation-state actors. That’s the only way to aim for credible international treaties to “pace AI”.
The threats and risks are immense, and AI safety is probably the greatest challenge humanity has ever faced. Despite that, I am hopeful, and I remain optimistic that we still have the power to change course. This will inevitably require cooperation and collaboration at many levels.
From what I have seen, there is a strong appetite for more open source collaboration in the AI verification ecosystem. That’s a great starting point, and I have high hopes that we can stimulate and nurture a very healthy, collaborative environment, with no zero-sum mentality.
We need to join forces, more than ever.
The space is way too small today. It will have to grow massively over the coming months, and I am sure it will. That makes it even more important to build solid foundations and a strong culture in the ecosystem, so it can grow and scale the right way.
I will do my very best to help build that collaborative environment. I love building in public, I am an open source maxi, and I am used to working with many entities across distributed ecosystems.
The topics and primitives where I will focus and facilitate open source collaboration:
- ZK for provable inference
- Proof of exhaustion schemes
- Workload classification, via different techniques
- Hardware roots of trust, TEEs, hardware formal verification
- Formal verification
If you are working on any of these in AI verification, I would love to connect and see how we can join forces on our shared mission.
If you are not working on AI verification (or AI safety more broadly): first, you are missing out. Second, we need you. We need a lot more talent working on these problems.
Lastly, I will work on public communication and educational material about AI verification and our work at Lucid. More on this very soon.
Follow @LucidCompute and @Kristian_Ronn, and stay tuned.
Let's build AI using tech to make it more verifiable and safer!
I don’t buy this.
Yes, the charitable read is that constant attacking/defending leads to an overall more hardened structure. I think everyone can feel how that makes intuitive sense.
But, I’d draw an analogy between this and Kelly betting. Everyone knows you don’t want to make repeated bets with full risk of ruin. The problem with cybersecurity and cryptocurrency is that due to the irreversible nature of transactions, you’re always in a ”risk of ruin”-like environment. If you have an automated warfare cybersecurity environment, I’d wager that your risk of ruin is actually higher, even if the ”probability of penetration per attempt” is lower.
The fact that every possible exploit at every protocol at all times is constantly attempted… across the whole stack, at every layer… like, it’s possible that some Lindy applications like the Bitcoin baselayer would be more secure in this way. But for anything dynamic that goes through changes (e.g. Lightning, anything smart contract/upgradeable layer) the chance of an irreversible fault overall seems higher.
Bobbin's Threadbare @bobbinth Oct 26 Article Miden Partner Mainnet: What We’ve Built and What Comes Next Today, we are launching Miden’s partner mainnet. This is a culmination of over five years of work and I am very proud of what the team has built. But, in many ways, we are still at the beginning of