
Free alpha Saturday, and a glimpse into one of the many real, underappreciated engineering problems facing compute markets. TLDR: compute markets literally can't work when you have to trust rando suppliers with access to all your data. Let's fix. 🧠


Co-Founder & CTO @get_hydrahost, NVIDIA backed | @getpeerd | b/acc | compute/acc | AI infrastructure & compute markets | substack.com/@arieldeschapel…

Free alpha Saturday, and a glimpse into one of the many real, underappreciated engineering problems facing compute markets. TLDR: compute markets literally can't work when you have to trust rando suppliers with access to all your data. Let's fix. 🧠


What if, and hear me out, the US simply produced superior open source models.
SITUATION DETECTED: The White House and Treasury are discussing a proposal that would require US companies to publicly disclose the use of Chinese open-weight AI models on their websites, aiming to discourage their use through public pressure, per Reuters.

😂
I love seeing @Apple dropping an open video model on HF, but why it works on CUDA only by default? Next time can we add a dedicated inference engine running on Apple Silicon? Please @johnternus 🙏 huggingface.co/apple/FastFra…

Crazy this needs to be said, but engineering is the heart and soul of any tech company. That’s what Jensen inately understood and got right. Everything else is a supporting function, and none of it matters if you don’t have the best product possible and the engineering culture to continue producing the best products. You give in to the belief that your best engineers and engineering leadership is easily replaceable at your own peril.

When we started working with data centers 5 years ago, we quickly realized the modern AI datacenter needed an entirely new software stack. Provisioning, multi tenancy user management, web portal and api, billing, all tightly integrated. We built it for ourselves. Now we’re going to give it away to the industry. Cheers!
Today we’re open sourcing Hydra OS™ (formerly Brokkr OS), the AI factory operating system we’ve spent five years building and running in production across 50+ data centers. Every neocloud and data center operator has had to solve the same problems from scratch: server onboarding, provisioning, monitoring, tenant lifecycle. That takes years of development and a full engineering team across disciplines. Hydra OS gives operators a production-proven operating layer on day one, with everything accessible through a single API. The repository, documentation, and installable release will be available on GitHub on November 30 under the Apache 2.0 license. Read the announcement: hydrahost.com/post/introduci… #HydraHost #HydraOS #OpenSource #AIfactory

Few
"If you wish to fire your CEO, here I am."

It’s imperative for human civilization that ignorant losers who have built nothing are shunned and ignored.
What SpaceX did today is the normal consequence of applying capital and engineering to any industry. You get better at it. Musk isn't a genius, he's just a guy who can get capital from Wall Street. Maybe that's unique right now, but it's not the skill his fanboys think it is.

The biggest value LLMs provide is the ability to help you quickly and cheaply explore this limitless design space.
Moore's Law could have ended decades ago and we could still mine the software problem until the end of time. There are more possible strings of 32 bytes than atoms in the universe. A billion years from now there will still be undiscovered 1000 line programs with revolutionary value. We often like to think we're limited by hardware, but only because that limit is easy to quantify. It's far harder to quantify what's in the infinite unmapped regions of the Library of Babel, so we vastly underestimate it. Our biggest limits all lie in our knowledge and imagination of software and information.

"Why is it that we don't come up with a regulation that's more balanced so that NVIDIA can win around the world instead of giving up the world? Why would you want the United States to give up the world?…The premise that even if we competed in China, that we're going to lose that market anyways. You're not talking to somebody who woke up a loser. That loser attitude, that loser premise makes no sense to me…Victimising them, turning them into an enemy, likely isn't the best answer. They are an adversary. We want the United States to win. But I think having a dialogue and having research dialogue is probably the safest thing to do.” - Jensen from a few months ago. So which seems reasonable and grounded who doesn’t?

Every modern Apple device is many times more powerful than the Xbox 360 and even Xbox One in most cases.
RTX 5090 is whopping 104.8 TFLOPS FP32 and 1.79 TB/s VRAM bandwidth. That’s 433x more ALU and 80x more bandwidth (plus memory compressors) vs Xbox 360, the first HD/PBR capable console. We could achieve so much more with today’s hardware.

Similarly, about a year and a half ago I decided to randomly cold email Jensen. Candidly, I had become frustrated after seeing minimal progress getting someone in the NVIDIA organization to care about our work for almost 12 months. Jensen responded the next morning. I was immediately invited out to NVIDIA HQ, and our rep was suddenly getting bombarded with questions about us. Complete re-prioritization in an instant. Fast forward another year and @get_hydrahost became an NVIDIA backed company.
epitome of founder mode this man jensen huang is IRREPLACEABLE

First it was Jensen, and now these bastards are coming after Hugging Face, using uncensored models as their excuse. Stop trying to take away our sovereignty.
In other bad news for Nvidia: @stokel found that Hugging Face, which Nvidia recently agreed to acquire, appears to be hosting a load of models that could be used for cyber attacks. transformernews.ai/p/hugging…

Oops?
US Justice Department has not concluded Alice Huang was Chinese spy, Blanche says reut.rs/4zdZ3HV

Happy for @get_hydrahost to sponsor
It was an honor having the opportunity to share dinner, speak with and deliver some local compute to President @nayibbukele El Salvador is truly leading the way in creating an environment for innovation, enabling builders to deploy while protecting their freedoms. Thank you @nvidia and @get_hydrahost for entrusting me to deliver this gift.

the solution to the war on open source is to be brave and open source things

Same. I have a skill that checks HF for the most valuable and the most likely to disappear datasets and model files and downloads them to my NAS.