


OpenRelay





The future of inference isn't everyone renting the same GPUs from neocloud training clusters. We're building a vertically integrated inference delivery network to change that. Just raised $10M led by @uncorkcap with participation from @EniacVC and @Standard_Cap . Time to build.

“I will mortgage my mother to get nodes at this price” — Ben Koska
if you are selling B300s no commit at $5/hr, I will literally take up to 1000 nodes

The dichotomy of man.
a single GPU now makes more than the federal minimum wage of $7.25/hr fucked up to say, but isn't that a sign of compute being underpriced? one B300 produces much more value than a minimum wage human ☹️

People are not properly vetting their suppliers. Vendor risk underwriting is a startup killer. There are so many 25% down 5 year commitments made with companies who have never deployed a node in their lives.


And it’s ever increasing. @OpenRelayInc has been providing short term B300s to YC companies and we were S26.
*Over $11.5M in perks and deals btw


Every day @OpenRelayInc we work to drive token prices into the ground
Inference is the second way to raise a massive round right now. After the labs, you can still justify massive rounds by pointing at data centers and compute, which means more inference companies keep getting funded even as the underlying product stays extremely easy to switch away from. On the flip side, many neolabs are also renting out their own compute, adding yet another source of supply into the same market. Companies that tried to verticalize around batch workloads and post-training are now pivoting back to "pure inference" and joining the same undercutting cycle. The result is a permanent reverse auction: providers undercut each other over and over: half off Fireworks, half off Baseten, 10% cheaper GLM or Kimi—and every new entrant or neolab offering capacity just accelerates the cheaper pricing At the same time, app companies have so much choice right now that they can bake off and compete prices down extremely hard. They move millions of run-rate spend overnight whenever a meaningfully cheaper option appears, because the technical switching cost is essentially "one line of code". That combination: easy capital, extra compute from neolabs, low stickiness, and continuous price pressure makes inference one of the less defensible layers in the stack even as it continues to attract large valuations. However, if you are a smart team of infra people, it is the easiest way to raise 100M seed after a neolab Researchers: neolab <> engineers: inference


I’m deadass giving out free cakes to absolutely anyone who wants it next tuesday. 100 cakes, i want to blow up X. Who wants a cake?

Corporate wants you to find the difference between these two pictures @prashant8124

Why are there no 24/7 @ChipotleTweets locations