←
Jaden Wang117 posts
Jaden Wang avatar

Jaden Wang

@jadenswang

OpenRelay

◷ Joined March 2018▧ 16 Photos and videos
Jaden Wang avatar
Jaden Wang@jadenswang·Nov 12

The future of inference isn't everyone renting the same GPUs from neocloud training clusters. We're building a vertically integrated inference delivery network to change that. Just raised $10M led by @uncorkcap with participation from @EniacVC and @Standard_Cap . Time to build.

Post attachment
Jaden Wang avatar
Jaden Wang@jadenswang·Nov 3

“I will mortgage my mother to get nodes at this price” — Ben Koska

if you are selling B300s no commit at $5/hr, I will literally take up to 1000 nodes

Jaden Wang avatar
Jaden Wang@jadenswang·Nov 3

The dichotomy of man.

a single GPU now makes more than the federal minimum wage of $7.25/hr fucked up to say, but isn't that a sign of compute being underpriced? one B300 produces much more value than a minimum wage human ☹️

Jaden Wang avatar
Jaden Wang@jadenswang·Nov 2

People are not properly vetting their suppliers. Vendor risk underwriting is a startup killer. There are so many 25% down 5 year commitments made with companies who have never deployed a node in their lives.

Jaden Wang avatar
Jaden Wang@jadenswang·Oct 12

Every day @OpenRelayInc we work to drive token prices into the ground

Inference is the second way to raise a massive round right now. After the labs, you can still justify massive rounds by pointing at data centers and compute, which means more inference companies keep getting funded even as the underlying product stays extremely easy to switch away from. On the flip side, many neolabs are also renting out their own compute, adding yet another source of supply into the same market. Companies that tried to verticalize around batch workloads and post-training are now pivoting back to "pure inference" and joining the same undercutting cycle. The result is a permanent reverse auction: providers undercut each other over and over: half off Fireworks, half off Baseten, 10% cheaper GLM or Kimi—and every new entrant or neolab offering capacity just accelerates the cheaper pricing At the same time, app companies have so much choice right now that they can bake off and compete prices down extremely hard. They move millions of run-rate spend overnight whenever a meaningfully cheaper option appears, because the technical switching cost is essentially "one line of code". That combination: easy capital, extra compute from neolabs, low stickiness, and continuous price pressure makes inference one of the less defensible layers in the stack even as it continues to attract large valuations. However, if you are a smart team of infra people, it is the easiest way to raise 100M seed after a neolab Researchers: neolab <> engineers: inference

William Lindholm🎂 avatar
⟳ Jaden Wang retweeted
William Lindholm🎂@daymakerguy·Aug 19

I’m deadass giving out free cakes to absolutely anyone who wants it next tuesday. 100 cakes, i want to blow up X. Who wants a cake?

Post attachment