←
Reynold Xin2,639 posts
Reynold Xin avatar

Reynold Xin

@rxin

Cofounder @Databricks

◷ Joined November 2008▧ 50 Photos and videos
Reynold Xin avatar
Reynold Xin@rxin·Jul 1

I find the Lakebase design for serverless Postgres very elegant, so I spent some time explaining how it works in this blog. The blog starts by explaining how databases really persist data (with a write-ahead-log and data files that are updated async), and how Lakebase separates storage and compute by externalizing those two components. It ends with how the Lakebase architecture naturally leads to LTAP, enabling OLTP and analytical workloads against a single governed copy of data. My goal was to make it readable by anyone curious about how these systems work, not just database and storage experts. That turned out to be a lot more challenging than I first thought. Database storage is one of the most complex areas in computer science (the ARIES paper cited in blog was the hardest paper I personally ever had to read). The first draft had too little detail and I couldn't land the ideas. The second had too much and I'd lost anyone who isn't already a storage expert. This is the third draft, and I'd love feedback on whether the depth feels right. databricks.com/blog/lakebase…

Patrick Wendell avatar
⟳ Reynold Xin retweeted
Patrick Wendell@pwendell·Nov 16

1/ Today we’re publishing the Databricks AI Index, showing trends from enterprises who manage AI with our Unity Gateway. Data covers >10,000 companies with broad representation (Digital Natives, Fortune 500, Global 2000, etc...). Enterprise AI consumption is changing quite a bit:

Post attachment
Neon avatar
⟳ Reynold Xin retweeted
Neon@neondatabase·Nov 13

Tonight the Postgres security team released minor version updates patching 52 CVEs in Postgres. Neon and Databricks customers were running patched versions within 30 minutes thanks to Lakebase architecture and our Postgres engineering team. Always-on computes will get the updates on next restart. neon.com/docs/postgresql/pos…

Post attachmentPost attachment
Ali Ghodsi avatar
⟳ Reynold Xin retweeted
Ali Ghodsi@alighodsi·Nov 11

Day 0 launch of Claude Fable 5.2 on @databricks! You can just get the tokens from Unity Gateway on Databricks.

Claude Fable 5.2 lands on Databricks on Day 0. Built for coding, finance and science, it sets a new high on our OfficeQA Pro v2 benchmark. Run long-running agents on governed data, with Unity Gateway controlling calls across 70+ models.

Ali Ghodsi avatar
⟳ Reynold Xin retweeted
Ali Ghodsi@alighodsi·Oct 28

I don't think we should fight. The two companies are complementary. Since you're not doing this AI stuff, I really think Snowflake should consider getting its AI tokens through Databricks. You can get both cheap OSS models as well as frontier (OAI/Ant/Gemini/Grok) models from our platform. It all goes through Unity Gateway which has Smart Routing, Budgets, and Access Control. You can even use Omnigent with any harness, including CoCo. Most of our customers used this to reduce token spend ~30% last few months while token count went up. Genie lets you then track, control, manage that spend, all your financials, marketing, etc. Quick POC?

Hyperbolic avatar
⟳ Reynold Xin retweeted
Hyperbolic@hyperbolic_labs·Oct 27

We’ve raised an oversubscribed $30M Series A1 led by @walden_catalyst to build the Global Compute Grid. We’re turning fragmented GPU capacity into one unified platform where AI teams can access, manage, sell, and orchestrate compute. Our mission: make the world’s compute unified, productive and liquid.

2:51
Reynold Xin avatar
Reynold Xin@rxin·Oct 23

No wonder Apple is a 5 trillion dollar company. UPS delivery guy: "Are you waiting by the door for this?" me: "Yes!" him: "I never run into people when I deliver, but on iPhone release date, everybody is home waiting."

Nikita | Scaling Lakebase Postgres avatar
⟳ Reynold Xin retweeted
Nikita | Scaling Lakebase Postgres@nikitabase·Oct 19

Can a single database architecture satisfy both vibe-coded and large scale enterprise apps? The same approach makes small database ultra cheap to run and branch can also make a large one faster and easier to operate. We call this architecture Lakebase.

Sam Willis avatar
⟳ Reynold Xin retweeted
Sam Willis@samwillis·Oct 18

Any SQL query, reactively kept up to date on front end. And is so so simple to use, even and agent can do it! -- Six years ago I was building an app, and thought "wouldn't it be so much easer if we could just subscribe to a query on the front end". That started my journey through Local First, lead to joining @ElectricSQL, where we built multiple Sync Engines, PGlite and @tan_stack DB. We finally achieved that goal with @neondatabase Realtime. Perfect thing for a side project, give it a go! neon.com/blog/neon-now-has-r…

Raunak avatar
⟳ Reynold Xin retweeted
Raunak@capsraunak·Oct 16

neon gives all these apart from just postgres database now

Post attachment
Reynold Xin avatar
Reynold Xin@rxin·Oct 15

Built by the Electric team (who also did pglite, i.e. Postgres on WASM), Neon Realtime is an incremental query engine to make it dramatically easier to build apps that sync data in realtime. It leverages the Lakebase architecture's separation of storage and compute to run on a separate compute instance. This avoids overwhelming the primary write Postgres instance and pushes the write operations incrementally to all the subscribers. Check it out. You can now build complex realtime sync apps in just a few lines of code. This is a great example of how hardcore database technologies can make the app developers' lives much simpler.

Neon now has realtime, built by the team behind Electric. Turn any SQL query into a live query, joins and aggregates included. All inside Postgres, and ready for agents. It’s in public beta and available in all Neon plans. Give it a try and tell us what you think!

0:06
Reynold Xin avatar
Reynold Xin@rxin·Oct 12

❤️

Yeah this happened. You've been listening to me tweet public love letters to object storage for a while, so it should come as no surprise that we're joining the best object-native product around: Databricks Lakebase.

Reynold Xin avatar
Reynold Xin@rxin·Oct 12

Super excited to welcome the Responsive team to @Databricks/@neondatabase to help take Lakebase Postgres to the next level. The best database is a lakebase!

I’m excited to announce that Responsive has been acquired by Databricks to accelerate the development of Lakebase and Neon! We couldn't be more excited to join the Lakebase team. We've long admired their technical vision, and the more we got to know them, the more impressed we became by their ambition, execution, and momentum. It feels like a natural home for us. I want to thank Responsive’s customers, investors, and especially the team. More than anything, I’m grateful for the trust you’ve placed in us through the good times and the tough times. Onward and upward!

Post attachment
Ali Ghodsi avatar
⟳ Reynold Xin retweeted
Ali Ghodsi@alighodsi·Oct 1

Everyone has been obsessed by Jev and what it can do, and they should be! Fast typed decisions >> slow text generation. It's a complete game changer. But how do you do that with all the data you have? We just dropped 𝚊𝚒_𝚍𝚎𝚌𝚒𝚍𝚎(), which runs decision models natively on all your data in @databricks . Now you can run system one decisions on all your big data, see screenshot. databricks.com/blog/introduc…

Post attachment