←
Scott Haines2,850 posts
Scott Haines avatar

Scott Haines

@newfront

OSS Engineer | Speaker • Trainer | #DatabricksMVP | Author @OReillyMed | ❤️ #ApacheSpark. ❤️ #Dogs. #DatabricksMVP. Views are my own

◷ Joined November 2008▧ 116 Photos and videos
Unity Catalog avatar
⟳ Scott Haines retweeted
Unity Catalog@unitycatalog_io·Nov 12

.@newfront walked through Unity Catalog's evolution at our recent Open Lakehouse + AI meetup: native Iceberg REST, catalog-managed tables, credential vending, metric views, and the Labels API. He also covers the roadmap: APPLY TAG, ABAC policies, MCP servers, and AI gateways. Watch the full session ⬇️ youtube.com/watch?v=XAU1GgDO…

Unity Catalog avatar
⟳ Scott Haines retweeted
Unity Catalog@unitycatalog_io·Nov 9

📣 Our next Unity Catalog Community Sync is coming up on Tuesday, November 17! This is a dedicated space for maintainers and developers to connect on roadmap updates, dive into ongoing development, and work through technical challenges together. Bring your questions and join the discussion. 🗓️ Tues, Nov 17 🕓 8:00 AM PT Save your spot ⬇️ luma.com/rxdhaocl

Delta Lake avatar
⟳ Scott Haines retweeted
Delta Lake@DeltaLakeOSS·Oct 12

Join us tomorrow, Oct 13 at 9 AM PT for the Delta Lake Community Meetup! 🎉 On the agenda: 🔹 Parquet FILE data type protocol support 🔹 Concurrent identity column generation RFC 🔹 delta-rs integration with Unity Catalog Delta APIs 🔗 RSVP: luma.com/w6gqy0ul #DeltaLake #OpenSource

Buf avatar
⟳ Scott Haines retweeted
Buf@bufbuild·Oct 7

connect-go v2 is here. We took four years of production experience and redesigned the API: simpler method signatures (no more generic Request/Response wrappers), pluggable transports, a unified interceptor model, and a migration tool to automate the upgrade. Learn more: buf.build/blog/connect-go-v2

Buf avatar
⟳ Scott Haines retweeted
Buf@bufbuild·Sep 22

How well do you actually know Protocol Buffers? We put together a quick interactive quiz covering schema design, field rules, and wire format mechanics. protobuf.com/quiz/ The questions are now randomly selected from a question bank so retrying will give you a few new questions. #protobuf #grpc #quiz

Omnigent avatar
⟳ Scott Haines retweeted
Omnigent@omnigent_ai·Sep 16

Omnigent v0.14.0 is now available! 🎉 This release makes it easier to work across GitHub repositories, configure sessions, and keep track of ongoing work. 🔀 Multi-repo GitHub PRs and sandboxes 🎛️ Redesigned composer 🪟 Claude SDK /compact 🗄️ Gensee, Kubernetes, CockroachDB 🔁 Approvals that survive restarts Learn more 👉 omnigent.ai/releases/0.14.0 #Omnigent #AIAgents #OpenSource

Post attachment
Apache Spark avatar
⟳ Scott Haines retweeted
Apache Spark@ApacheSpark·Sep 16

At Airflow Summit, Meni Shmueli from DataFlint covers how #ApacheSpark and @ApacheAirflow run together in production, including splitting CPU work (like reading Parquet) off GPU machines so AI jobs aren’t paying GPU rates for CPU-only steps. Apache Spark 4.2 is out: auto CDC and Real-Time Mode for streaming, DataSketches as first-class operators, and Spark Connect so client/server queries come back in milliseconds instead of spinning up a full app. #SparkConnect #DataSketches #ApacheAirflow

7:20
Scott Haines avatar
Scott Haines@newfront·Sep 15

RT @ApacheSpark: 📣 Schema-on-Read Without Regrets: Lessons from Apache Spark™ Variant shredding in Production Join Geir E. Alstad (Gabler…

Databricks avatar
⟳ Scott Haines retweeted
Databricks@databricks·Sep 10

The Replit-Databricks integration is now generally available, with new native Lakebase support! Now, you can use @Replit to build full-stack Databricks Apps on live, governed enterprise data. Replit Agent can automatically provision a Lakebase database, while AI-proposed schema changes require human approval. Build, deploy, and iterate in one flow. See it in action: replit.com/blog/databricks20…

3:05
Delta Lake avatar
⟳ Scott Haines retweeted
Delta Lake@DeltaLakeOSS·Aug 31

3 weeks out: Open Lakehouse + AI Meetup is coming to Paris! 🇫🇷 Agenda: 🔹 @unitycatalog_io (You Can Go Your Own Way....Go Your Own Way) 🔹 @omnigent_ai — A Meta Harness for AI Agents 🔹 AI Agents at Every Scale: Personal, Team, and Data Workflows Then networking, light bites & swag. 📅 Wed, Sept 23 | 6:00–9:30 PM CEST 📍 La Fondation | Paris, FR 🎟️Register: usergroups.databricks.com/ev… #OpenLakehouse #AI

Post attachment