←
Zach Wilson7,269 posts
Zach Wilson avatar

Zach Wilson

@Zachly

Founder @ DataExpert.io | blog.dataexpert.io | ADHD | 10 yrs big data experience | ex @meta, @netflix, and @airbnb

◷ Joined July 2014▧ 677 Photos and videos
Zach Wilson avatar
Zach Wilson@Zachly·Jun 24

Senior data engineers at Netflix can make $500k per year. The interview process is intense though: - SQL Make sure you know: - window functions - table scans and optimization techniques - indices and data modeling - Data pipeline Make sure you know: - the failure modes of Spark - when to use Kafka vs Spark Streaming vs batch Spark - how to optimize Spark with different join types (especially broadcast join) - Data Modeling Make sure you know: - fundamentals of dimensional modeling - other techniques like data vault and one big table - when to incorporate complex data types like STRUCT and ARRAY - Behavioral Make sure you have a good story: - about when you received critical feedback and how you improved - about when you managed conflict - about when you failed - about demonstrating the cultural values of freedom and responsibility - Python / DSA Make sure you know: - breadth first and depth first search - Big O notation - binary trees, heaps, stacks, queues - recursion - System Design Make sure you know: - CAP theory and eventually consistent systems - Lambda vs Kappa architectures - production data modeling vs analytical data modeling DataExpert.io now offers mock interviews as part of our subscription product! You can take a simulated Netflix interview today!

Post attachment
Zach Wilson avatar
Zach Wilson@Zachly·3h

AI agent guardrails matter a lot! There’s 3 types of guardrails: - input guardrails We need to validate the user input and if they say something inappropriate or off topic, reject it without sending it to the agent - output guardrails Sometimes for a perfectly appropriate input, the agent generates an inappropriate output. Validate this output before sending it to the user and tell them when an inappropriate output was generated - tool guardrails Tools need protection and limits. Rate limit guardrails are the most important one! Follow me for more AI tips and tricks!

1:39
Zach Wilson avatar
⟳ Zach Wilson retweeted
Zach Wilson@Zachly·Nov 17

Multi-agent architectures save you on money and make your agents faster! - use opus for advanced planning tasks - use Haiku for brain dead simple tasks - use sonnet for small feature building! What are you using your agents for?

0:53
Jai Bhagat avatar
⟳ Zach Wilson retweeted
Jai Bhagat@ChaiWithJai·17h

Tonight we learned about why setting temperature to 0 does not solve PDF extraction anymore in @Zachly’s Senior Analytics Engineering Bootcamp. My notes on our Unstructured Data Modeling in @Snowflake lab: chaiwithjai.com/blog/snowfla…

Zach Wilson avatar
⟳ Zach Wilson retweeted
Zach Wilson@Zachly·Nov 17

I’ve played 9,158 hours of Xbox since 2008. This averages out to about 90 minutes per day. Video games taught me so many valuable lessons: - if you want to win, you need a good team Being good at Halo isn’t just about shooting well and dodging. Since it’s a 4 v 4 game, you need to find 3 good teammates to be able to reach the highest level of play. - if you want to get really good, you will need to put in the time I almost got my 10,000 hours in Xbox. Half of that time was dedicated to Halo. - being the very best isn’t worth it I reached the top 20 in the world in Halo 5 briefly in 2016. But I realized to get to number 1 I would have had to put in twice as many hours, something impossible while juggling my job at Meta. Usually the number one guy weighs 400 pounds and lives in his parents basement. Is that a cost you want to pay to be number one? - it is possible to build a glorious career while playing a lot of video games Video games help calm my mind and are part of my ADHD therapy stack. DataExpert.io has done $5m in sales in 3 years while I still play about 1-2 hours per day. When I worked in big tech, I played even more. Carly, please help me reach 10,000 hours by 2028 so I can finally claim I’m an Xbox expert!

Post attachment
li yin avatar
⟳ Zach Wilson retweeted
li yin@panda_liyin·Nov 17

GPT-6.2 Sol and GPT-6.2 Astra are now in AdaL @OpenAI Make videos with your chatgpt plan for free adalagent.ai

0:15
OpenAI@OpenAINov 17

Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. openai.com/index/introducing…

1:59
Zach Wilson avatar
Zach Wilson@Zachly·22h

Wow Nvidia gigabounced back to where it was a few days ago!

Jai Bhagat avatar
⟳ Zach Wilson retweeted
Jai Bhagat@ChaiWithJai·Nov 17

I’m taking @Zachly’s cohort and I must be using Snowflake everyday to graduate at the top of my cohort. I’m live-streaming my daily learnings.

Ali Ghodsi avatar
⟳ Zach Wilson retweeted
Ali Ghodsi@alighodsi·Nov 16

Big shifts happening in the AI landscape. These stats are crazy, and they come from our Unity Gateway, one of the largest router of proprietary/open source tokens (quadrillions of tokens per quarter). It's a cross-section of over 10,000 large enterprises using our gateway. Check these stats: → We've seen open source models go from single digit percentage 6 months ago to now over 30% of the tokens! → 6 months ago most enterprises had 1 model provider, today 75% have 2+ and 50% have 3+ model providers. Read @pwendell's thread 👇

1/ Today we’re publishing the Databricks AI Index, showing trends from enterprises who manage AI with our Unity Gateway. Data covers >10,000 companies with broad representation (Digital Natives, Fortune 500, Global 2000, etc...). Enterprise AI consumption is changing quite a bit:

Post attachment
Zach Wilson avatar
Zach Wilson@Zachly·Nov 16

Didn’t realize Taco Bell was going to decide the fate of humanity

These 10 people just decided the fate of humanity.

Post attachment
Zach Wilson avatar
⟳ Zach Wilson retweeted
Zach Wilson@Zachly·Nov 16

The November 16th Senior AI Analytics Engineer Boot Camp Kickoff