←
Data Engineering Weekly1,889 posts
Data Engineering Weekly avatar

Data Engineering Weekly

@data_weekly

Weekly Data Engineering Newsletter. Subscribe to dataengineeringweekly.com | Wanna talk about Data engineering? Book Me here calendly.com/apackkildurai

◷ Joined November 2020▧ 38 Photos and videos
Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Nov 15

ROWS BETWEEN 6 PRECEDING counts 7 rows, not 7 days. Skip a day of sales and your "weekly" sum reaches back weeks. Use RANGE BETWEEN INTERVAL 6 DAY PRECEDING AND CURRENT ROW. leetdata.ai/problems/range-f… #SQL

Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Nov 11

Should list customers who never ordered. Returns 0 rows. Why? WHERE id NOT IN (SELECT cust_id FROM orders) A) Subqueries not allowed B) NULLs in cust_id C) Needs DISTINCT D) Needs a cast Reply A-D. leetdata.ai/problems/not-in-… #SQL

Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Nov 8

Daily report says 1 order on a day nobody ordered. calendar LEFT JOIN orders, then COUNT(*). The empty day still has its calendar row, so COUNT(*) = 1. COUNT(o.order_id) gives 0. leetdata.ai/problems/calenda… #SQL

Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Nov 4

Same room, bookings a and b. Which WHERE catches every overlap? A) a_in BETWEEN b_in AND b_out B) a_in < b_out AND b_in < a_out C) a_in = b_in D) a_out > b_in Reply with a letter. leetdata.ai/problems/date-ra… #SQL

Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Oct 29

Two jobs append to one Iceberg table from snapshot 41. A commits first. B: A) overwrites A's files B) retries on the new snapshot, both land C) breaks it till compaction D) forks into 2 snapshots leetdata.ai/paths/lakehouse #dataengineering

Data Engineering Weekly avatar
Data Engineering Weekly@data_weekly·Oct 23

Parquet is how columnar data sits on disk. Arrow is how it sits in memory. Engines that share Arrow pass data with zero copies, no serialization step. From Hoyt Emerson's overview in DEW #292. Practice: leetdata.ai/paths/lakehouse #dataengineering