, ,

Polars’ Streaming Engine Is a Bigger Deal Than People Realize

Polars’ Streaming Engine Is a Bigger Deal Than People Realize If there’s one tool that still doesn’t get enough attention in our strange little data world, it’s Polars. It gets some love, sure, but not nearly what it deserves. I’ve been using it on and off since around 2022, and it was actually the first […]

Read more
, ,

Transactions Are Coming to the Lakehouse… Whether You Like It or Not

Every once in a while, I catch myself wondering if I should sell everything, move to a cabin in the woods, and raise goats… or keep doing this Data Engineering thing a little longer. The problem with sticking around is that you start to recognize patterns, and lately it feels like we’re watching history repeat […]

Read more

Metric Views in Databricks | The Semantic Layer

Read more

Will AI Kill Data Engineering (or Software Engineering)?

Short answer? No.Long answer? Also, no — but let’s talk about why. If you spend any amount of time on LinkedIn, X, YouTube, or your favorite tech newsletter, you’ve probably been told that software engineering, and especially data engineering, is on the brink of extinction. The headlines are loud, and the thumbnails are dramatic, heck […]

Read more

Introduction to Databricks SQL Temporary Tables

There was a moment when Databricks announced support for temporary tables, and a certain segment of the data world collectively blinked and did a double-take. If you came up through the ranks of SQL Server, Oracle, or any traditional warehouse, your first reaction may have been somewhere between nostalgia and disbelief. “Wait… we’re celebrating temp […]

Read more