When and how to override Spark's automatic join strategy — a technical deep-dive for senior engineers.
I match compute type to workload pattern — the biggest cost mistake I see is teams using all-purpose clusters for production jobs because that's what they developed on.
Stop following 2023 advice in 2026. Half of what's on Stack Overflow and old blog posts is fighting the platform instead of using it.
No npm. No Vite. No bundler. Just HTML, vanilla JavaScript, D3, and free StatsBomb data. Here's how, and what I picked up about xG, xT, and 2010-era web tech.
Benchmark of the new feature in spark 4.1 which changes completely how spark deal with streaming data
