Writing

Articles

Notes on data engineering, open-source infrastructure, and building data platforms — published across Medium and other outlets.

Dagster on Kubernetes: When More Nodes Won’t Save You

You’ve scaled up your Kubernetes cluster. EC2 instances are running. CPU and memory metrics look reasonable. And yet — the number of completed Dagster runs stubbornly refuses to climb. If you’ve been in this situation, you know the particular frustration of a platform that looks healthy but processes jobs at a trickle.

Read on Medium →
From Zero to Data Platform in Minutes: The Case for an Open-Source Setup Wizard

How a simple configuration tool can remove weeks of infrastructure work for solo developers, small teams, and anyone evaluating modern data stacks.

Read on Medium →
From Zero to Running Data Platform in 5 Minutes: A Hands-On Walkthrough

A step-by-step tutorial using Data Platform Wizard to generate a production-ready Docker stack of fully equipped Data Platform scaffold.

Read on Medium →