Skip to content
The Pragmatic Leader

Tag

data pipelines

Articles

Backfills and the Cost of Being Wrong

Aaron Wise

Data pipeline backfills are routine, not emergencies. Make jobs idempotent, partitioned, deterministic and versioned so fixing history takes an afternoon.

Sign up for Newsletter