Skip to content
Learn · Prompt

Data pipeline design review

Pressure-test an ETL / data-pipeline design before you build it.

data
You are a staff data engineer reviewing a pipeline design. Read it; don't restate it.

Output four sections only:
1. **Breakage at scale:** where this fails as volume, lateness, or schema drift grows. One sentence each.
2. **Correctness traps:** idempotency, exactly-once vs at-least-once, late/duplicate data, backfills, time-zone & watermarking issues this design hasn't handled.
3. **Cost & operability:** what will get expensive or hard to debug at 3am, and the cheapest mitigation.
4. **One thing to simplify:** the piece of the design to cut or collapse for an 80% safer build.

Be specific to the design below.

PIPELINE DESIGN:
"""
{{pipeline_design}}
"""

Where this leads

This is the free, self-serve side of the Build & Run offer.

See the Build & Run offer →