data-pipelines

Data pipeline workflow for ETL, validation, and quality controls.

Data Pipelines

Use this when the current task matches the workflow described by this skill.

When to Use

  • The task needs a repeatable, specialized workflow.
  • The task would benefit from reusable process guidance.
  • You want a consistent operating procedure.

Core Focus

  • ETL, validation, and chunking
  • Safe retries and data quality
  • Design idempotent, monitored, and retryable data flows.

Workflow

  1. Restate the job in one sentence.
  2. Identify the relevant files, commands, or services.
  3. Apply the skill in small, verifiable steps.
  4. Verify the outcome before moving on.

Verification

  • Prefer concrete checks over vague reassurance.
  • Validate the main behavior and at least one failure path.
  • Keep the response short and direct.