Stack · Data engineering

Data pipeline desk

Keeps the ingestion syncs, the Airflow DAGs and the dbt models moving, and explains a failed run before the dashboard goes stale.

Built for: The data engineer who owns the nightly load, the models on top of it, and the message at nine that says the numbers look wrong.

Install all 10 parts

The button opens the checkout, where the 4 servers and 6 skills are listed one by one. Every member is free, so the checkout lists them and asks for no card.

$0/mo
every member is free — 4 servers and 6 skills
$0
the free-tier version keeps 4 servers and 6 skills — and all 36 tools
$0
6 skills with no monthly cost
33.5k
tokens if every skill file is read in full — a skill loads its description first and the rest only when used
01 · Outcome

What your agent can do with this

The reason to buy a stack rather than five listings: each line below needs more than one member connected at the same time.

  1. 01

    Find the failed Airflow task, read its log, and say whether the cause was upstream data, code or the connection.

  2. 02

    Read the job and attempt logs of an Airbyte sync that failed, on the connection where it failed.

  3. 03

    Change a dbt model, run its tests and unit tests, and show which downstream models the change reaches.

  4. 04

    Query ClickHouse to check that the rows the model promised actually arrived.

02 · Assembly

The assembly, part by part

What each part contributes, and why it was picked over the obvious alternative. Prices and permissions are read from the listings, so nothing here can disagree with the catalogue.

4 servers6 skills36 tools
AP01

The Airflow REST API as tools — DAGs, runs, task instances, logs, connections and datasets — with a --read-only mode for looking without triggering.

read/write split not recordedruns on your machine A v0.2.10 credential not declared · runs locally
Free
$0 of the monthly total
AI02

The Airbyte public API, self-managed or Cloud: connections, sync jobs and their logs, so a failed load is read where it failed.

23 read13 writeruns on your machine F v1.0.0 credential not declared · runs locally
Free
$0 of the monthly total
DB03

Runs, builds and tests dbt Core models and reads lineage and impact, from the project on disk.

read/write split not recordedruns on your machine A v1.7.1 credential not declared · runs locally
Free
$0 of the monthly total
CL04

ClickHouse's official server: list databases and tables and run queries against the warehouse the models land in.

read/write split not recordedruns on your machine A v0.7.0 · updated 3 weeks ago API key · runs locally
Free
$0 of the monthly total
and the instructions that drive them A skill is a prompt file, not a server: it adds context and a procedure, never a tool or a permission of its own.
AI05
Airflow Operations Agent skill by astronomer

Astronomer's guide to operating Airflow — listing and triggering DAGs, retrying runs, reading task logs, fixing import errors.

4.5k tokens when loaded in full write access not declared 3 files · Apache-2.0 needs no server of its own
Free
no monthly cost
DA06
DAG Diagnosis Agent skill by astronomer

Astronomer's root-cause procedure for a failing DAG, ending in a fix and a prevention note rather than a retry.

1.9k tokens when loaded in full write access not declared 1 file · Apache-2.0 needs no server of its own
Free
no monthly cost
US07
Using dbt for Analytics Engineering Agent skill by dbt-labs

dbt Labs' own skill for building and changing models with ref() and source(), tests, and checking results with dbt show.

10.2k tokens when loaded in full asks the agent to write 9 files · Apache-2.0 needs no server of its own
Free
no monthly cost
AD08
Add unit test for a dbt model Agent skill by dbt-labs

dbt Labs' unit-test YAML with mocked inputs, so a model's logic is tested without the warehouse.

8.9k tokens when loaded in full write access not declared 14 files · Apache-2.0 needs no server of its own
Free
no monthly cost
CO09

Runs a dbt Core project as Airflow tasks with Astronomer Cosmos, one checklist from engine to warehouse.

6.9k tokens when loaded in full write access not declared 2 files · Apache-2.0 needs no server of its own
Free
no monthly cost
DA10
Data Quality Frameworks Agent skill by wshobson

Great Expectations, dbt tests and data contracts, for the checks that catch bad data before a dashboard does.

1.1k tokens when loaded in full write access not declared 1 file · MIT needs no server of its own
Free
no monthly cost
03 · Cost

What it costs, and on what assumption

Every member is free, so the monthly figure is $0 whatever you do with the stack: nothing here is billed by the call, and only adding a paid member could change it.

PartWhat you are paying forMonthly, as quoted
Apache Airflow Free —
Airbyte Free —
Dbt Core Free —
ClickHouse Free —
Skills
Airflow Operations Free · context cost only —
DAG Diagnosis Free · context cost only —
Using dbt for Analytics Engineering Free · context cost only —
Add unit test for a dbt model Free · context cost only —
Cosmos + dbt Core: Implementation Checklist Free · context cost only —
Data Quality Frameworks Free · context cost only —
Everything above $0 of servers plus $0 of skills, the same in a quiet month and a busy one $0/mo

Subscriptions at their monthly plan price; one-off licences spread over 12 months.

What moves the bill
Flat every month$0 · 0 subscriptions
Carries a call allowancenothing
Paid oncenothing
Traffic assumed5k calls / month

Nothing in this stack carries a call allowance, so nothing here can run out before the month does. The bill is decided when you install it, not when you use it.

The spend cap is one figure for the whole account, set in your dashboard and checked when an order is placed. On the call path what stops a retry loop is the plan's call allowance and its rate limit, and a refused call is never billed.

04 · Setup

Setting it up, in order

The steps below come before the install lines: what to decide and scope before connecting anything, in the order it matters. The lines themselves follow, part by part, for the client you pick.

1
Start Airflow read-only
AIRFLOW_HOST, AIRFLOW_USERNAME and AIRFLOW_PASSWORD for the API, and --read-only on the start line until you decide the desk may trigger runs.
2
Give ClickHouse a read-only user
CLICKHOUSE_HOST, CLICKHOUSE_USER and CLICKHOUSE_PASSWORD for a user with readonly = 1, and CLICKHOUSE_ALLOW_WRITE_ACCESS left unset.
3
Run dbt from the project
The dbt member works on the dbt project in the folder the client opens, with your profiles.yml; it does not carry its own credentials.
4
Install the skills last
The diagnosis and dbt skills act through the servers above; connect those first.
Install, part by part10 parts of 10 in Claude Code

npx mcprush@latest stack add data-pipelines writes all 4 servers into Claude Code’s config in one go — or run the lines below one by one. The 6 skills are not included — add them with lines 05–10.

Keys you’ll need
ClickHouse
CLICKHOUSE_HOST — Hostname of the ClickHouse server
CLICKHOUSE_USER — Username for ClickHouse authentication
CLICKHOUSE_PASSWORD — Password for ClickHouse authentication

Set them where you start Claude Code — export CLICKHOUSE_HOST=… in your shell profile on macOS and Linux, setx CLICKHOUSE_HOST "…" on Windows, then open a new terminal. Claude Code reads them at start; the config keeps only the names.

# 01 · Apache Airflow claude mcp add --scope user apache-airflow-mcp '--' uvx mcp-server-apache-airflow # 02 · Airbyte claude mcp add --scope user airbyte-mcp '--' uvx --with 'mcp<2' airbyte-mcp # 03 · Dbt Core claude mcp add --scope user dbt-core-mcp '--' uvx dbt-core-mcp # 04 · ClickHouse claude mcp add --scope user --env 'CLICKHOUSE_HOST=${CLICKHOUSE_HOST}' --env 'CLICKHOUSE_USER=${CLICKHOUSE_USER}' --env 'CLICKHOUSE_PASSWORD=${CLICKHOUSE_PASSWORD}' --transport stdio clickhouse-mcp '--' uvx mcp-clickhouse # 05 · Airflow Operations npx mcprush@latest skill add astronomer/airflow-operations # 06 · DAG Diagnosis npx mcprush@latest skill add astronomer/dag-diagnosis # 07 · Using dbt for Analytics Engineering npx mcprush@latest skill add dbt-labs/using-dbt-for-analytics-engineering # 08 · Add unit test for a dbt model npx mcprush@latest skill add dbt-labs/add-unit-test-for-a-dbt-model # 09 · Cosmos + dbt Core: Implementation Checklist npx mcprush@latest skill add astronomer/cosmos-dbt-core-implementation-checklist # 10 · Data Quality Frameworks npx mcprush@latest skill add wshobson/data-quality-frameworks
Requirements and Windows tips
  • Node.js 20 or newer (for npx).
  • uv (for uvx, docs.astral.sh/uv).
  • Windows PowerShell says 'running scripts is disabled on this system'? Run Set-ExecutionPolicy -Scope CurrentUser RemoteSigned once, or type npx.cmd instead of npx (codex.cmd, gemini.cmd, grok.cmd likewise). PowerShell 7 needs neither.

Nothing is connected until you approve it in Claude Code. mcprush is not in the path and meters nothing here.

Before you start
  • 1 member wants an API key, set in your own client’s config on your machine — this marketplace never holds it.
  • 3 members have not declared what credential they need — check each one’s own page before you start.
  • What this stack can write is not recorded — 3 members of 4 have no imported tool surface. Section 05 says what is known before you approve anything.
  • 4 members are connected straight from their own package or address — nothing in them goes through mcprush.
05 · Permissions

What the whole stack can reach

Installed together, these tool surfaces add up. It is the first thing a security reviewer asks for, so what has been counted — and what nobody has counted yet — is on the page rather than in a PDF.

—
tools that only read
Which tools read and which write is counted from the surface a publisher imports, and 3 members of 4 have no imported tool surface.
—
tools that can change something
Not recorded, and not estimated: a total added up from the members that have a surface would be read as the whole stack’s. The table below is what is known, member by member.
0
tools that reach the network
36 of the 36 never leave your machine — they belong to the local members.
Who grants the write accessnot recorded
MemberTool surfaceWrite tools
Airbyte imported 13
Apache Airflow not imported not recorded
ClickHouse not imported not recorded
Dbt Core not imported not recorded
Reading the number

A stack's blast radius is the union of its members, not the worst of them. That union cannot be taken here, because 3 members of 4 have no imported tool surface — so the figure a review asks for is missing rather than low, and a member marked not imported is one nobody has counted rather than one that cannot write.

1 skill in this stack instructs the agent to write — Using dbt for Analytics Engineering. A skill holds no permission of its own; it can only ask a server that already has the scope, and the approval gate still applies.

Tools in total36
Write sharenot recorded
Members that can writeat least 1 of 4
Surface imported1 of 4 members
06 · Swaps

Sensible swaps

A stack is a default, not a verdict. These are the substitutions the maintainer would make, and what each one costs or saves.

Teams on Dagster get runs, failure summaries, asset health and backfills from a server over the Dagster GraphQL API.

same money at 5k calls tool counts not recorded both grade A

If ingestion runs on Fivetran, manage and resync its connections and read their status there instead.

same money at 5k calls 15 tools instead of 36 grade A instead of grade F
07 · Limits

Where this stack stops

Written by the maintainer, kept on the page rather than in a support thread.

  • It does not deploy DAGs or change production connections on its own. The Airflow member has a read-only mode; this desk expects it.

  • The ClickHouse member keeps writes off unless CLICKHOUSE_ALLOW_WRITE_ACCESS is set. Leave it unset, and give it a read-only user as well.

  • It covers Airflow, Airbyte, dbt Core and ClickHouse. Another orchestrator or warehouse means a swap, not a setting.

08 · Maintenance

Who keeps this current

A stack has an owner: whoever keeps it re-checks the combination when a member changes, and the members themselves are published by the people named on each row.

Maintainer
mcprush
The marketplace’s own editors — keep 40 stacks here
Version
—
Not versioned — the curator edits in place
Scanned members
4 of 4
Servers in it that carry a scan grade for the release they serve.
Member trust score
58–99
Lowest to highest client score of its 4 scanned servers, out of 100.
Composition
4 + 6
4 servers, 6 skills
Nearby

Other ready-made stacks

All 40 stacks