Skip to content

docs: add the Bakehouse SDP project guide - #18

Merged
ivancalvo-dbxs merged 11 commits into
mainfrom
issue-3-sdp-pipelines
Sep 2, 2026
Merged

docs: add the Bakehouse SDP project guide#18
ivancalvo-dbxs merged 11 commits into
mainfrom
issue-3-sdp-pipelines

Conversation

@ivancalvo-dbxs

Copy link
Copy Markdown
Collaborator

Summary

  • Rewrite the existing ETL page as a Bakehouse-specific Spark Declarative Pipeline runbook.
  • Preserve the published URL while aligning navigation terminology with SDP.
  • Add runnable checks for auth targets, update completion, materialized-view types, row quality, and current-update expectation metrics.

Test plan

  • npm run build
  • npm run typecheck
  • Captain cold-start evaluation with ivancalvowest2
  • Update 644a548d-b0d1-4715-9bbe-c2c3398e9d9b completed successfully
  • All eight materialized views and grouped expectation metrics verified
  • Human verification accepted for this session

Closes #3

Replace the generic ETL page with an executable batch pipeline path so agents can build and verify the shared Bakehouse foundation for later project resources.
Poll exact pipeline updates and SQL statements so verification cannot pass on incomplete work or stale expectation metrics.
Support the current nested CLI response so healthy workspace credentials do not trigger a false preflight blocker.
Match the auth projection output to the documented single-line expected JSON.
Use one focused source file per dataset so the runbook follows the upstream pipeline structure guidance.
Use the grouped same-action decorator so the runbook matches upstream pipeline guidance without changing quality semantics.
Load the core CLI guidance first so pipeline work follows the required upstream skill hierarchy after authentication succeeds.
Link the ordered skills to their verified upstream definitions so agents can load the cited guidance directly.
Require the tables API response to prove each governed object is a materialized view instead of accepting names alone.
Recover workspace mismatches with the profile data already collected so the runbook does not require an undefined account profile.
Fail immediately when any governed object has the wrong type, and keep the ingestion handoff aligned with the renamed SDP page.
@ivancalvo-dbxs
ivancalvo-dbxs merged commit 6fa4076 into main Sep 2, 2026
1 check passed
@ivancalvo-dbxs
ivancalvo-dbxs deleted the issue-3-sdp-pipelines branch September 2, 2026 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2. [MISSING] SDP pipelines

1 participant