Skip to content

feat(t3-1): verified_sources.json — 40-entry dlt source manifest - #191

Open
JesuFemi-O wants to merge 4 commits into
v0.1.12from
feat/m3-t3-1
Open

feat(t3-1): verified_sources.json — 40-entry dlt source manifest#191
JesuFemi-O wants to merge 4 commits into
v0.1.12from
feat/m3-t3-1

Conversation

@JesuFemi-O

@JesuFemi-O JesuFemi-O commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds src/tycoon/ingestion/data/verified_sources.json with 40+ dlt source entries
  • 8 fully-specified entries (github, slack, stripe, hubspot, notion, google_sheets, rest_api, filesystem) with credentials, config_fields, hints, and env_var names ported from catalog.py
  • 32 minimal entries for remaining dlt verified sources with display metadata
  • requires_dlt_init: false for rest_api, sql_database, filesystem (built-in to dlt) and for 11 entries whose dlt init names could not be verified against https://github.com/dlt-hub/verified-sources
  • dlt_init_name: "asana_dlt" (correct) rather than "asana"; "shopify_dlt" (correct) for shopify

Test plan

  • uv run pytest tests/test_manifest.py — all 17 pass
  • python -c "from tycoon.ingestion.manifest import load_manifest; m = load_manifest(); print(len(m))" outputs ≥ 40

Closes #98


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

…entries

Full credential/config metadata for 8 catalog sources (github, slack,
stripe, hubspot, notion, google_sheets, rest_api, filesystem). Baseline
entries for 32 additional dlt verified sources. rest_api, filesystem,
and sql_database marked requires_dlt_init=false (built-in to dlt).

Closes #98
…s_dlt_init false

- asana: dlt_init_name 'asana' -> 'asana_dlt' (correct dlt verified source name)
- confluence, hackernews, linkedin_ads, piano, postgres, sendgrid, twilio,
  twitter, chargebee, google_cloud_storage, dremio: set requires_dlt_init=false
  and dlt_init_name=null — their dlt init names are unverified; marking false
  prevents users from running dlt init <wrong-name> and silently getting a
  generic template instead of a real source connector
@gemini-code-assist

Copy link
Copy Markdown

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

Move dlt_source, dlt_init_name, requires_dlt_init into a backend object
and add provider: "dlt" on every entry. This keeps SourceSpec generic —
adding Airbyte, Fivetran, or Estuary means a new provider value and a
different backend shape, with no changes to the shared model fields.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant