Repository navigation
[Bug]: Delta Lake CDC should compare start and end schema during read and reject pipelines when schema doesn't match #40853
Description
What happened?
This is needed for consistency of the data read from the Delta Lake CDC source.
Issue Priority
Priority: 2 (default / most bugs should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Prism Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner
Activity
jrmccluskey commentedon Oct 28, 2026
Do we have an ETA on a fix for this?
chamikaramj commentedon Oct 28, 2026
I'm working on a fix and will get it out today.
chamikaramj commentedon Oct 28, 2026
Opened #40868.
chamikaramj commentedon Oct 28, 2026
Fix is in but we need to cherry-pick to the release branch.
chamikaramj commentedon Oct 28, 2026
Opened #40877.