fix(hashing): pydantic/dataclass columns as pipeline columns (ITL-432)#185

Merged

eywalker merged 6 commits into

mainfrom

eywalker/itl-432-pydanticdataclass-models-cant-flow-through-pipelines-as

Jun 27, 2026

Commits on Jun 27, 2026

docs(itl-432): add design spec for pydantic/dataclass pipeline column fixes

kurodo3[bot]
and
claude
committed
fix(hashing): pydantic/dataclass columns now flow through pipelines as Arrow extension types

kurodo3[bot]
and
claude
committed
test(hashing): fix DictSource and PolarsFilter test cases for ITL-432

kurodo3[bot]
and
claude
committed
perf(arrow_utils): preserve chunking in normalize_extension_columns

kurodo3[bot]
and
claude
committed
fix(types): correct new_columns type annotations in extension column processing

kurodo3[bot]
and
claude
committed
test(arrow_utils): add thorough unit tests for normalize_extension_columns

kurodo3[bot]
and
claude
committed