Make SQLite CI checks portable #2
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: Data pipeline | |
| on: | |
| pull_request: | |
| push: | |
| branches: | |
| - main | |
| - "agent/**" | |
| workflow_dispatch: | |
| permissions: | |
| contents: read | |
| jobs: | |
| validate: | |
| runs-on: ubuntu-latest | |
| steps: | |
| - name: Check out repository | |
| uses: actions/checkout@v5 | |
| - name: Set up Python | |
| uses: actions/setup-python@v6 | |
| with: | |
| python-version: "3.12" | |
| cache: pip | |
| - name: Install pipeline dependency | |
| run: python -m pip install -r requirements.txt | |
| - name: Validate committed generated data | |
| run: python scripts/validate_dataset.py | |
| - name: Rebuild generated data | |
| run: python scripts/build_dataset.py | |
| - name: Validate rebuilt cross-format equivalence | |
| run: python scripts/validate_dataset.py | |
| - name: Run schema, integrity and coordinate tests | |
| run: python -m unittest discover -s tests -v | |
| - name: Reject stale or manually edited generated files | |
| run: >- | |
| git diff --exit-code -- | |
| data | |
| ":(exclude)data/italian_locations.sqlite" | |
| reports/milestone2-diff.json | |
| reports/milestone2-exports.json | |
| reports/milestone2-validation.json |