Skip to content

feat(showcase): stream packed taxi rows into Spatial Atlas - #2924

Draft
ibgreen-openai wants to merge 2 commits into
masterfrom
codex/atlas-taxi-source
Draft

feat(showcase): stream packed taxi rows into Spatial Atlas#2924
ibgreen-openai wants to merge 2 commits into
masterfrom
codex/atlas-taxi-source

Conversation

@ibgreen-openai

@ibgreen-openai ibgreen-openai commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Goals

  • let the Billion-Point Spatial Atlas consume a real packed TaxiPointSource instead of always regenerating its deterministic fixture;
  • preserve exact source provenance and literal source/GPU telemetry through query, rendering, and picking; and
  • keep source activation, GPU rebuilds, LiDAR cache publication, and diagnostic readback transactional.

Changes

  • Adds an optional ?taxi-manifest= Atlas source path with cached metadata, explicit CRS validation, capacity-bounded row-group loading, abort/reload handling, last-good fallback, and original-row tooltip provenance.
  • Extracts shared taxi coordinate/data helpers used by both the Atlas and deck.gl adapter, avoiding a discarded local-XYZ allocation in the deck path.
  • Reports manifest corpus, network/decode, resident, intersected-cell, candidate, match, render, and overflow values separately.
  • Snapshots GPU query counters atomically into one five-word readback buffer and defers superseded resource destruction until an in-flight read settles.
  • Makes Atlas/LiDAR resource replacement transactional, including postprocessing resize rollback and committed borrowed-buffer restoration.
  • Adds a deterministic six-row packed-source browser fixture, scan/index and mode-transition coverage, reference-device-only mapped readback, and source/CRS/telemetry documentation.

Verification

  • nvm use — passed (v22.22.1).
  • yarn install — attempted; blocked by the internal socket registry returning HTTP 403 for Playwright 1.62.1 and @vis.gl/dev-tools 2.0.0-alpha.3.
  • yarn lint fix — wrapper unavailable because the blocked install left ocular-lint missing; direct Biome check --write on every touched TS/JS source passed with no changes.
  • yarn build — wrapper unavailable because ocular-clean is missing; focused strict TypeScript compilation passed and the Atlas Vite production bundle passed (2,127 modules).
  • yarn test — wrapper unavailable because ocular-test is missing; the two focused taxi source/data suites passed (12/12).
  • yarn website:build — attempted; stopped at missing Vite from the blocked install.
  • (cd website && yarn build) — attempted; stopped at the same missing Vite dependency.
  • Atlas Playwright software-WebGPU smoke — passed in 9 seconds, covering packed-source activation, query/execution controls, taxi-zone changes, zoom, LiDAR transition, colour mode, and bounded layout.
  • Exact mapped counter/readback assertions remain opt-in for reference-device runs; the software smoke deliberately follows the existing test(showcase): validate Atlas EPT lifecycle #2919 policy.
  • git diff --check — passed.
  • Independent final code review — no actionable findings.

Stack

Risks and follow-up

  • The original Paul Taylor Arrow object still has no authoritative CRS metadata; operators must not label it OGC:CRS84 without external verification.
  • Large public data and reference-GPU benchmarks remain intentionally outside CI.

@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 2bd6fe4 to 7f47087 Compare August 4, 2026 14:15
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 56aaf4a to 80b6aa2 Compare August 4, 2026 14:39
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 7f47087 to 038ef75 Compare August 4, 2026 18:00
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from b6e27c7 to cd6f283 Compare August 4, 2026 18:09
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 038ef75 to 63c7fb5 Compare August 4, 2026 21:38
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch 2 times, most recently from 5d2a3dd to dfad765 Compare August 4, 2026 22:59
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 63c7fb5 to c1d2044 Compare August 4, 2026 22:59
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from dfad765 to b238472 Compare August 5, 2026 00:01
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch 2 times, most recently from 3240604 to 697adb0 Compare August 5, 2026 00:39
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from b238472 to 6ab0a24 Compare August 5, 2026 00:39
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 697adb0 to 88c6c95 Compare August 5, 2026 13:52
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 6ab0a24 to c3f7ebd Compare August 5, 2026 13:52
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 88c6c95 to 30f513c Compare August 5, 2026 14:07
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from c3f7ebd to 197b335 Compare August 5, 2026 14:07
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 30f513c to 844a282 Compare August 5, 2026 15:00
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 197b335 to ffac434 Compare August 5, 2026 15:00
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 844a282 to 25c20bb Compare August 5, 2026 15:10
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from ffac434 to 74efdc0 Compare August 5, 2026 15:11
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 25c20bb to 1c769d3 Compare August 5, 2026 15:24
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 74efdc0 to 11b1c50 Compare August 5, 2026 15:24
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 1c769d3 to 35e3c3a Compare August 5, 2026 17:28
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 11b1c50 to b8229f1 Compare August 5, 2026 17:28
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 35e3c3a to 8937bd7 Compare August 5, 2026 19:30
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch 2 times, most recently from 6909f6a to ee5b95f Compare August 5, 2026 20:31
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from 8937bd7 to 37fd510 Compare August 5, 2026 20:31
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from ee5b95f to 963c679 Compare August 5, 2026 21:32
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch 2 times, most recently from a9ad93d to beee1be Compare August 5, 2026 21:48
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 963c679 to 464d871 Compare August 5, 2026 21:48
@ibgreen-openai
ibgreen-openai force-pushed the codex/luspatial-direct-source-ids branch from beee1be to 1222740 Compare August 5, 2026 22:48
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from 464d871 to 4bb7371 Compare August 5, 2026 22:48
Base automatically changed from codex/luspatial-direct-source-ids to master August 5, 2026 22:57
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch 9 times, most recently from 872b84c to d9deba7 Compare August 7, 2026 00:51
@ibgreen-openai
ibgreen-openai force-pushed the codex/atlas-taxi-source branch from d9deba7 to b2b61eb Compare August 7, 2026 01:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants