Skip to content

feat(migrations): drop per-part latest projections (v1.0.14 — HOLD until telemetry-api switch + 24h soak)#264

Merged
zer0stars merged 1 commit into
mainfrom
feat/drop-latest-projections
Jun 15, 2026
Merged

feat(migrations): drop per-part latest projections (v1.0.14 — HOLD until telemetry-api switch + 24h soak)#264
zer0stars merged 1 commit into
mainfrom
feat/drop-latest-projections

Conversation

@zer0stars

Copy link
Copy Markdown
Member

Drops signal_latest_by_subject_source_name and event_latest_by_subject_source_name and resets deduplicate_merge_projection_mode. Superseded by signal_latest/summary tables (#263).

HARD GATE — do not merge/tag until:

  1. telemetry-api release reading signal_latest/summary tables is deployed and verified stable 24h.
  2. prod query_log shows zero projection-matched app queries in 24h:
SELECT count() FROM clusterAllReplicas(default, system.query_log)
WHERE type = 'QueryFinish' AND event_time > now() - INTERVAL 24 HOUR
  AND notEmpty(projections);

Dropping while anything still emits projection-matched shapes sends those queries to full-history scans (~10s, the original incident — worse than the ~3s projection path).

Stacked on #263; retarget to main after it merges. Tag v1.0.14 from this merge.

Superseded by signal_latest (00010) and the summary tables (00011).
Projections are stored per part, so latest-state reads through them
fan out across all ~140 parts of the signal table — measured p50 ~3s
in prod vs ~110ms for raw primary-key reads. Dropping also removes
the projection rebuild cost from every merge.
@zer0stars zer0stars force-pushed the feat/drop-latest-projections branch from 2515865 to 6955f49 Compare June 11, 2026 20:41
@zer0stars zer0stars changed the base branch from feat/signal-latest-table to main June 11, 2026 20:41
@zer0stars zer0stars marked this pull request as ready for review June 15, 2026 18:50
@zer0stars zer0stars merged commit df3619f into main Jun 15, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant