Skip to content

kv: add --mode index, the W4 gate of a keyed load against the same load without the key - #281

Merged
tamnd merged 1 commit into
mainfrom
index-gate
Oct 9, 2026
Merged

tamnd merged 1 commit into
mainfrom
index-gate

Conversation

@tamnd

@tamnd tamnd commented Oct 9, 2026

Copy link
Copy Markdown
Owner

Part of tamnd/rudb#1387 (W4), the index gate of 17-milestones.md: building the key of a load of 10 million rows adds at most a tenth to the same load without it.

--mode index loads --records rows of (id BIGINT, v BIGINT) into a fresh table without a key and into one with id as its primary key, --runs times each, and drops both after each load. The two take turns, and which one goes first alternates by run, so neither always meets a file that just grew. The gate is judged on the medians. It runs on rudb, DuckDB and PostgreSQL, each loading from its own row generator.

On server3 with rudb and the W4 key work, 10 million rows over 5 runs: a median of 3.361 s without the key and 3.425 s with it, 1.9% added, a pass. The box was under a load of about 80 from other jobs, so single runs swing by tens of percent either way and only the medians mean much.

Tests: the median of an odd and an even count, and of nothing.

@tamnd tamnd added kind/feature It should do something it does not. area/loaders Getting a dataset into each engine, and timing that. labels Oct 9, 2026
@tamnd
tamnd merged commit 5f273bc into main Oct 9, 2026
1 check failed
@tamnd
tamnd deleted the index-gate branch October 9, 2026 12:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/loaders Getting a dataset into each engine, and timing that. kind/feature It should do something it does not.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant