Nightly stress soak failed in multi-process.
Full log is attached as the nightly-stress-multi-process artifact on the run.
Reproduce locally after a checked build:
cd build
DOLTLITE_MP_COMMIT_OPS=2000 ./multi_process_test
./multi_process_gc_test
./multi_process_merge_rebase_test
Last 80 lines of the soak log:
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=6 abort wins=6 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=4 abort wins=8 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=5 abort wins=7 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=6 abort wins=6 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=5 abort wins=7 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
multi_process_merge_rebase_test run 210
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=6 abort wins=6 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 46 passed, 0 failed out of 46 tests ===
=== Multi-Process Merge & Rebase Concurrency Tests ===
--- Test 1: 8 processes merging distinct branches into main ---
--- Test 2: merge into main racing concurrent main commits ---
FAIL: merge_race_feat_rows_present
--- Test 3: rebase racing a dolt_gc() loop ---
--- Test 4: rebase racing a checkout loop ---
--- Test 5: concurrent --continue vs --abort ---
continue wins=4 abort wins=8 bad=0
--- Test 6: concurrent --continue after default reopen ---
=== Results: 45 passed, 1 failed out of 46 tests ===
completed 211 multi_process_merge_rebase_test runs
Nightly stress10170ed82c1b12414db8d1b29d2fe9ea2a72fd88masterNightly stress soak failed in multi-process.
Full log is attached as the
nightly-stress-multi-processartifact on the run.Reproduce locally after a checked build:
cd build DOLTLITE_MP_COMMIT_OPS=2000 ./multi_process_test ./multi_process_gc_test ./multi_process_merge_rebase_testLast 80 lines of the soak log: