Skip to content

PM-4151: ignore failed MM score runs#111

Merged
jmgasper merged 3 commits into
developfrom
PM-4151-6
Jun 22, 2026
Merged

PM-4151: ignore failed MM score runs#111
jmgasper merged 3 commits into
developfrom
PM-4151-6

Conversation

@jmgasper

Copy link
Copy Markdown
Collaborator

What was broken
Previous PM-4151 fixes suppressed active Marathon Match final columns and stopped final review rows with unusable scores from falling back to submission.finalScore. Failed or deleted Marathon Match submissions could still influence score output through positive submission.initialScore or submission.finalScore fallbacks, and a newest failed submission with no usable score could mask an earlier valid scored run.

Root cause
The export SQL filtered negative review summation scores, but it did not check reviews.submission.status before using submission score fallbacks. The submitter and valid submitter CTEs also selected the newest submission before checking whether that row had an exportable Marathon Match score.

What was changed
Added failed/deleted submission status guards before using Marathon Match provisional and final score fallbacks in submitter, valid submitter, and winner exports.
Changed Marathon Match submitter and valid submitter score selection to skip rows where both provisionalScore and finalScore are unavailable, so the latest usable scored run is used instead of a failed no-score run.
Updated the challenge user DTO documentation to describe latest non-failed scored submission behavior.

Any added/updated tests
Updated src/reports/challenges/challenge-export-sql.spec.ts to cover failed/deleted status guards, provisional initialScore fallback, and latest usable score selection for Marathon Match submitter exports.

Validation
pnpm lint passed.
pnpm test -- --runInBand src/reports/challenges/challenge-export-sql.spec.ts src/reports/challenges/challenges-reports.service.spec.ts passed.
pnpm build passed.
pnpm test -- --runInBand still fails in unrelated existing SFDC DTO/service specs and report-directory access coverage on the current branch base.

jmgasper added 3 commits June 19, 2026 10:26
What was broken
Marathon Match submitter exports could show negative failed-run scores, finalScore values while a challenge was still in submission, and a finalRank column before the challenge was completed.

Root cause
The challenge export SQL treated any final score field as exportable regardless of challenge status, used negative review summation scores as normal scores, and always emitted Marathon Match final columns from the formatter.

What was changed
Changed the submitter, valid submitter, and winner SQL to ignore negative Marathon Match scores, only expose finalScore/finalRank data for completed challenges, and avoid falling back to submission.finalScore when a final review row explicitly failed.
Updated the challenge report formatter so Marathon Match finalScore and finalRank columns are only emitted when at least one row has those values.
Updated report descriptions and DTO documentation to match the completed-only final data behavior.

Any added/updated tests
Updated the challenge SQL regression spec for completed-only final scores, negative score filtering, and completed-only final ranks.
Added a service regression test that verifies active Marathon Match exports omit finalScore and finalRank columns when final scoring is unavailable.
What was broken
The previous PM-4151 follow-up suppressed active Marathon Match final columns and negative scores, but the final score fallback still depended on final_review.aggregateScore being non-null. If a final review row exists without a valid non-negative score, the query could still fall back to stale submission.finalScore.

Root cause
The final review lateral subquery only projected aggregateScore, so the scoring CASE could not distinguish no final review row from a final review row that exists but is not usable for export.

What was changed
Projected a has_final_review flag from the final review lateral subqueries for submitter, valid submitter, and winner exports. The Marathon Match final score CASE now falls back to submission.finalScore only when no final review row exists, while existing final review rows with negative or otherwise unusable scores export null.

Any added/updated tests
Updated the challenge export SQL regression spec to require the final review presence guard across submitter, valid submitter, and winner SQL.
What was broken
The previous PM-4151 follow-up suppressed active Marathon Match final columns and guarded final review fallbacks, but failed or deleted Marathon Match submissions could still influence score output. Positive initialScore/finalScore fallbacks from failed submissions could leak stale scores, and a newest failed submission with no usable score could mask an earlier valid scored run.

Root cause
The challenge export SQL filtered negative review summation scores, but the submission.initialScore and submission.finalScore fallback paths did not check reviews.submission.status. The submitter and valid submitter ranking CTEs also selected the newest submission before checking whether it had any usable Marathon Match score.

What was changed
Added failed/deleted submission status guards before using Marathon Match provisional and final score fallbacks in submitter, valid submitter, and winner exports.
Changed Marathon Match submitter and valid submitter score selection to skip rows where both provisionalScore and finalScore are unavailable, so the latest usable scored run is used instead of a failed no-score run.
Updated the challenge user DTO documentation to describe the latest non-failed scored submission behavior.

Any added/updated tests
Updated src/reports/challenges/challenge-export-sql.spec.ts to cover failed/deleted status guards, provisional initialScore fallback, and latest usable score selection for Marathon Match submitter exports.
@jmgasper jmgasper merged commit e3be399 into develop Jun 22, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant