Reason
Seeing this diff:
htgr/gpbr200/pebble_surrogate_modeling.train: Schema difference detected.
htgr/gpbr200/pebble_surrogate_modeling.train: File 1: /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/pebble_surrogate_modeling/gold/stm_pebble_surrogate_out.json
htgr/gpbr200/pebble_surrogate_modeling.train: File 2: /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/pebble_surrogate_modeling/stm_pebble_surrogate_out.json
htgr/gpbr200/pebble_surrogate_modeling.train: Errors:
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr1_Tfuel'][0][0] changed from 47.93778022457521 to 47.81456977720785.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr1_Tmod'][0][0] changed from 32.9195508849906 to 32.71684003067046.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr2_Tfuel'][0][0] changed from 17.7422000068469 to 17.7978789743987.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr2_Tmod'][0][0] changed from 11.775508161596353 to 11.89400707545286.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr4_Tfuel'][0][0] changed from 6.89988566743494 to 6.895868401191566.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr4_Tmod'][0][0] changed from 4.675869470853429 to 4.672764362139111.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr6_Tfuel'][0][0] changed from 3.4345997680514437 to 3.511172355247739.
htgr/gpbr200/pebble_surrogate_modeling.train: Value of root['time_steps'][1]['cv']['pr6_Tmod'][0][0] changed from 2.323928864773492 to 2.3698518255349637.
htgr/gpbr200/pebble_surrogate_modeling.train:
htgr/gpbr200/pebble_surrogate_modeling.train:
on https://civet.inl.gov/job/3887675/
and this one
htgr/gpbr200/sensitivity_analysis.lhs_sampling: Running csvdiff: /opt/blue_crab/share/moose/python/mooseutils/csvdiff.py /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/sensitivity_analysis/gold/stm_lhs_sampling_out_storage_0001.csv /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/sensitivity_analysis/stm_lhs_sampling_out_storage_0001.csv --relative-tolerance 5.5e-06 --abs-zero 1e-10
htgr/gpbr200/sensitivity_analysis.lhs_sampling: ERROR: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "burnup_limit_weight" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 1.592e+02 ~ 1.550e+02 = 2.607e-02 (2.607e-02)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "data:Trpv_max:value" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 5.181e+02 ~ 4.956e+02 = 4.347e-02 (4.347e-02)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "data:eigenvalue:value" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 8.661e-01 ~ 1.108e+00 = 2.181e-01 (2.181e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "data:peaking_factor:value" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 1.762e+00 ~ 1.815e+00 = 2.887e-02 (2.887e-02)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "data:pebble_power_max:value" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 2.865e+03 ~ 2.283e+03 = 2.029e-01 (2.029e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "enrichment" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 1.017e-01 ~ 1.916e-01 = 4.693e-01 (4.693e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "filling_factor" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 8.599e-02 ~ 6.916e-02 = 1.957e-01 (1.957e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "kernel_radius" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 2.622e-04 ~ 2.157e-04 = 1.773e-01 (1.773e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "pebble_unloading_rate" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 4.309e-02 ~ 4.031e-02 = 6.452e-02 (6.452e-02)
htgr/gpbr200/sensitivity_analysis.lhs_sampling: In file stm_lhs_sampling_out_storage_0001.csv: The values in column "total_power" don't match at row 0.
htgr/gpbr200/sensitivity_analysis.lhs_sampling: relative diff: 2.130e+08 ~ 1.822e+08 = 1.444e-01 (1.444e-01)
htgr/gpbr200/sensitivity_analysis.lhs_sampling:
htg
and this one crashes
tgr/gpbr200/coupling.coupling: --------------------------------------------------------------------------
htgr/gpbr200/coupling.coupling: prterun detected that one or more processes exited with non-zero status,
htgr/gpbr200/coupling.coupling: thus causing the job to be terminated. The first process to do so was:
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: Process name: [prterun-wr8n21-76458@1,10] Exit code: 247
htgr/gpbr200/coupling.coupling: --------------------------------------------------------------------------
htgr/gpbr200/coupling.coupling: ################################################################################
htgr/gpbr200/coupling.coupling: Apptainer exited with code 247, using 119 instead
htgr/gpbr200/coupling.coupling: Completed TestHarness slurm test execution; exit code = 119, walltime = 81.75 sec
htgr/gpbr200/coupling.coupling: Failed to find output /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/coupling/gpbr200_ss_gfnk_reactor_out_pronghorn_th0.csv
htgr/gpbr200/coupling.coupling: Failed to find output /scratch/romebuild9-service/build/copied_tests/htgr/gpbr200/coupling/gpbr200_ss_gfnk_reactor_out.csv
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: ################################################################################
htgr/gpbr200/coupling.coupling: End runner_run output
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: ################################################################################
htgr/gpbr200/coupling.coupling: Begin tester output
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: Exit Code: 119
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: Tester failed, reason: EXIT CODE 119 != 0
htgr/gpbr200/coupling.coupling:
htgr/gpbr200/coupling.coupling: ################################################################################
htgr/gpbr200/coupling.coupling: End tester output
Remedial
Likely regold the solution once change cause has been identified
Impact
Keep VTB models operational
Reason
Seeing this diff:
on https://civet.inl.gov/job/3887675/
and this one
and this one crashes
Remedial
Likely regold the solution once change cause has been identified
Impact
Keep VTB models operational