Skip to content

surface warnings in the report dashboard - #127

Open
Nina-mvH wants to merge 4 commits into
mainfrom
97-surface-warnings-in-report
Open

surface warnings in the report dashboard#127
Nina-mvH wants to merge 4 commits into
mainfrom
97-surface-warnings-in-report

Conversation

@Nina-mvH

Copy link
Copy Markdown
Collaborator

Surfaces warnings found in the log files in the report dashboard:

Screenshot 2026-08-26 at 3 52 30 PM

To do this, the log(s) are parsed, similarly to the metrics parsing, and each time WARNING is encountered, the count increases by one (unless the warning is about shutting down). In the same dictionary, a count is kept of the total number of files processed (using number of METRICS lines) to print the "across N file(s)" information.

@yoonspark I plan to add some unit tests to this PR, but I just wanted to get your feedback on the design/approach before implementing those.

Closes #97

Preliminary attempt at adding a warnigns section to
the report dashboard. If any of the successful files
contained warnings, this section will print (per task,
the total num warnings, min, max, and average).

Changes include:
* FileMetics updated to have default values (revisit)
* _parse_all_metrics updated to search for warnings (edge cases)
* _compute_warning_summary added

Things that need to be cleaned up:
* Clarify if warnings should be counted if file failed
* Add path to log file
* Clean up printing (ie. formatting and decimal points)
* Address edge cases in models.py code
Now, the warnigng information is stored in the format:
{"task_name":{"num_files_processed":0, "num_warnings":0}.
Instead of the warnings being associated with specific files,
they are simply summed at the task level. This means
concurrently running files will not cause issues and is overall
less brittle than the previous approach.
@Nina-mvH
Nina-mvH requested a review from yoonspark August 31, 2026 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Surface warnings to users

1 participant