Skip to content

Add logging filter to exclude per-task subprocess output from sflow.log#11

Merged
RogerLiu312 merged 1 commit into
mainfrom
hotfix/batch-mode-logging-light-fix
Jun 17, 2026
Merged

Add logging filter to exclude per-task subprocess output from sflow.log#11
RogerLiu312 merged 1 commit into
mainfrom
hotfix/batch-mode-logging-light-fix

Conversation

@RogerLiu312

Copy link
Copy Markdown
Collaborator
  • Introduced a new logging filter, _DropTaskStreamFilter, to prevent per-task subprocess output from being written to sflow.log, ensuring that only orchestration lines and command/status hints are logged.
  • Updated logging configuration to apply this filter to file handlers.
  • Enhanced the SubprocessLauncher to conditionally echo per-task output to the root logger based on whether the output is being streamed to an interactive console.
  • Added unit tests to verify the correct routing of per-task output and the functionality of the logging filter.

- Introduced a new logging filter, `_DropTaskStreamFilter`, to prevent per-task subprocess output from being written to sflow.log, ensuring that only orchestration lines and command/status hints are logged.
- Updated logging configuration to apply this filter to file handlers.
- Enhanced the `SubprocessLauncher` to conditionally echo per-task output to the root logger based on whether the output is being streamed to an interactive console.
- Added unit tests to verify the correct routing of per-task output and the functionality of the logging filter.
@RogerLiu312
RogerLiu312 merged commit 6efbf59 into main Jun 17, 2026
3 checks passed
RogerLiu312 added a commit that referenced this pull request Jul 22, 2026
Brings the v0.3.0 release line into main: Kubernetes backend (k8s / k8s_mpi),
merge-pod same-node GPU fabrics, recursive deep-merge composition, declarative
result parsing + S3 uploads, hardware monitoring, and richer run summaries.

The logging-filter files (logging.py, core/launcher.py, cli/batch.py and their
tests) conflicted because the main-only hotfix (#11: _DropTaskStreamFilter
per-task log routing + venv bootstrap fix) was developed independently on both
branches. Resolved by taking develop's version, which already incorporates that
hotfix as a strict superset (every main-side test also present on develop).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant