Add efficient local I/O classes - #50
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
Why
Researchers need practical guidance for keeping temporary and random I/O on job-local storage while preserving durable input and final results on approved shared storage. The architecture class explains why metadata, object storage, network links, and caches behave differently under streaming and small-file workloads.
User impact
Learners can compare direct shared-storage access with local staging using synthetic data, use the RCC
SLURM_TMPDIRpattern, validate output before publication, and diagnose I/O bottlenecks without exposing infrastructure inventory or patient identifiers.Integration notes
The supplied v3 patch was malformed and targeted an older navigation layout. This PR repairs the content and adapts it to the current ClusterDocs NG structure, renderer, publication policy, canonical scratch path, and Class 1–13 numbering system.
Validation
git diff --check: PASSThe standalone MkDocs strict build still encounters the branch's existing media/download warnings; it reports no new warnings for Classes 12 or 13.