Skip to content

Include memory limit in the job inputs - #1266

Open
MBartkowiakSTFC wants to merge 5 commits into
protosfrom
maciej/memory-use-prediction
Open

Include memory limit in the job inputs#1266
MBartkowiakSTFC wants to merge 5 commits into
protosfrom
maciej/memory-use-prediction

Conversation

@MBartkowiakSTFC

Copy link
Copy Markdown
Collaborator

Description of work
In principle, we could add an input to our jobs letting the user specify their preferred amount of memory that the job should use.

This prototype applies the new approach only to the Dynamic Incoherent Structure Factor calculations.

Fixes

  1. Introduced MemoryConfigurator,
  2. Added new prediction outputs for RAM per process and number of atoms per step.
  3. Connected RunningModeConfigurator to MemoryConfigurator to calculate the total expected RAM use.
  4. Changed the group_per_index function to use a pre-calculated number of atoms per index group.
  5. Created a memory prediction function that is meant to be called by MemoryConfigurator.

To test
Load a trajectory and run DISF on it. Check how the memory requirements on your computer compare to the MDANSE prediction.

@MBartkowiakSTFC MBartkowiakSTFC added enhancement New feature or request question Further information is requested labels Jul 10, 2026
@MBartkowiakSTFC
MBartkowiakSTFC marked this pull request as draft July 10, 2026 10:26
@MBartkowiakSTFC
MBartkowiakSTFC force-pushed the maciej/memory-use-prediction branch from eb8e278 to 0f8dc2c Compare July 21, 2026 09:53
@MBartkowiakSTFC MBartkowiakSTFC changed the title [RFC] Include memory limit in the job inputs Include memory limit in the job inputs Jul 21, 2026
@MBartkowiakSTFC
MBartkowiakSTFC marked this pull request as ready for review July 21, 2026 09:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request question Further information is requested

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant