Maneage - Bugs: bug #62879, Maneage handling of /dev/shm does...
You are not allowed to post comments on this tracker with your current authentication level.
bug #62879: Maneage handling of /dev/shm does not know about slurm
Submitter: | Boud Roukema <boud> | ||
Submitted: | Mon 08 Aug 2022 08:24:49 PM UTC | ||
Category: | Software | Severity: | 3 - Normal |
Item Group: | Crash | Status: | None |
Privacy: | Public | Assigned to: | None |
Open/Closed: | Open |
Thu 11 Aug 2022 10:10:09 AM UTC, comment #1: |
Boud Roukema <boud>![]() |
Mon 08 Aug 2022 08:24:49 PM UTC, original submission:
DESCRIPTION: In both (i) reproduce/software/shell/configure.sh and (ii) reproduce/software/make/basic.mk we have tests for the amount of RAM available in /dev/shm. Firstly, these should be associated with each other in some way, since someone may not realise that there are two separate tests. Secondly, neither of these take into account RAM limits imposed by a task allocation manager such as 'slurm' on an HPC (high-performance computing) shared system of systems. These can lead to a crash because the 'slurm' RAM limit is violated and Maneage (via (i) and (ii)) cannot protect against that.
where /tmp is also a RAM disk of type tmpfs . Although this error occurs when trying to write to /tmp, not to /dev/shm, slurm tools presumably check the total RAM used by the user's task. Increasing the --mem=... parameter given to sbatch by a few GiB prevents the crashes, and does not intervene in memory allocation to /tmp.
|
Boud Roukema <boud>![]() |
No files currently attached
Depends on the following items: None found
Items that depend on this one: None found
There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.
Powered by Savane 3.12.
Corresponding source code
See https://savannah.nongnu.org/task/index.php?16244#comment9 for related discussion: /tmp/fs, gcc compilation RAM, gcc src RAM, gcc working file RAM, all need to be taken into account.