Skip to content

268 ensemble multi rank mpi tasks launch multiple processes but each reports a singleton mpi world - #269

Open
markcoletti wants to merge 3 commits into
0.9.0-prereleasefrom
268-ensemble-multi-rank-mpi-tasks-launch-multiple-processes-but-each-reports-a-singleton-mpi-world
Open

markcoletti wants to merge 3 commits into
0.9.0-prereleasefrom
268-ensemble-multi-rank-mpi-tasks-launch-multiple-processes-but-each-reports-a-singleton-mpi-world

Conversation

@markcoletti

Copy link
Copy Markdown

This makes some changes to the prun command line to ensure that we get the desired behavior for specifying multiple ranks and cores-per-rank for launched tasks. A note warning of Mich MPI vs. OpenMPI compatibility has been added to the ensemble readthedocs page.

@markcoletti markcoletti self-assigned this Nov 6, 2026
raise Exception('Missing %s command in $PATH' % (mpi_binary))

nproc_flag = '-np'
nproc_flag = '-n'

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does this actually do? I checked the output of prun --help using version 3.0.8 and I noted that these flags are referenced differently, but have the same description:

+----------------------+-----------------------------------------------+
|                      | Launch Options                                |
+----------------------+-----------------------------------------------+
| Option               | Description                                   |
|======================|===============================================|
| "--runtime-options   | Comma-delimited list of runtime directives    |
| <arg0>"              | for the job (e.g., do not abort if a process  |
|                      | exits on non-zero status)                     |
+----------------------+-----------------------------------------------+
| "-c" | "--np         | Number of processes to run                    |
| <num_procs>"         |                                               |
+----------------------+-----------------------------------------------+
| "-n" | "--n          | Number of processes to run                    |
| <num_procs>"         |                                               |
+----------------------+-----------------------------------------------+

I couldn't find any documentation for mpirun 5.0.7 (perlmutter), but for version 4.1.6 I did find this, where the options are also listed separately but have the same description:

mpirun (Open MPI) 4.1.6

Usage: mpirun [OPTION]...  [PROGRAM]...
Start the given program using Open RTE

-c|-np|--np <arg0>       Number of processes to run
-h|--help <arg0>         This help message
   -n|--n <arg0>         Number of processes to run

In any case this seems to work fine on my end

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants