Hi, Both PMIx and UCX are runtime dependencies. They must be available on all nodes where your application runs. Location is mostly a style decision. Many systems use /usr/local for packages installed manually (i.e. not by the system package manager). GPFS is also a fine option, which allows you to install only once. Ken On 12/12/19 8:54 AM, Sajid Ali via discuss wrote:

Hi MPICH-developers,

I'm trying to help the sysadmins at my univ. cluster install mpich using spack with ucx and pmix (previously we just let mpich interact with slurm's pmi2 and as mentioned on the mailing list the old versions of mpich either failed to read the nodelist properly or were (incorrectly) configured with default TCP/IP transport protocols).

After the sysadmins installed pmix-2.2.3 and pmix-3.1.3 from rpm's at /usr/lib64/pmix-version (and configured slurm to use them), I tried building mpich in my home folder (on GPFS) but it was giving a build error as it was picking up some wrong libraries from /usr/lib64. When I installed pmix using spack in my home directory (on GPFS), I was able to build mpich-devel against it.

What is the best location to install pmix and ucx? Does it have to be available on every node and if yes would it be on the local file system on each node or GPFS file-system ? Or is it okay to have it installed on the slurm launcher node alone ?

Hope this is the right place to ask this question and thanks in advance for the help!

-- Sajid Ali | PhD Candidate Applied Physics Northwestern University s-sajid-ali.github.io <http://s-sajid-ali.github.io>

_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss