Is there documentation somewhere for how to launch Nh MPI processes on the host and Nm MPI processes on the MIC using Hydra? TACC told me that Intel MPI's Hydra supports this so I guess MPICH's does as well but I'm not sure how to do it. I only care about launching on a single box right now, not a cluster, so interactions with multiple nodes, IB, etc. don't matter to me. And when I run in this mode, I will be using Nemesis shm within the host and within the MIC while using SCIF between them, right? Thanks, Jeff -- Jeff Hammond Argonne Leadership Computing Facility University of Chicago Computation Institute [email protected] / (630) 252-5381 http://www.linkedin.com/in/jeffhammond https://wiki.alcf.anl.gov/parts/index.php/User:Jhammond