Hi  Muhammad, Huiwei,

There is a Hybrid MPI(HMPI) library which aims at implementing MPI efficiently on both inter-node network and shared memory architecture. Here are some papers talking about this, which may give you some info.

Ownership Passing: Efficient Distributed Memory Programming on Multi-core Systems

NUMA-Aware Shared Memory Collective Communication for MPI

Hybrid MPI: Efficient Message Passing for Multi-core Systems

Best Regards,

Shigang

On Thu, Aug 29, 2013 at 12:31 PM, Muhammad Ansar Javed <muhammad.ansar@seecs.edu.pk> wrote:

Hi Huiwei,

Thank you so much for suggesting reading material. These are really useful papers but I am looking for models that provide seamless integration of two devices (Network device and Shared Memory device) into one hybrid device. Message passing mechanism should be exactly same  for end user at MPI layer. 

Idea is to use to use Network Device for establishing network communication between nodes and Shared memory device should be responsible for Intra-node communication on each multi-core machine. Shared Memory device is implemented using Multi-threading approach. Both Network and Shared Memory device are in working state independently.

I hope it explains what I am really looking for. Please suggest papers that can provide guidelines for achieving this goal.

On Wed, Aug 28, 2013 at 7:40 PM, Huiwei Lu <huiweilu@mcs.anl.gov> wrote:

Hi, Muhammad,

As I am also starting to exploit this area, I would like to share with you some of my readings.

Following are a few papers to help you start:

1. Early Experiments with the OpenMP/MPI Hybrid Programming Model, http://www.mcs.anl.gov/~lusk/hybridpaper.pdf

2. Test Suite for Evaluating Performance of MPI Implementations That Support MPI THREAD MULTIPLE, http://www.mcs.anl.gov/~thakur/papers/thread-tests.pdf

In the second paper, you can also find some code examples for using hybrid programming model.

Best,

Huiwei Lu

http://www.mcs.anl.gov/~huiweilu/

On Wed, Aug 28, 2013 at 12:54 AM, Muhammad Ansar Javed <muhammad.ansar@seecs.edu.pk> wrote:

Hi,

I am looking for message passing models for Hybrid Parallelism that are being used in MPICH implementations for the Cluster of Multi-core machines. Can you please suggest me some papers or study material that can explain communication models that incorporate network communication as well as shared memory communication.  

Thanks,

Ansar

--

Regards:

Muhammad Ansar Javed
NUST SEECS
Contact: +92 334 438 9394
Email: muhammad.ansar@seecs.edu.pk