GNU gdb (GDB) Red Hat Enterprise Linux (7.2-50.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /root/xm/osu_benchmarks/osu_bw...done. [New Thread 20946] Missing separate debuginfo for Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/08/f634a1d22deff00461d50a7699dacdc97657bf Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libnss_files.so.2 Core was generated by `./osu_bw'. Program terminated with signal 11, Segmentation fault. #0 OPA_load_ptr (vc=0x209544b8, hdr=0x7fff58234110, hdr_sz=40, sreq_ptr=0x7fff58234160) at /root/xm/mpich-3.0.3/src/openpa/src/primitives/opa_gcc_intel_32_64_ops.h:46 46 return ptr->v; Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.47.el6.x86_64 (gdb) bt #0 OPA_load_ptr (vc=0x209544b8, hdr=0x7fff58234110, hdr_sz=40, sreq_ptr=0x7fff58234160) at /root/xm/mpich-3.0.3/src/openpa/src/primitives/opa_gcc_intel_32_64_ops.h:46 #1 MPID_nem_queue_dequeue (vc=0x209544b8, hdr=0x7fff58234110, hdr_sz=40, sreq_ptr=0x7fff58234160) at ../mpich-3.0.3/src/mpid/ch3/channels/nemesis/include/mpid_nem_queue.h:192 #2 MPID_nem_mpich_send_header (vc=0x209544b8, hdr=0x7fff58234110, hdr_sz=40, sreq_ptr=0x7fff58234160) at ../mpich-3.0.3/src/mpid/ch3/channels/nemesis/include/mpid_nem_inline.h:111 #3 MPIDI_CH3_iStartMsg (vc=0x209544b8, hdr=0x7fff58234110, hdr_sz=40, sreq_ptr=0x7fff58234160) at ../mpich-3.0.3/src/mpid/ch3/channels/nemesis/src/ch3_istartmsg.c:59 #4 0x000000000044ad04 in MPID_nem_lmt_dma_progress () at ../mpich-3.0.3/src/mpid/ch3/channels/nemesis/src/mpid_nem_lmt_dma.c:562 #5 0x000000000044077b in MPIDI_CH3I_Progress (progress_state=0x7fff582347f0, is_blocking=) at ../mpich-3.0.3/src/mpid/ch3/channels/nemesis/src/ch3_progress.c:460 #6 0x00000000004100aa in MPIR_Waitall_impl (count=64, array_of_requests=0x107d0200, array_of_statuses=0x207e11a0) at ../mpich-3.0.3/src/mpi/pt2pt/waitall.c:159 #7 0x0000000000410750 in PMPI_Waitall (count=64, array_of_requests=0x107d0200, array_of_statuses=0x207e11a0) at ../mpich-3.0.3/src/mpi/pt2pt/waitall.c:297 #8 0x0000000000409470 in main ()