Please see messages re: connectivity issues. I confirm that bblogin is unreachable, and I can't ping it from home, but I can connect from login.mcs.anl.gov. I can't say I've ever connected directly to bblogin, but I would think ICMP should work. Could this be trouble with the hpc router? ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Forwarded Message ----- From: "Steven Pieper" <[email protected]> To: "Paul Hargrove" <[email protected]> Cc: [email protected] Sent: Friday, August 24, 2012 9:41:26 PM Subject: Re: [Early-users-discuss] network outage? Yes, I also can reach intrepid from home. So the problem seems to be in Bldg 240, but not all of it. Steve Steven C. Pieper: [email protected] Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100 On 08/24/2012 09:38 PM, Paul Hargrove wrote:
Odd/interesting data points:
From an lbl.gov <http://lbl.gov> host: + I can reach terra.mcs.anl.gov <http://terra.mcs.anl.gov> but not bblogin.mcs.anl.gov <http://bblogin.mcs.anl.gov>. + I can reach surveyor but not vesta.
From terra.mcs.anl.gov <http://terra.mcs.anl.gov> I *can* reach bblogin and vesta which I can't reach from LBL.
-Paul
On Fri, Aug 24, 2012 at 7:31 PM, Steven Pieper <[email protected] <mailto:[email protected]>> wrote:
I just set a report to td-support:
I cannot connect to vesta, mira, fd from home. But if I ssh first to PHY then I can go on into alcf.
I can connect directly to fusion.
Steve
Steven C. Pieper: [email protected] <mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 <tel:630-252-4232> Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:28 PM, Paul Hargrove wrote:
It looks like alcf.anl.gov <http://alcf.anl.gov> <http://alcf.anl.gov> just dropped off the net! Is/was this a planned outage?
Of course, chances are nobody will see this until the problem is fixed :-)
-Paul
-- Paul H. Hargrove [email protected] <mailto:[email protected]> <mailto:[email protected] <mailto:[email protected]>> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 <tel:%2B1-510-495-2352> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 <tel:%2B1-510-486-6900>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
-- Paul H. Hargrove [email protected] <mailto:[email protected]> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
_______________________________________________ early-users-discuss mailing list [email protected] https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss
I can connect to login nodes and our compute. I can confirm that I cannot get to miralac1.alcf.anl.gov from offsite, but I can from MCS. On Aug 24, 2012, at 9:51 PM, Dan Olson wrote:
Please see messages re: connectivity issues. I confirm that bblogin is unreachable, and I can't ping it from home, but I can connect from login.mcs.anl.gov. I can't say I've ever connected directly to bblogin, but I would think ICMP should work.
Could this be trouble with the hpc router?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Forwarded Message ----- From: "Steven Pieper" <[email protected]> To: "Paul Hargrove" <[email protected]> Cc: [email protected] Sent: Friday, August 24, 2012 9:41:26 PM Subject: Re: [Early-users-discuss] network outage?
Yes, I also can reach intrepid from home. So the problem seems to be in Bldg 240, but not all of it.
Steve
Steven C. Pieper: [email protected] Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:38 PM, Paul Hargrove wrote:
Odd/interesting data points:
From an lbl.gov <http://lbl.gov> host: + I can reach terra.mcs.anl.gov <http://terra.mcs.anl.gov> but not bblogin.mcs.anl.gov <http://bblogin.mcs.anl.gov>. + I can reach surveyor but not vesta.
From terra.mcs.anl.gov <http://terra.mcs.anl.gov> I *can* reach bblogin and vesta which I can't reach from LBL.
-Paul
On Fri, Aug 24, 2012 at 7:31 PM, Steven Pieper <[email protected] <mailto:[email protected]>> wrote:
I just set a report to td-support:
I cannot connect to vesta, mira, fd from home. But if I ssh first to PHY then I can go on into alcf.
I can connect directly to fusion.
Steve
Steven C. Pieper: [email protected] <mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 <tel:630-252-4232> Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:28 PM, Paul Hargrove wrote:
It looks like alcf.anl.gov <http://alcf.anl.gov> <http://alcf.anl.gov> just dropped off the net! Is/was this a planned outage?
Of course, chances are nobody will see this until the problem is fixed :-)
-Paul
-- Paul H. Hargrove [email protected] <mailto:[email protected]> <mailto:[email protected] <mailto:[email protected]>> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 <tel:%2B1-510-495-2352> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 <tel:%2B1-510-486-6900>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
-- Paul H. Hargrove [email protected] <mailto:[email protected]> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
_______________________________________________ early-users-discuss mailing list [email protected] https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss
-- Craig
Tisha confirms that if they go through ISSF hosts, they can get to ALCF machines in 240. On Aug 24, 2012, at 10:13 PM, Craig Stacey wrote:
I can connect to login nodes and our compute. I can confirm that I cannot get to miralac1.alcf.anl.gov from offsite, but I can from MCS.
On Aug 24, 2012, at 9:51 PM, Dan Olson wrote:
Please see messages re: connectivity issues. I confirm that bblogin is unreachable, and I can't ping it from home, but I can connect from login.mcs.anl.gov. I can't say I've ever connected directly to bblogin, but I would think ICMP should work.
Could this be trouble with the hpc router?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Forwarded Message ----- From: "Steven Pieper" <[email protected]> To: "Paul Hargrove" <[email protected]> Cc: [email protected] Sent: Friday, August 24, 2012 9:41:26 PM Subject: Re: [Early-users-discuss] network outage?
Yes, I also can reach intrepid from home. So the problem seems to be in Bldg 240, but not all of it.
Steve
Steven C. Pieper: [email protected] Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:38 PM, Paul Hargrove wrote:
Odd/interesting data points:
From an lbl.gov <http://lbl.gov> host: + I can reach terra.mcs.anl.gov <http://terra.mcs.anl.gov> but not bblogin.mcs.anl.gov <http://bblogin.mcs.anl.gov>. + I can reach surveyor but not vesta.
From terra.mcs.anl.gov <http://terra.mcs.anl.gov> I *can* reach bblogin and vesta which I can't reach from LBL.
-Paul
On Fri, Aug 24, 2012 at 7:31 PM, Steven Pieper <[email protected] <mailto:[email protected]>> wrote:
I just set a report to td-support:
I cannot connect to vesta, mira, fd from home. But if I ssh first to PHY then I can go on into alcf.
I can connect directly to fusion.
Steve
Steven C. Pieper: [email protected] <mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 <tel:630-252-4232> Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:28 PM, Paul Hargrove wrote:
It looks like alcf.anl.gov <http://alcf.anl.gov> <http://alcf.anl.gov> just dropped off the net! Is/was this a planned outage?
Of course, chances are nobody will see this until the problem is fixed :-)
-Paul
-- Paul H. Hargrove [email protected] <mailto:[email protected]> <mailto:[email protected] <mailto:[email protected]>> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 <tel:%2B1-510-495-2352> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 <tel:%2B1-510-486-6900>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
-- Paul H. Hargrove [email protected] <mailto:[email protected]> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
_______________________________________________ early-users-discuss mailing list [email protected] https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss
-- Craig
-- Craig
I can reach bblogin.mcs.anl.gov from login.mcs.anl.gov, but not from my home network. Here's the traceroute from home: bender.local (0.0.0.0) Fri Aug 24 22:15:59 2012 Keys: Help Display mode Restart statistics Order of fields quit Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 192.168.1.1 0.0% 8 3.7 2.1 0.8 5.0 1.7 2. c-67-162-114-1.hsd1.il.comcast.net 0.0% 8 26.9 31.9 26.9 42.3 5.5 3. te-0-1-0-5-sur04.elmhurst.il.chicago.comcast.net 0.0% 8 9.5 13.0 9.5 17.5 2.6 4. te-0-7-0-1-sur03.elmhurst.il.chicago.comcast.net 0.0% 8 17.6 21.7 9.6 74.5 21.7 5. te-2-8-0-10-ar01.area4.il.chicago.comcast.net 0.0% 8 22.0 29.3 16.8 71.3 17.3 6. 68.86.91.33 0.0% 8 19.1 20.1 16.8 26.2 3.2 7. pos-1-1-0-0-pe01.350ecermak.il.ibone.comcast.net 0.0% 8 16.6 17.5 14.7 23.0 2.5 8. xe-2-2-0.792.chic0.tr-cps.internet2.edu 0.0% 8 33.4 20.8 16.8 33.4 5.7 9. 64.57.21.142 0.0% 8 19.4 20.6 15.5 45.4 10.1 10. guava-v3801-sdn-sdsc.anchor.anl.gov 0.0% 8 16.2 21.2 16.2 29.0 4.5 11. 130.202.222.105 0.0% 8 22.3 23.3 17.1 33.2 5.4 12. ??? -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby Schmitz" <[email protected]>, "Linda Winkler" <[email protected]> Sent: Friday, August 24, 2012 10:13:31 PM Subject: Re: [Early-users-discuss] network outage? Tisha confirms that if they go through ISSF hosts, they can get to ALCF machines in 240. On Aug 24, 2012, at 10:13 PM, Craig Stacey wrote:
I can connect to login nodes and our compute. I can confirm that I cannot get to miralac1.alcf.anl.gov from offsite, but I can from MCS.
On Aug 24, 2012, at 9:51 PM, Dan Olson wrote:
Please see messages re: connectivity issues. I confirm that bblogin is unreachable, and I can't ping it from home, but I can connect from login.mcs.anl.gov. I can't say I've ever connected directly to bblogin, but I would think ICMP should work.
Could this be trouble with the hpc router?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Forwarded Message ----- From: "Steven Pieper" <[email protected]> To: "Paul Hargrove" <[email protected]> Cc: [email protected] Sent: Friday, August 24, 2012 9:41:26 PM Subject: Re: [Early-users-discuss] network outage?
Yes, I also can reach intrepid from home. So the problem seems to be in Bldg 240, but not all of it.
Steve
Steven C. Pieper: [email protected] Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:38 PM, Paul Hargrove wrote:
Odd/interesting data points:
From an lbl.gov <http://lbl.gov> host: + I can reach terra.mcs.anl.gov <http://terra.mcs.anl.gov> but not bblogin.mcs.anl.gov <http://bblogin.mcs.anl.gov>. + I can reach surveyor but not vesta.
From terra.mcs.anl.gov <http://terra.mcs.anl.gov> I *can* reach bblogin and vesta which I can't reach from LBL.
-Paul
On Fri, Aug 24, 2012 at 7:31 PM, Steven Pieper <[email protected] <mailto:[email protected]>> wrote:
I just set a report to td-support:
I cannot connect to vesta, mira, fd from home. But if I ssh first to PHY then I can go on into alcf.
I can connect directly to fusion.
Steve
Steven C. Pieper: [email protected] <mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 <tel:630-252-4232> Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:28 PM, Paul Hargrove wrote:
It looks like alcf.anl.gov <http://alcf.anl.gov> <http://alcf.anl.gov> just dropped off the net! Is/was this a planned outage?
Of course, chances are nobody will see this until the problem is fixed :-)
-Paul
-- Paul H. Hargrove [email protected] <mailto:[email protected]> <mailto:[email protected] <mailto:[email protected]>> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 <tel:%2B1-510-495-2352> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 <tel:%2B1-510-486-6900>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
-- Paul H. Hargrove [email protected] <mailto:[email protected]> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
_______________________________________________ early-users-discuss mailing list [email protected] https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss
-- Craig
-- Craig
It was our work, more specifically my work this evening. There seems to be a problem with the default network configuration on the brocade. It was not transiting traffic as expected for networks that we don't have route entries for (i.e. default gateway traffic). Still looking, but we failed back to our primary ESNet circuit. sorry I didn't catch this sooner. corby ________________________________________ From: Craig Stacey [[email protected]] Sent: Friday, August 24, 2012 10:16 PM To: Olson, Daniel E. Cc: [email protected]; Corby Schmitz; Linda Winkler Subject: Re: [Early-users-discuss] network outage? I can reach bblogin.mcs.anl.gov from login.mcs.anl.gov, but not from my home network. Here's the traceroute from home: bender.local (0.0.0.0) Fri Aug 24 22:15:59 2012 Keys: Help Display mode Restart statistics Order of fields quit Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 192.168.1.1 0.0% 8 3.7 2.1 0.8 5.0 1.7 2. c-67-162-114-1.hsd1.il.comcast.net 0.0% 8 26.9 31.9 26.9 42.3 5.5 3. te-0-1-0-5-sur04.elmhurst.il.chicago.comcast.net 0.0% 8 9.5 13.0 9.5 17.5 2.6 4. te-0-7-0-1-sur03.elmhurst.il.chicago.comcast.net 0.0% 8 17.6 21.7 9.6 74.5 21.7 5. te-2-8-0-10-ar01.area4.il.chicago.comcast.net 0.0% 8 22.0 29.3 16.8 71.3 17.3 6. 68.86.91.33 0.0% 8 19.1 20.1 16.8 26.2 3.2 7. pos-1-1-0-0-pe01.350ecermak.il.ibone.comcast.net 0.0% 8 16.6 17.5 14.7 23.0 2.5 8. xe-2-2-0.792.chic0.tr-cps.internet2.edu 0.0% 8 33.4 20.8 16.8 33.4 5.7 9. 64.57.21.142 0.0% 8 19.4 20.6 15.5 45.4 10.1 10. guava-v3801-sdn-sdsc.anchor.anl.gov 0.0% 8 16.2 21.2 16.2 29.0 4.5 11. 130.202.222.105 0.0% 8 22.3 23.3 17.1 33.2 5.4 12. ??? -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby Schmitz" <[email protected]>, "Linda Winkler" <[email protected]> Sent: Friday, August 24, 2012 10:13:31 PM Subject: Re: [Early-users-discuss] network outage? Tisha confirms that if they go through ISSF hosts, they can get to ALCF machines in 240. On Aug 24, 2012, at 10:13 PM, Craig Stacey wrote:
I can connect to login nodes and our compute. I can confirm that I cannot get to miralac1.alcf.anl.gov from offsite, but I can from MCS.
On Aug 24, 2012, at 9:51 PM, Dan Olson wrote:
Please see messages re: connectivity issues. I confirm that bblogin is unreachable, and I can't ping it from home, but I can connect from login.mcs.anl.gov. I can't say I've ever connected directly to bblogin, but I would think ICMP should work.
Could this be trouble with the hpc router?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Forwarded Message ----- From: "Steven Pieper" <[email protected]> To: "Paul Hargrove" <[email protected]> Cc: [email protected] Sent: Friday, August 24, 2012 9:41:26 PM Subject: Re: [Early-users-discuss] network outage?
Yes, I also can reach intrepid from home. So the problem seems to be in Bldg 240, but not all of it.
Steve
Steven C. Pieper: [email protected] Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:38 PM, Paul Hargrove wrote:
Odd/interesting data points:
From an lbl.gov <http://lbl.gov> host: + I can reach terra.mcs.anl.gov <http://terra.mcs.anl.gov> but not bblogin.mcs.anl.gov <http://bblogin.mcs.anl.gov>. + I can reach surveyor but not vesta.
From terra.mcs.anl.gov <http://terra.mcs.anl.gov> I *can* reach bblogin and vesta which I can't reach from LBL.
-Paul
On Fri, Aug 24, 2012 at 7:31 PM, Steven Pieper <[email protected] <mailto:[email protected]>> wrote:
I just set a report to td-support:
I cannot connect to vesta, mira, fd from home. But if I ssh first to PHY then I can go on into alcf.
I can connect directly to fusion.
Steve
Steven C. Pieper: [email protected] <mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 <tel:630-252-4232> Fax -6008 Secretary, Debra Morrison, -4100
On 08/24/2012 09:28 PM, Paul Hargrove wrote:
It looks like alcf.anl.gov <http://alcf.anl.gov> <http://alcf.anl.gov> just dropped off the net! Is/was this a planned outage?
Of course, chances are nobody will see this until the problem is fixed :-)
-Paul
-- Paul H. Hargrove [email protected] <mailto:[email protected]> <mailto:[email protected] <mailto:[email protected]>> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 <tel:%2B1-510-495-2352> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 <tel:%2B1-510-486-6900>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
_________________________________________________ early-users-discuss mailing list early-users-discuss@lists.__alcf.anl.gov <mailto:[email protected]> https://lists.alcf.anl.gov/__mailman/listinfo/early-users-__discuss <https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss>
-- Paul H. Hargrove [email protected] <mailto:[email protected]> Future Technologies Group Computer and Data Sciences Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
_______________________________________________ early-users-discuss mailing list [email protected] https://lists.alcf.anl.gov/mailman/listinfo/early-users-discuss
-- Craig
-- Craig
participants (3)
-
Craig Stacey -
Dan Olson -
Schmitz, Corby B.