Dan's been invoked. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed? I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan. -- Craig ----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed? My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP? -- corby

I don't. Do you have Ken's number? -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed? Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed? Dan's been invoked. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed? I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan. -- Craig ----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed? My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP? -- corby

I can be onsite in 20 minutes if it would help to have a physical presence. -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:46:50 AM Subject: Re: Auth is hosed? I left him a voicemail. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:45:31 AM Subject: Re: Auth is hosed? I don't. Do you have Ken's number? -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed? Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed? Dan's been invoked. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed? I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan. -- Craig ----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed? My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP? -- corby

hmm.. my cryptocard just let me into namby. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected] Sent: Saturday, August 25, 2012 9:56:40 AM Subject: Re: Auth is hosed? I'll just head in. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:47:47 AM Subject: Re: Auth is hosed? I can be onsite in 20 minutes if it would help to have a physical presence. -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:46:50 AM Subject: Re: Auth is hosed? I left him a voicemail. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:45:31 AM Subject: Re: Auth is hosed? I don't. Do you have Ken's number? -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed? Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed? Dan's been invoked. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed? I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan. -- Craig ----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed? My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP? -- corby

Unsure. It's not letting me in. -- Craig ----- Original Message ----- From: "Linda Winkler" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], [email protected] Sent: Saturday, August 25, 2012 9:59:11 AM Subject: Re: Auth is hosed? I confirm we can use CC to access anchor device. What changed? lw On Aug 25, 2012, at 9:57 AM, Dan Olson wrote:

hmm.. my cryptocard just let me into namby.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected] Sent: Saturday, August 25, 2012 9:56:40 AM Subject: Re: Auth is hosed?

I'll just head in.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:47:47 AM Subject: Re: Auth is hosed?

I can be onsite in 20 minutes if it would help to have a physical presence.

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:46:50 AM Subject: Re: Auth is hosed?

I left him a voicemail.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:45:31 AM Subject: Re: Auth is hosed?

I don't. Do you have Ken's number?

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed?

Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed?

Dan's been invoked.

-- Craig

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed?

I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan.

-- Craig

----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed?

My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP?

-- corby

There is a flood of requests from mkemp from 140.221.69.2 and 140.221.69.3. I'm still seeing them trickle in. Can we get someone from alcf to trace the requests back to the source and put a stop to it? ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Linda Winkler" <[email protected]> Cc: [email protected], "Dan Olson" <[email protected]> Sent: Saturday, August 25, 2012 10:01:32 AM Subject: Re: Auth is hosed? Okay, now I'm in. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Linda Winkler" <[email protected]> Cc: [email protected], "Dan Olson" <[email protected]> Sent: Saturday, August 25, 2012 10:00:53 AM Subject: Re: Auth is hosed? Unsure. It's not letting me in. -- Craig ----- Original Message ----- From: "Linda Winkler" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], [email protected] Sent: Saturday, August 25, 2012 9:59:11 AM Subject: Re: Auth is hosed? I confirm we can use CC to access anchor device. What changed? lw On Aug 25, 2012, at 9:57 AM, Dan Olson wrote:

hmm.. my cryptocard just let me into namby.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected] Sent: Saturday, August 25, 2012 9:56:40 AM Subject: Re: Auth is hosed?

I'll just head in.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:47:47 AM Subject: Re: Auth is hosed?

I can be onsite in 20 minutes if it would help to have a physical presence.

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:46:50 AM Subject: Re: Auth is hosed?

I left him a voicemail.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:45:31 AM Subject: Re: Auth is hosed?

I don't. Do you have Ken's number?

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed?

Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed?

Dan's been invoked.

-- Craig

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed?

I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan.

-- Craig

----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed?

My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP?

-- corby

Are the ping_user ones coming from ALCF as well? -- Craig ----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: "Linda Winkler" <[email protected]>, [email protected] Sent: Saturday, August 25, 2012 10:17:01 AM Subject: Re: Auth is hosed? Also, while they are looking - there are requests coming from a non existent user, ping_user. I had provided our test account infomation, nagios-radius-test-user with a static password. Maybe they have a bad config on the server? I can confirm that I can log into intrepid, so it doesn't appear to be causing a problem, just a quirk in the config. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: "Linda Winkler" <[email protected]>, [email protected] Sent: Saturday, August 25, 2012 10:13:15 AM Subject: Re: Auth is hosed? There is a flood of requests from mkemp from 140.221.69.2 and 140.221.69.3. I'm still seeing them trickle in. Can we get someone from alcf to trace the requests back to the source and put a stop to it? ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Linda Winkler" <[email protected]> Cc: [email protected], "Dan Olson" <[email protected]> Sent: Saturday, August 25, 2012 10:01:32 AM Subject: Re: Auth is hosed? Okay, now I'm in. -- Craig ----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Linda Winkler" <[email protected]> Cc: [email protected], "Dan Olson" <[email protected]> Sent: Saturday, August 25, 2012 10:00:53 AM Subject: Re: Auth is hosed? Unsure. It's not letting me in. -- Craig ----- Original Message ----- From: "Linda Winkler" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], [email protected] Sent: Saturday, August 25, 2012 9:59:11 AM Subject: Re: Auth is hosed? I confirm we can use CC to access anchor device. What changed? lw On Aug 25, 2012, at 9:57 AM, Dan Olson wrote:

hmm.. my cryptocard just let me into namby.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected] Sent: Saturday, August 25, 2012 9:56:40 AM Subject: Re: Auth is hosed?

I'll just head in.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:47:47 AM Subject: Re: Auth is hosed?

I can be onsite in 20 minutes if it would help to have a physical presence.

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: [email protected] Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:46:50 AM Subject: Re: Auth is hosed?

I left him a voicemail.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Dan Olson" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:45:31 AM Subject: Re: Auth is hosed?

I don't. Do you have Ken's number?

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed?

Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed?

Dan's been invoked.

-- Craig

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed?

I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan.

-- Craig

----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed?

My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP?

-- corby

Crap, I should have remembered that. -- Craig ----- Original Message ----- From: "Ken Raffenetti" <[email protected]> To: "core-adm >> \"[email protected]\"" <[email protected]> Sent: Saturday, August 25, 2012 4:37:53 PM Subject: Re: Auth is hosed? I talked to Dan on the phone, but for completeness, the IPMI root password is in the IPMI.doc file in our Sharepoint site. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 08/25/2012 09:45 AM, Craig Stacey wrote:

I don't. Do you have Ken's number?

-- Craig

----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Craig Stacey" <[email protected]> Cc: [email protected], "Corby B. Schmitz" <[email protected]> Sent: Saturday, August 25, 2012 9:44:38 AM Subject: Re: Auth is hosed?

Does anyone have the current root password for the ipmi consoles? I believe it was last changed when we configured them for radius auth.

---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:20:32 AM Subject: Re: Auth is hosed?

Dan's been invoked.

-- Craig

----- Original Message ----- From: "Craig Stacey" <[email protected]> To: "Corby B. Schmitz" <[email protected]> Cc: [email protected] Sent: Saturday, August 25, 2012 9:16:14 AM Subject: Re: Auth is hosed?

I noticed this, too. Seeing what I can do, otherwise I'm ringing Dan.

-- Craig

----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: [email protected] Sent: Saturday, August 25, 2012 9:13:17 AM Subject: Auth is hosed?

My MCS CC is not working and I saw alerts from Auth last night. Can someone take a look ASAP?

-- corby