Re: 221 Service Outage Saturday 5/18 10am-2pm rolling
I thought this would be a quick change, and it appears that we are still down. The public connection (mac 00.25.90.03.eb.80) for the load balancer is supposed to be on a "special" vlan, I'm not sure of the id, but it is the vlan with the 140.221.15.1 gateway. It doesn't look like it is on that vlan, instead from a tcpdump it looks like it on the 808 vlan. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Brandon L. Siegel" <[email protected]> To: "Corby B. Schmitz" <[email protected]>, "Daniel E. Olson" <[email protected]> Cc: [email protected], "Craig J. Stacey" <[email protected]> Sent: Saturday, May 19, 2012 12:24:49 PM Subject: Re: 221 Service Outage Saturday 5/18 10am-2pm rolling Dan, I'm done moving the CIS equipment, I'm going to start on the MCS stuff. I'll let you know when I'm done so you can verify connectivity. Brandon On 5/14/12 10:08 AM, "Siegel, Brandon L." <[email protected]> wrote:
Dan,
I've got the ports for your load balancers marked and will save those for last, I should be ready to move them around 11:00 on Saturday. We could also move them before Saturday if you wanted, the new equipment is already in place and ready to go.
Brandon
-- Brandon Siegel Jr. Network Engineer Computing and Information Systems Argonne National Laboratory [email protected] (630)252-0261
On 5/11/12 6:00 PM, "Schmitz, Corby B." <[email protected]> wrote:
i am copying the engineer leading the work so he can make arrangements.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 14:51, "Dan Olson" <[email protected]> wrote:
I'll also be onsite doing other work that day, so I can help troubleshoot issues if they arise. I would like to do the load balancers two connections last. 6 net load balancer address is 00:25:90:03:EB:81 15 net load balancer address is 00:25:90:03:EB:80
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: "Craig J. Stacey" <[email protected]>, "Corby Schmitz" <[email protected]> Cc: "Daniel E. Olson" <[email protected]>, [email protected] Sent: Friday, May 11, 2012 2:44:54 PM Subject: Re: 221 Service Outage Saturday 5/18 10am-2pm rolling
Yes, I got confused on the dates. It is Saturday 5/19.
-- corby
On 5/11/12 2:36 PM, "Stacey, Craig J." <[email protected]> wrote:
Also, I presume you mean 5/19. -- Craig
On May 11, 2012, at 2:35 PM, Craig Stacey wrote:
Okay, cool. I see no issue with this. -- Craig
On May 11, 2012, at 2:30 PM, Corby Schmitz wrote:
60 seconds or less is the expected outage per-host.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 14:17, Craig Stacey <[email protected]> wrote:
What will the length of the outage be for each host? -- Craig
On May 11, 2012, at 1:52 PM, Corby Schmitz wrote:
We are replacing the 4k and its oversubscribed hardware to line rate fex shelves and the new 7K in 221.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 13:45, Dan Olson <[email protected]> wrote:
I don't think there is much that we can do, we're going to have to take this outage. Is the 4k going to reboot, or is it something upstream that is being worked on?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Original Message ----- From: "Corby Schmitz" <[email protected]> To: [email protected] Sent: Friday, May 11, 2012 1:40:35 PM Subject: 221 Service Outage Saturday 5/18 10am-2pm rolling
We will be replacing network hardware, which will affect the server infrastructure MCS has in 221 on Saturday 5/18 between 10am and 2pm. What needs to be done ahead of time to prepare for this?
Corby Schmitz Sent from my mobile office
After some further poking at the nics it looks like eth0 and eth1's network connections were swapped, they need to be swapped back. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Dan Olson" <[email protected]> To: "Brandon L. Siegel" <[email protected]> Cc: [email protected], "Craig J. Stacey" <[email protected]>, "Corby B. Schmitz" <[email protected]> Sent: Saturday, May 19, 2012 2:00:50 PM Subject: Re: 221 Service Outage Saturday 5/18 10am-2pm rolling I thought this would be a quick change, and it appears that we are still down. The public connection (mac 00.25.90.03.eb.80) for the load balancer is supposed to be on a "special" vlan, I'm not sure of the id, but it is the vlan with the 140.221.15.1 gateway. It doesn't look like it is on that vlan, instead from a tcpdump it looks like it on the 808 vlan. ---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055 ----- Original Message ----- From: "Brandon L. Siegel" <[email protected]> To: "Corby B. Schmitz" <[email protected]>, "Daniel E. Olson" <[email protected]> Cc: [email protected], "Craig J. Stacey" <[email protected]> Sent: Saturday, May 19, 2012 12:24:49 PM Subject: Re: 221 Service Outage Saturday 5/18 10am-2pm rolling Dan, I'm done moving the CIS equipment, I'm going to start on the MCS stuff. I'll let you know when I'm done so you can verify connectivity. Brandon On 5/14/12 10:08 AM, "Siegel, Brandon L." <[email protected]> wrote:
Dan,
I've got the ports for your load balancers marked and will save those for last, I should be ready to move them around 11:00 on Saturday. We could also move them before Saturday if you wanted, the new equipment is already in place and ready to go.
Brandon
-- Brandon Siegel Jr. Network Engineer Computing and Information Systems Argonne National Laboratory [email protected] (630)252-0261
On 5/11/12 6:00 PM, "Schmitz, Corby B." <[email protected]> wrote:
i am copying the engineer leading the work so he can make arrangements.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 14:51, "Dan Olson" <[email protected]> wrote:
I'll also be onsite doing other work that day, so I can help troubleshoot issues if they arise. I would like to do the load balancers two connections last. 6 net load balancer address is 00:25:90:03:EB:81 15 net load balancer address is 00:25:90:03:EB:80
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Original Message ----- From: "Corby B. Schmitz" <[email protected]> To: "Craig J. Stacey" <[email protected]>, "Corby Schmitz" <[email protected]> Cc: "Daniel E. Olson" <[email protected]>, [email protected] Sent: Friday, May 11, 2012 2:44:54 PM Subject: Re: 221 Service Outage Saturday 5/18 10am-2pm rolling
Yes, I got confused on the dates. It is Saturday 5/19.
-- corby
On 5/11/12 2:36 PM, "Stacey, Craig J." <[email protected]> wrote:
Also, I presume you mean 5/19. -- Craig
On May 11, 2012, at 2:35 PM, Craig Stacey wrote:
Okay, cool. I see no issue with this. -- Craig
On May 11, 2012, at 2:30 PM, Corby Schmitz wrote:
60 seconds or less is the expected outage per-host.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 14:17, Craig Stacey <[email protected]> wrote:
What will the length of the outage be for each host? -- Craig
On May 11, 2012, at 1:52 PM, Corby Schmitz wrote:
We are replacing the 4k and its oversubscribed hardware to line rate fex shelves and the new 7K in 221.
Corby Schmitz Sent from my mobile office
On May 11, 2012, at 13:45, Dan Olson <[email protected]> wrote:
I don't think there is much that we can do, we're going to have to take this outage. Is the 4k going to reboot, or is it something upstream that is being worked on?
---- Daniel Murphy-Olson Systems Administrator Mathematics & Computer Science Division Argonne National Laboratory 630-252-0055
----- Original Message ----- From: "Corby Schmitz" <[email protected]> To: [email protected] Sent: Friday, May 11, 2012 1:40:35 PM Subject: 221 Service Outage Saturday 5/18 10am-2pm rolling
We will be replacing network hardware, which will affect the server infrastructure MCS has in 221 on Saturday 5/18 between 10am and 2pm. What needs to be done ahead of time to prepare for this?
Corby Schmitz Sent from my mobile office
participants (1)
-
Dan Olson