July 2012 - Core-students - mailman3.cels.anl.gov

INFO: Re: excessive scanning of collab.mcs.anl.gov, Ticket No. 62213, Status=Open
by Argonne Service Desk 27 Jul '12

27 Jul '12

When replying, type your text above this line. ---------------------------------------------- Notification of Incident Change Thank You for submitting your request to the CIS Service Desk. This message serves as an automatic confirmation that your request has been entered into our request tracking system. Your request will be assigned to our technical staff momentarily. If you have additional information that may help us in resolving your request, please use the reply button on your email client to reply to this message. If you would like to speak to a member of the CIS Service Desk team, please call 2-9999, option 2 and reference Incident 62213 Incident: Re: excessive scanning of collab.mcs.anl.gov Incident Number: 62213 Priority: Medium Status: Open Date: 07/27/2012 Time: 15:54:06 Creation Date: 07/27/2012 Creation Time: 13:30:06 Created By: raffenet(a)mcs.anl.gov View Incident in Browser: https://tickets.anl.gov/MRcgi/MRlogin.pl?DL=62213DA12 Detail: Entered on 07/27/2012 at 15:54:06 CDT (GMT-0500) by Matthew Kwiatkowski: We need to add Danaâs group to this ticket. Cyber has the same concern. The google appliances index internal sites WAY too often. Entered on 07/27/2012 at 13:38:25 CDT (GMT-0500) by Malikah Reed: assigning to cyber? Entered on 07/27/2012 at 13:30:06 CDT (GMT-0500) by raffenet(a)mcs.anl.gov: This scanning is still out of control. In yesterday's logs I see about 300,000 requests from each of the lab's google bots. Is there something I should be doing to these sites to prevent this excessive scanning? root@blizzard:/var/log/apache2# grep 146.137.96.101 blizzard.access_log.2012Jul26 | wc -l 277670 root@blizzard:/var/log/apache2# grep 130.202.84.131 blizzard.access_log.2012Jul26 | wc -l 292253 There are only about 200 pages on this entire site. Can we get support from Google with regards to this problem? A similar issue caused me to block the ANL google bots from www.alcf.anl.gov because it was affecting site performance. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 07/10/2012 09:29 AM, Ken Raffenetti wrote: > Google Admins, > > I'm seeing a pretty outrageous number of requests to > http://collab.mcs.anl.gov. Is there any way the scanning frequency can > be turned down on this site? > > In July alone, I see 1.5 million requests. This is similar to what was > happening with www.alcf.anl.gov, which I eventually just blocked from > being crawled by the internal Google bot. > > root@blizzard:/var/log/apache2# grep 146.137.96.101 > *.access_log.2012Jul* | wc -l | uniq -c > 1 1522255 > Current Assignees: Cyber Security CC(s): (permanent) core-admins(a)mcs.anl.gov, help(a)anl.gov Customer Information: Last Name: Raffenetti First Name: Kenneth Email Address: raffenet(a)mcs.anl.gov Badge: 56518 Login ID: b56518 ANL Division: MCS Costcenter: 145 Building: 240 Room: 2135 Phone: (630) 252-3358 Attachments: smime_20120727155405_611572.p7s This is an automated message sent by the Numara FootPrints ticket tracking system, which is operated by CIS.

1 0

Finishing up from home
by Ti Leggett 27 Jul '12

27 Jul '12

Amy has to run an errand that taking the boys with would be foolhardy (think of two bulls in an extra small china shop) so I'm running home to monitor them and finish up the RHEL6 build from there.

1 0

INFO: Re: excessive scanning of collab.mcs.anl.gov, Ticket No. 62221, Status=Active
by Argonne Service Desk 27 Jul '12

27 Jul '12

When replying, type your text above this line. ---------------------------------------------- Notification of Incident Change Incident: Re: excessive scanning of collab.mcs.anl.gov Incident Number: 62221 Priority: Medium Status: Active Date: 07/27/2012 Time: 14:28:07 Creation Date: 07/27/2012 Creation Time: 14:06:08 Created By: Dana Stasiak View Incident in Browser: https://tickets.anl.gov/MRcgi/MRlogin.pl?DL=62221DA12 Detail: Entered on 07/27/2012 at 14:28:07 CDT (GMT-0500) by Dmitriy Sklyar: I have switched both internal and external GSAs to scheduled crawl and specified minimum load for Normal 0 false false false EN-US X-NONE X-NONE /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman","serif";} collab.mcs.anl.gov and Normal 0 false false false EN-US X-NONE X-NONE /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman","serif";} www.alcf.anl.gov. Please remove the blocks and let me know if the situation improves. If the blocks remain in place, no results from these sites will show up in the internal/external site search. Entered on 07/27/2012 at 14:09:19 CDT (GMT-0500) by Malikah Reed: assigning to web services Entered on 07/27/2012 at 14:06:08 CDT (GMT-0500) by Dana Stasiak: Craig, Ken, Please accept my apologies for the difficulties you have been experiencing. I have asked Dmitry to turn down the host load schedule for these servers. I am also creating a ticket to track this to completion. We have been recrawling the the collection due to some changes we are making for inside Argonne. Dana On Jul 27, 2012, at 2:32 PM, "Craig Stacey" <stace(a)mcs.anl.gov> wrote: I'd go ahead and block it until it gets figured out. -- Craig (from my mobile) Ken Raffenetti <raffenet(a)mcs.anl.gov> wrote: This scanning is still out of control. In yesterday's logs I see about 300,000 requests from each of the lab's google bots. Is there something I should be doing to these sites to prevent this excessive scanning? root@blizzard:/var/log/apache2# grep 146.137.96.101 blizzard.access_log.2012Jul26 | wc -l 277670 root@blizzard:/var/log/apache2# grep 130.202.84.131 blizzard.access_log.2012Jul26 | wc -l 292253 There are only about 200 pages on this entire site. Can we get support from Google with regards to this problem? A similar issue caused me to block the ANL google bots from www.alcf.anl.gov because it was affecting site performance. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 07/10/2012 09:29 AM, Ken Raffenetti wrote: > Google Admins, > > I'm seeing a pretty outrageous number of requests to > http://collab.mcs.anl.gov. Is there any way the scanning frequency can > be turned down on this site? > > In July alone, I see 1.5 million requests. This is similar to what was > happening with www.alcf.anl.gov, which I eventually just blocked from > being crawled by the internal Google bot. > > root@blizzard:/var/log/apache2# grep 146.137.96.101 > *.access_log.2012Jul* | wc -l | uniq -c > 1 1522255 > Current Assignees: Web Services CC(s): (permanent) raffenet(a)mcs.anl.gov, googleadmins(a)anl.gov, core-admins(a)mcs.anl.gov Customer Information: Last Name: Stasiak First Name: Dana Email Address: dstasiak(a)anl.gov Badge: 50278 Login ID: dstasiak ANL Division: CIS Costcenter: 250 Building: 240 Room: 2106 Phone: (630) 252-0912 This is an automated message sent by the Numara FootPrints ticket tracking system, which is operated by CIS.

1 0

Where's Max?
by Max trefonides 27 Jul '12

27 Jul '12

Going to Oakbrook mall Apple store right now to pick up the mini-server, I'll be back in a couple hours. -- Max Trefonides MCS Systems maxadam(a)mcs.anl.gov

1 0

INFO: Re: excessive scanning of collab.mcs.anl.gov, Ticket No. 62221, Status=Request
by Argonne Service Desk 27 Jul '12

27 Jul '12

When replying, type your text above this line. ---------------------------------------------- Notification of Incident Registration Incident: Re: excessive scanning of collab.mcs.anl.gov Incident Number: 62221 Priority: Medium Status: Request Date: 07/27/2012 Time: 14:06:08 Created By: Dana Stasiak View Incident in Browser: https://tickets.anl.gov/MRcgi/MRlogin.pl?DL=62221DA12 Detail: Entered on 07/27/2012 at 14:06:08 CDT (GMT-0500) by Dana Stasiak: Craig, Ken, Please accept my apologies for the difficulties you have been experiencing. I have asked Dmitry to turn down the host load schedule for these servers. I am also creating a ticket to track this to completion. We have been recrawling the the collection due to some changes we are making for inside Argonne. Dana On Jul 27, 2012, at 2:32 PM, "Craig Stacey" <stace(a)mcs.anl.gov> wrote: I'd go ahead and block it until it gets figured out. -- Craig (from my mobile) Ken Raffenetti <raffenet(a)mcs.anl.gov> wrote: This scanning is still out of control. In yesterday's logs I see about 300,000 requests from each of the lab's google bots. Is there something I should be doing to these sites to prevent this excessive scanning? root@blizzard:/var/log/apache2# grep 146.137.96.101 blizzard.access_log.2012Jul26 | wc -l 277670 root@blizzard:/var/log/apache2# grep 130.202.84.131 blizzard.access_log.2012Jul26 | wc -l 292253 There are only about 200 pages on this entire site. Can we get support from Google with regards to this problem? A similar issue caused me to block the ANL google bots from www.alcf.anl.gov because it was affecting site performance. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 07/10/2012 09:29 AM, Ken Raffenetti wrote: > Google Admins, > > I'm seeing a pretty outrageous number of requests to > http://collab.mcs.anl.gov. Is there any way the scanning frequency can > be turned down on this site? > > In July alone, I see 1.5 million requests. This is similar to what was > happening with www.alcf.anl.gov, which I eventually just blocked from > being crawled by the internal Google bot. > > root@blizzard:/var/log/apache2# grep 146.137.96.101 > *.access_log.2012Jul* | wc -l | uniq -c > 1 1522255 > Current Assignees: Help Desk CC(s): (permanent) raffenet(a)mcs.anl.gov, googleadmins(a)anl.gov, core-admins(a)mcs.anl.gov Customer Information: Last Name: Stasiak First Name: Dana Email Address: dstasiak(a)anl.gov Badge: 50278 Login ID: dstasiak ANL Division: CIS Costcenter: 250 Building: 240 Room: 2106 Phone: (630) 252-0912 This is an automated message sent by the Numara FootPrints ticket tracking system, which is operated by CIS.

1 0

excessive scanning of collab.mcs.anl.gov
by Ken Raffenetti 27 Jul '12

27 Jul '12

Google Admins, I'm seeing a pretty outrageous number of requests to http://collab.mcs.anl.gov. Is there any way the scanning frequency can be turned down on this site? In July alone, I see 1.5 million requests. This is similar to what was happening with www.alcf.anl.gov, which I eventually just blocked from being crawled by the internal Google bot. root@blizzard:/var/log/apache2# grep 146.137.96.101 *.access_log.2012Jul* | wc -l | uniq -c 1 1522255 -- Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory

3 3

INFO: Re: excessive scanning of collab.mcs.anl.gov, Ticket No. 62213, Status=Request
by Argonne Service Desk 27 Jul '12

27 Jul '12

When replying, type your text above this line. ---------------------------------------------- Notification of Incident Registration Incident: Re: excessive scanning of collab.mcs.anl.gov Incident Number: 62213 Priority: Medium Status: Request Date: 07/27/2012 Time: 13:30:07 Created By: raffenet(a)mcs.anl.gov View Incident in Browser: https://tickets.anl.gov/MRcgi/MRlogin.pl?DL=62213DA12 Detail: Entered on 07/27/2012 at 13:30:06 CDT (GMT-0500) by raffenet(a)mcs.anl.gov: This scanning is still out of control. In yesterday's logs I see about 300,000 requests from each of the lab's google bots. Is there something I should be doing to these sites to prevent this excessive scanning? root@blizzard:/var/log/apache2# grep 146.137.96.101 blizzard.access_log.2012Jul26 | wc -l 277670 root@blizzard:/var/log/apache2# grep 130.202.84.131 blizzard.access_log.2012Jul26 | wc -l 292253 There are only about 200 pages on this entire site. Can we get support from Google with regards to this problem? A similar issue caused me to block the ANL google bots from www.alcf.anl.gov because it was affecting site performance. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 07/10/2012 09:29 AM, Ken Raffenetti wrote: > Google Admins, > > I'm seeing a pretty outrageous number of requests to > http://collab.mcs.anl.gov. Is there any way the scanning frequency can > be turned down on this site? > > In July alone, I see 1.5 million requests. This is similar to what was > happening with www.alcf.anl.gov, which I eventually just blocked from > being crawled by the internal Google bot. > > root@blizzard:/var/log/apache2# grep 146.137.96.101 > *.access_log.2012Jul* | wc -l | uniq -c > 1 1522255 > Current Assignees: Help Desk CC(s): (permanent) core-admins(a)mcs.anl.gov, help(a)anl.gov Customer Information: Last Name: Raffenetti First Name: Kenneth Email Address: raffenet(a)mcs.anl.gov Badge: 56518 Login ID: b56518 ANL Division: MCS Costcenter: 145 Building: 240 Room: 2135 Phone: (630) 252-3358 This is an automated message sent by the Numara FootPrints ticket tracking system, which is operated by CIS.

1 0

where's Linda 7/27
by Linda Winkler 27 Jul '12

27 Jul '12

Woke up with a killer headache to go with the cold. If I can shake it after a little more sleep, I will work this afternoon. I can be reached via cell if there are any lingering issues after last night's marathon to upgrade the border router. lw

1 1

Where's Max
by Max trefonides 27 Jul '12

27 Jul '12

Next week I am moving, I will be out Wednesday, Thursday and Friday, PLease put me down for three vacation days. Thanks! -- Max Trefonides MCS Systems maxadam(a)mcs.anl.gov

1 2

Where's Tina
by Tina Stanton-Piersanti 27 Jul '12

27 Jul '12

Working an hour this morning and will finish out my 1/2 day late this afternoon (I have to go to Lip Sync show at the Park Dist. at 1:30, today is his last day of Summer camp). T.

1 0