watcher is thrashing the disk on this hypervisor. That's what's causing variant to go into IO wait and spike load. Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory On 06/05/2012 08:59 AM, Ken Raffenetti wrote:
Okay, both trac.mcs and trac.alcf have been throttled to the lowest possible crawl rate through google's webmaster tools.
Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory
On 06/05/2012 08:51 AM, Ken Raffenetti wrote:
Turns out Google ignores crawl rate directives in robots.txt. I'll have to configure this through the Google webmaster tools, which only last for 90 days. Should be a nice motivator to get variant on better hardware.
Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory
On 06/05/2012 08:45 AM, Ken Raffenetti wrote:
Yes, we can easily throw one in the document root of both these sites. I'll do that today.
Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory
On 06/04/2012 11:33 PM, Craig Stacey wrote:
Any way to put a robots.txt on trac.alcf.anl.gov and the other Trac sites? We can then set the crawl rate.
-- Craig
On Jun 4, 2012, at 11:29 PM, Craig Stacey <[email protected]> wrote:
Googlebot killed us again. Need to get that blocked until we figure out how to stop it from killing the Trac sites.
-- Craig
On Jun 4, 2012, at 9:45 AM, Ken Raffenetti <[email protected]> wrote:
Seems to be pretty unhappy still after the reboot. Looking more closely...
Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory
On 06/04/2012 09:40 AM, Ken Raffenetti wrote:
It was pretty unhappy this morning, so I kicked it. To add to the pain, I got a lock error when trying to restart the domain on vserver7.mcs.anl.gov. To remedy, I had to "/etc/init.d/libvirt-bin restart" before I could start the VM again.
Ken Raffenetti Systems Administration Associate MCS Division - Argonne National Laboratory
On 06/03/2012 06:01 PM, Craig Stacey wrote:
Whatever happened to it this evening, it seems to have fixed itself by the time I got to it.
On Jun 3, 2012, at 2:00 PM, Craig Stacey wrote:
Dunno what was going on with variant -- load was through the roof. After various attempts to get services stopped and reduce load so I could do some actual troubleshooting, I decided it was taking too much time and just rebooted it. Things seemed to come back cleanly and it hasn't complained since. -- Craig
-- Craig