Yikes, Google’s feedfetcher as DOS tool, albeit unintentional.
Originally shared by Abraham Williams
http://www.behind-the-enemy-lines.com/2012/04/google-attack-how-i-self-attacked.html
Comments are closed.
Yikes, Google’s feedfetcher as DOS tool, albeit unintentional.
Originally shared by Abraham Williams
http://www.behind-the-enemy-lines.com/2012/04/google-attack-how-i-self-attacked.html
Comments are closed.
The use of an RSS feed to soak up a site’s bandwidth is troublesome. Hopefully someone at Google will adjust things.
That said, even the regular GoogleBot has issues. I host a few large, high-traffic sites that periodically get hit with a deluge of requests from the GoogleBot crawler (and from Bing, so Google’s not alone in this). The rate of hits is much higher than for regular users. Since the sites are strongly database-driven, the high hit rate can really hammer the load on the server. Fortunately the spikes usually don’t last too long, but it can still be troublesome to keep up good performance for real users when the bots are running intensively.