Rich2k
Apr 21 2003, 05:20 PM
OK everything has been fine for ages now.
However today my server loads have been rocketing.
running a ps aux I see multiple instances of mysql and httpd running huge cpu loads, terminate the processes, loads drop, start and loads rise.
Any ideas to track exactly what's going on?
Rich2k
Apr 21 2003, 05:28 PM
Update... I think I may have the httpd problem solved now.
I offer an open directory script and I've got google bot indexing every file of the open directory at the moment! 9Mb log file today from just google bot.
Still doesn't solve the mysql problem though.
4PSA
Apr 22 2003, 02:29 AM
Do you host forums or other intenssive applications on your server?
Rich2k
Apr 22 2003, 03:39 AM
There is a client who has a php/mysql photo gallery script (around 2000 visitors a day). But they've had that for about a year and no noticable problems before.
Yet today the load is back down to 0.11
Google definately accounted for httpd problems but that script they were accessing doesn't use mysql, because once the googlebot left the site the loads fell (although to around 4 rather than 11)
Erwin
Apr 22 2003, 04:06 AM
You could always block Googlebot with robots.tx from spidering your open directory mirror.
Rich2k
Apr 22 2003, 05:14 AM
I don't really want to block them

more indexing thus more traffic thus more possibilty to sell things
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please
click here.