fkatzenb
Aug 30 2007, 10:57 AM
Ok, so I need help. My server is experiencing very bad loading about twice a day. When this happens, I see in my inbox the vbulletin e-mails telling me there are too many connections. I also see something in my /var/log that says MaxClients reached. This is odd since there hasn't been a big increase in users across any of my sites or other people's sites on this server. I do see that in TOP, that the SQL process has 135m of vitrual memory and after being online for 11 hours, it is at 6:00+ while all others are at less then 0:30.
What can I start looking at for SQL connections to various scripts on my website? Thanks!!!!!!!!!
Frank
Gary Simat
Sep 1 2007, 01:22 PM
QUOTE (fkatzenb @ Aug 30 2007, 04:57 PM)

Ok, so I need help. My server is experiencing very bad loading about twice a day. When this happens, I see in my inbox the vbulletin e-mails telling me there are too many connections. I also see something in my /var/log that says MaxClients reached. This is odd since there hasn't been a big increase in users across any of my sites or other people's sites on this server. I do see that in TOP, that the SQL process has 135m of vitrual memory and after being online for 11 hours, it is at 6:00+ while all others are at less then 0:30.
What can I start looking at for SQL connections to various scripts on my website? Thanks!!!!!!!!!
Frank
Looks like you just need apache and mysql tweaking. Make sure to raise maxclients in both configs but make sure your load doesnt go too high.
fkatzenb
Sep 3 2007, 08:57 PM
Well I am beyond fustrated! I have gone thru turmoil to upgrade to the latest everything and verified the usual security things, etc. Here is my normal info..
http://www.turbo-mopar.com/forums/index.php?&do=phpinfoIt happens about once to twice a day... the server loads shoot up to anywhere between 50 and 150!!!! THere is a crap load of httpd processes running, but not doing anything. THere is nothing in the logs other then for me to increase my MaxClients... however that is at 256. it has gotten more frequent over the past 2 weeks when it happened about 1 every couple of days. The server has been running top notch outside of that. At first I had suspected MySQL, so I researched about all of those settings and such. They helped my normal operations and have dropped my normal server load to about half of what it was.
When this spike in httpd process and loads happen, I see the following. TO stop and return to normal, I litterally just have to do the ./etc/init.d/httpd restart and a few minutes later, I am back to normal. Here is a ps -ef dumped to text....
CODE
UID PID PPID C STIME TTY TIME CMD
root 1 0 0 Aug31 ? 00:00:00 init [3]
root 2 1 0 Aug31 ? 00:00:00 [ksoftirqd/0]
root 3 1 0 Aug31 ? 00:00:00 [events/0]
root 4 3 0 Aug31 ? 00:00:00 [khelper]
root 5 3 0 Aug31 ? 00:00:00 [kacpid]
root 25 3 0 Aug31 ? 00:00:00 [kblockd/0]
root 26 1 0 Aug31 ? 00:00:00 [khubd]
root 45 1 0 Aug31 ? 00:01:02 [kswapd0]
root 46 3 0 Aug31 ? 00:00:00 [aio/0]
root 192 1 0 Aug31 ? 00:00:00 [kseriod]
root 415 3 0 Aug31 ? 00:00:00 [ata/0]
root 416 3 0 Aug31 ? 00:00:00 [ata_aux]
root 418 1 0 Aug31 ? 00:00:00 [scsi_eh_0]
root 419 1 0 Aug31 ? 00:00:00 [scsi_eh_1]
root 433 1 0 Aug31 ? 00:00:29 [kjournald]
root 1740 1 0 Aug31 ? 00:00:00 udevd
root 1925 3 0 Aug31 ? 00:00:00 [kauditd]
root 1989 1 0 Aug31 ? 00:00:00 [kjournald]
root 1990 1 0 Aug31 ? 00:00:00 [kjournald]
root 2648 1 0 Aug31 ? 00:00:06 syslogd -m 0
root 2652 1 0 Aug31 ? 00:00:00 klogd -x
root 2736 1 0 Aug31 ? 00:00:00 rpc.idmapd
root 2751 1 0 Aug31 ? 00:00:00 /usr/sbin/smartd
root 2760 1 0 Aug31 ? 00:00:00 /usr/sbin/acpid
root 2770 1 0 Aug31 ? 00:00:00 /usr/sbin/sshd
root 2783 1 0 Aug31 ? 00:00:02 xinetd -stayalive -pidfile /var/run/xinetd.pid
ntp 2795 1 0 Aug31 ? 00:00:00 ntpd -u ntp:ntp -p /var/run/ntpd.pid -g
root 3201 1 0 Aug31 ? 00:00:00 crond
root 3218 1 0 Aug31 ? 00:00:00 /usr/sbin/atd
dbus 3227 1 0 Aug31 ? 00:00:00 dbus-daemon-1 --system
root 3237 1 0 Aug31 ? 00:00:00 rhnsd --interval 240
root 3247 1 0 Aug31 ? 00:00:00 hald
mailman 3331 1 0 Aug31 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/mailmanctl -s -q start
mailman 3333 3331 0 Aug31 ? 00:00:02 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s
mailman 3334 3331 0 Aug31 ? 00:00:02 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s
mailman 3335 3331 0 Aug31 ? 00:00:01 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s
mailman 3336 3331 0 Aug31 ? 00:00:02 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s
mailman 3337 3331 0 Aug31 ? 00:00:02 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s
mailman 3338 3331 0 Aug31 ? 00:00:03 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
mailman 3339 3331 0 Aug31 ? 00:00:02 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s
mailman 3340 3331 0 Aug31 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s
root 3380 1 0 Aug31 ? 00:00:53 /usr/sbin/portsentry -atcp
root 3384 1 0 Aug31 ? 00:00:00 /usr/sbin/portsentry -audp
root 3407 1 0 Aug31 tty1 00:00:00 /sbin/mingetty tty1
root 3408 1 0 Aug31 tty2 00:00:00 /sbin/mingetty tty2
root 3409 1 0 Aug31 tty3 00:00:00 /sbin/mingetty tty3
root 3410 1 0 Aug31 tty4 00:00:00 /sbin/mingetty tty4
root 3411 1 0 Aug31 tty5 00:00:00 /sbin/mingetty tty5
root 3412 1 0 Aug31 tty6 00:00:00 /sbin/mingetty tty6
root 3413 1 0 Aug31 ttyS0 00:00:00 /sbin/agetty -L 9600 ttyS0 vt100
root 4033 1 0 Aug31 ? 00:00:00 [loop0]
root 4034 1 0 Aug31 ? 00:00:00 [kjournald]
psaadm 4117 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
psaadm 4118 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
psaadm 4119 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
psaadm 4120 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
psaadm 4121 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
psaadm 4123 10837 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
root 4882 1 0 Aug31 ? 00:00:01 /usr/sbin/httpd
named 10512 1 0 Aug31 ? 00:00:01 /usr/sbin/named -u named -c /etc/named.conf -u named -t /var/named/run-root
root 10579 1 0 Aug31 ? 00:00:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --pid-file=/var/run/mysqld/mysqld.pid
mysql 10618 10579 0 Aug31 ? 00:22:33 /usr/libexec/mysqld --defaults-file=/etc/my.cnf --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-external-locking --port=3306 --socket=/var/lib/mysql/mysql.sock
qmails 10634 1 0 Aug31 ? 00:00:19 qmail-send
qmaill 10636 10634 0 Aug31 ? 00:00:02 splogger qmail
root 10637 10634 0 Aug31 ? 00:00:00 qmail-lspawn ./Maildir/
qmailr 10638 10634 0 Aug31 ? 00:00:00 qmail-rspawn
qmailq 10639 10634 0 Aug31 ? 00:00:01 qmail-clean
root 10700 1 0 Aug31 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=imapd -maxprocs=40 -maxperip=4 -pid=/var/run/imapd.pid -nodnslookup -noidentlookup 143 /usr/sbin/imaplogin /usr/lib/courier-imap/authlib/authpsa /usr/bin/imapd Maildir
root 10702 1 0 Aug31 ? 00:00:00 /usr/sbin/courierlogger imapd
root 10712 1 0 Aug31 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=imapd-ssl -maxprocs=40 -maxperip=4 -pid=/var/run/imapd-ssl.pid -nodnslookup -noidentlookup 993 /usr/bin/couriertls -server -tcpd /usr/sbin/imaplogin /usr/lib/courier-imap/authlib/authpsa /usr/bin/imapd Maildir
root 10714 1 0 Aug31 ? 00:00:00 /usr/sbin/courierlogger imapd-ssl
root 10722 1 0 Aug31 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=pop3d -maxprocs=40 -maxperip=4 -pid=/var/run/pop3d.pid -nodnslookup -noidentlookup 110 /usr/sbin/pop3login /usr/lib/courier-imap/authlib/authpsa /usr/bin/pop3d Maildir
root 10724 1 0 Aug31 ? 00:00:00 /usr/sbin/courierlogger pop3d
root 10733 1 0 Aug31 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=pop3d-ssl -maxprocs=40 -maxperip=4 -pid=/var/run/pop3d-ssl.pid -nodnslookup -noidentlookup 995 /usr/bin/couriertls -server -tcpd /usr/sbin/pop3login /usr/lib/courier-imap/authlib/authpsa /usr/bin/pop3d Maildir
root 10735 1 0 Aug31 ? 00:00:00 /usr/sbin/courierlogger pop3d-ssl
postgres 10776 1 0 Aug31 ? 00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
postgres 10778 10776 0 Aug31 ? 00:00:00 postgres: stats buffer process
postgres 10779 10778 0 Aug31 ? 00:00:00 postgres: stats collector process
popuser 10796 1 0 Aug31 ? 00:00:00 /usr/bin/spamd --username=popuser --daemonize --helper-home-dir=/var/qmail --max-children 5 --pidfile=/var/run/spamd/spamd_full.pid --socketpath=/tmp/spamd_full.sock --siteconfigpath=/dev/null
popuser 10798 1 0 Aug31 ? 00:00:00 /usr/bin/spamd --username=popuser --daemonize --helper-home-dir=/var/qmail --max-children 5 --pidfile=/var/run/spamd/spamd_light.pid --socketpath=/tmp/spamd_light.sock --siteconfigpath=/dev/null
root 10837 1 0 Aug31 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
popuser 10890 10796 0 Aug31 ? 00:00:00 spamd child
popuser 10891 10796 0 Aug31 ? 00:00:00 spamd child
popuser 10892 10796 0 Aug31 ? 00:00:00 spamd child
popuser 10893 10796 0 Aug31 ? 00:00:00 spamd child
popuser 10894 10796 0 Aug31 ? 00:00:00 spamd child
popuser 10896 10798 0 Aug31 ? 00:00:00 spamd child
popuser 10897 10798 0 Aug31 ? 00:00:00 spamd child
popuser 10898 10798 0 Aug31 ? 00:00:00 spamd child
popuser 10899 10798 0 Aug31 ? 00:00:00 spamd child
popuser 10900 10798 0 Aug31 ? 00:00:00 spamd child
drweb 10901 1 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10902 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10903 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10904 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10905 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10906 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10907 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10908 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10911 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10912 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10913 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10914 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10915 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10916 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10917 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10918 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
drweb 10919 10901 0 Aug31 ? 00:00:00 /opt/drweb/drwebd
root 16176 4882 0 04:02 ? 00:00:00 /usr/sbin/httpd
apache 16181 4882 0 04:03 ? 00:02:08 /usr/sbin/httpd
apache 16182 4882 0 04:03 ? 00:02:03 /usr/sbin/httpd
apache 23148 4882 0 06:13 ? 00:01:31 /usr/sbin/httpd
apache 23863 4882 0 07:42 ? 00:01:01 /usr/sbin/httpd
apache 24674 4882 0 09:09 ? 00:00:38 /usr/sbin/httpd
apache 24807 4882 0 09:29 ? 00:00:32 /usr/sbin/httpd
apache 25500 4882 0 10:51 ? 00:00:14 /usr/sbin/httpd
apache 25523 4882 0 10:53 ? 00:00:13 /usr/sbin/httpd
apache 25543 4882 0 10:55 ? 00:00:10 /usr/sbin/httpd
apache 25671 4882 0 11:13 ? 00:00:10 /usr/sbin/httpd
apache 25859 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25860 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25862 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25864 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25865 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25867 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25868 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25869 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25870 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25871 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25873 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25875 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25877 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25878 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25879 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25880 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25881 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25882 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25883 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25884 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25885 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25888 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25893 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25894 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25895 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25896 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25898 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25899 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25902 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25903 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25904 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25905 4882 0 11:37 ? 00:00:00 /usr/sbin/httpd
apache 25906 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25907 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25908 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25909 4882 0 11:37 ? 00:00:01 /usr/sbin/httpd
apache 25911 4882 0 11:38 ? 00:00:01 /usr/sbin/httpd
apache 25914 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25915 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25916 4882 0 11:38 ? 00:00:01 /usr/sbin/httpd
apache 25917 4882 0 11:38 ? 00:00:01 /usr/sbin/httpd
apache 25918 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25920 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25954 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25960 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25961 4882 0 11:38 ? 00:00:01 /usr/sbin/httpd
apache 25962 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25963 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25964 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25965 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25966 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25968 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25971 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25972 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25973 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25974 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25975 4882 0 11:38 ? 00:00:00 /usr/sbin/httpd
apache 25976 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25977 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25979 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25980 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25982 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25983 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25984 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25985 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25986 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25987 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 25988 4882 0 11:39 ? 00:00:01 /usr/sbin/httpd
apache 26003 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26007 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26010 4882 0 11:39 ? 00:00:01 /usr/sbin/httpd
apache 26011 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26020 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26021 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26024 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26025 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26026 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26036 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26037 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26038 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26039 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26041 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26044 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26045 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26048 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26057 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26066 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26068 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26070 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26072 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26073 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26074 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26075 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26076 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26077 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26079 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26080 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26083 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26084 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26085 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26086 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26087 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26088 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26089 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26090 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26094 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26096 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26102 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26103 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26104 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26105 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26106 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26107 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26108 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26109 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26110 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26111 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26112 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26113 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26115 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26118 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26119 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26121 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26122 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26123 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26124 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26126 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26128 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26130 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26134 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26135 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26136 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26137 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26138 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26139 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26140 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26141 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26142 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26144 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26145 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26147 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26148 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26149 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26150 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26151 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26152 4882 0 11:39 ? 00:00:01 /usr/sbin/httpd
apache 26153 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26154 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26155 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26160 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26162 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26163 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26164 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26165 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26166 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26167 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26168 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26169 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26170 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26171 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26172 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26174 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26175 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26176 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26177 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26178 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26179 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26180 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26181 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26182 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26183 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26184 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26185 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26186 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26187 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26188 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26189 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26190 4882 0 11:39 ? 00:00:00 /usr/sbin/httpd
apache 26347 4882 0 11:40 ? 00:00:00 /usr/sbin/httpd
apache 26796 4882 0 11:44 ? 00:00:00 /usr/sbin/httpd
apache 26797 4882 0 11:44 ? 00:00:00 /usr/sbin/httpd
apache 26798 4882 0 11:44 ? 00:00:00 /usr/sbin/httpd
apache 26802 4882 0 11:44 ? 00:00:00 /usr/sbin/httpd
apache 26805 4882 0 11:44 ? 00:00:00 /usr/sbin/httpd
apache 26817 4882 0 11:45 ? 00:00:00 /usr/sbin/httpd
apache 26818 4882 0 11:45 ? 00:00:00 /usr/sbin/httpd
apache 26819 4882 0 11:45 ? 00:00:00 /usr/sbin/httpd
apache 26846 4882 0 11:45 ? 00:00:00 /usr/sbin/httpd
apache 26875 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26877 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26878 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26879 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26880 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26881 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26882 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26892 4882 0 11:47 ? 00:00:00 /usr/sbin/httpd
apache 26908 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26914 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26915 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26916 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26917 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26918 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26920 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26921 4882 0 11:48 ? 00:00:00 /usr/sbin/httpd
apache 26933 4882 0 11:49 ? 00:00:00 /usr/sbin/httpd
apache 26934 4882 0 11:49 ? 00:00:00 /usr/sbin/httpd
apache 26938 4882 0 11:49 ? 00:00:00 /usr/sbin/httpd
apache 26943 4882 0 11:50 ? 00:00:00 /usr/sbin/httpd
apache 26944 4882 0 11:50 ? 00:00:00 /usr/sbin/httpd
apache 26962 4882 0 11:50 ? 00:00:00 /usr/sbin/httpd
apache 26964 4882 0 11:50 ? 00:00:00 /usr/sbin/httpd
apache 26971 4882 0 11:51 ? 00:00:00 /usr/sbin/httpd
apache 26972 4882 0 11:51 ? 00:00:00 /usr/sbin/httpd
apache 28567 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28670 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28691 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28750 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28855 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28887 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28888 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28889 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28890 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28891 4882 0 12:40 ? 00:00:00 /usr/sbin/httpd
apache 28960 4882 0 12:41 ? 00:00:00 /usr/sbin/httpd
apache 28968 4882 0 12:41 ? 00:00:00 /usr/sbin/httpd
apache 29018 4882 0 12:41 ? 00:00:00 /usr/sbin/httpd
apache 29087 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29088 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29089 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29093 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29094 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29095 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29097 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29101 4882 0 12:42 ? 00:00:00 /usr/sbin/httpd
apache 29104 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29107 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29109 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29113 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29114 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29115 4882 0 12:43 ? 00:00:00 /usr/sbin/httpd
apache 29118 4882 0 12:44 ? 00:00:00 /usr/sbin/httpd
apache 29124 4882 0 12:44 ? 00:00:00 /usr/sbin/httpd
apache 29125 4882 0 12:44 ? 00:00:00 /usr/sbin/httpd
apache 29126 4882 0 12:44 ? 00:00:00 /usr/sbin/httpd
apache 29139 4882 0 12:45 ? 00:00:00 /usr/sbin/httpd
apache 29140 4882 0 12:45 ? 00:00:00 /usr/sbin/httpd
qmailr 29786 10638 0 13:29 ? 00:00:00 qmail-remote zhujie.com Sander416@zhujie.com
qmaild 29787 2783 0 13:29 ? 00:00:00 /var/qmail/bin/qmail-smtpd /var/qmail/bin/smtp_auth /var/qmail/bin/true /var/qmail/bin/cmd5checkpw /var/qmail/bin/true
root 29877 2770 0 13:33 ? 00:00:00 sshd: admin [priv]
admin 29897 29877 0 13:34 ? 00:00:00 sshd: admin@pts/1
admin 29898 29897 0 13:34 pts/1 00:00:00 -bash
root 29929 29898 0 13:34 pts/1 00:00:00 su
root 29983 29929 0 13:36 pts/1 00:00:00 bash
qmaild 30017 2783 0 13:38 ? 00:00:00 /var/qmail/bin/qmail-smtpd /var/qmail/bin/smtp_auth /var/qmail/bin/true /var/qmail/bin/cmd5checkpw /var/qmail/bin/true
root 30019 3 0 13:39 ? 00:00:00 [pdflush]
root 30022 3201 0 13:40 ? 00:00:00 crond
mailman 30024 30022 0 13:40 ? 00:00:00 /usr/bin/python -S /usr/lib/mailman/cron/gate_news
qmailr 30025 10638 0 13:40 ? 00:00:00 qmail-remote aclickinwego.com vhominy@aclickinwego.com
root 30026 10722 0 13:40 ? 00:00:00 /usr/lib/courier-imap/authlib/authpsa /usr/bin/pop3d Maildir
root 30027 2783 0 13:40 ? 00:00:00 xinetd -stayalive -pidfile /var/run/xinetd.pid
root 30028 29983 1 13:40 pts/1 00:00:00 ps -ef
root 30029 3 0 13:40 ? 00:00:00 [pdflush]
Here is ps -ef when life is normal....
CODE
UID PID PPID C STIME TTY TIME CMD
root 1 0 0 Sep02 ? 00:00:00 init [3]
root 2 1 0 Sep02 ? 00:00:00 [ksoftirqd/0]
root 3 1 0 Sep02 ? 00:00:00 [events/0]
root 4 3 0 Sep02 ? 00:00:00 [khelper]
root 5 3 0 Sep02 ? 00:00:00 [kacpid]
root 25 3 0 Sep02 ? 00:00:00 [kblockd/0]
root 26 1 0 Sep02 ? 00:00:00 [khubd]
root 45 1 0 Sep02 ? 00:00:46 [kswapd0]
root 46 3 0 Sep02 ? 00:00:00 [aio/0]
root 192 1 0 Sep02 ? 00:00:00 [kseriod]
root 415 3 0 Sep02 ? 00:00:00 [ata/0]
root 416 3 0 Sep02 ? 00:00:00 [ata_aux]
root 418 1 0 Sep02 ? 00:00:00 [scsi_eh_0]
root 419 1 0 Sep02 ? 00:00:00 [scsi_eh_1]
root 433 1 0 Sep02 ? 00:00:07 [kjournald]
root 1720 1 0 Sep02 ? 00:00:00 udevd
root 1911 3 0 Sep02 ? 00:00:00 [kauditd]
root 1974 1 0 Sep02 ? 00:00:00 [kjournald]
root 1975 1 0 Sep02 ? 00:00:00 [kjournald]
root 2618 1 0 Sep02 ? 00:00:02 syslogd -m 0
root 2622 1 0 Sep02 ? 00:00:00 klogd -x
named 2646 1 0 Sep02 ? 00:00:07 /usr/sbin/named -u named -c /etc/named.conf -u named -t /var/named/run-root
root 2706 1 0 Sep02 ? 00:00:00 rpc.idmapd
root 2721 1 0 Sep02 ? 00:00:00 /usr/sbin/smartd
root 2730 1 0 Sep02 ? 00:00:00 /usr/sbin/acpid
root 2740 1 0 Sep02 ? 00:00:00 /usr/sbin/sshd
root 2753 1 0 Sep02 ? 00:00:00 xinetd -stayalive -pidfile /var/run/xinetd.pid
ntp 2765 1 0 Sep02 ? 00:00:00 ntpd -u ntp:ntp -p /var/run/ntpd.pid -g
root 2826 1 0 Sep02 ? 00:00:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --pid-file=/var/run/mysqld/mysqld.pid
mysql 2862 2826 1 Sep02 ? 00:18:11 /usr/libexec/mysqld --defaults-file=/etc/my.cnf --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-external-locking --port=3306 --socket=/var/lib/mysql/mysql.sock
postgres 2911 1 0 Sep02 ? 00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
postgres 2913 2911 0 Sep02 ? 00:00:00 postgres: stats buffer process
postgres 2914 2913 0 Sep02 ? 00:00:00 postgres: stats collector process
root 2939 1 0 Sep02 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=imapd -maxprocs=40 -maxperip=4 -pid=/var/run/imapd.pid -nodnslookup -noidentlookup 143 /usr/sbin/imaplogin /usr/lib/courier-imap/authlib/authpsa /usr/bin/imapd Maildir
root 2941 1 0 Sep02 ? 00:00:00 /usr/sbin/courierlogger imapd
root 2951 1 0 Sep02 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=imapd-ssl -maxprocs=40 -maxperip=4 -pid=/var/run/imapd-ssl.pid -nodnslookup -noidentlookup 993 /usr/bin/couriertls -server -tcpd /usr/sbin/imaplogin /usr/lib/courier-imap/authlib/authpsa /usr/bin/imapd Maildir
root 2953 1 0 Sep02 ? 00:00:00 /usr/sbin/courierlogger imapd-ssl
root 2961 1 0 Sep02 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=pop3d -maxprocs=40 -maxperip=4 -pid=/var/run/pop3d.pid -nodnslookup -noidentlookup 110 /usr/sbin/pop3login /usr/lib/courier-imap/authlib/authpsa /usr/bin/pop3d Maildir
root 2963 1 0 Sep02 ? 00:00:00 /usr/sbin/courierlogger pop3d
root 2972 1 0 Sep02 ? 00:00:00 /usr/lib/courier-imap/couriertcpd -address=0 -stderrlogger=/usr/sbin/courierlogger -stderrloggername=pop3d-ssl -maxprocs=40 -maxperip=4 -pid=/var/run/pop3d-ssl.pid -nodnslookup -noidentlookup 995 /usr/bin/couriertls -server -tcpd /usr/sbin/pop3login /usr/lib/courier-imap/authlib/authpsa /usr/bin/pop3d Maildir
root 2974 1 0 Sep02 ? 00:00:00 /usr/sbin/courierlogger pop3d-ssl
qmails 2983 1 0 Sep02 ? 00:00:03 qmail-send
qmaill 2985 2983 0 Sep02 ? 00:00:00 splogger qmail
root 2986 2983 0 Sep02 ? 00:00:00 qmail-lspawn ./Maildir/
qmailr 2987 2983 0 Sep02 ? 00:00:00 qmail-rspawn
qmailq 2988 2983 0 Sep02 ? 00:00:00 qmail-clean
popuser 3075 1 0 Sep02 ? 00:00:00 /usr/bin/spamd --username=popuser --daemonize --nouser-config --helper-home-dir=/var/qmail --max-children 5 --pidfile=/var/run/spamd/spamd_full.pid --socketpath=/tmp/spamd_full.sock
popuser 3077 3075 0 Sep02 ? 00:00:00 spamd child
popuser 3078 3075 0 Sep02 ? 00:00:00 spamd child
popuser 3079 3075 0 Sep02 ? 00:00:00 spamd child
popuser 3080 3075 0 Sep02 ? 00:00:00 spamd child
popuser 3081 3075 0 Sep02 ? 00:00:00 spamd child
root 3124 1 0 Sep02 ? 00:00:00 /usr/local/psa/admin/bin/httpsd
root 3168 1 0 Sep02 ? 00:00:00 crond
root 3185 1 0 Sep02 ? 00:00:00 /usr/sbin/atd
dbus 3194 1 0 Sep02 ? 00:00:00 dbus-daemon-1 --system
root 3204 1 0 Sep02 ? 00:00:00 rhnsd --interval 240
root 3213 1 0 Sep02 ? 00:00:00 hald
mailman 3304 1 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/mailmanctl -s -q start
mailman 3308 3304 0 Sep02 ? 00:00:01 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s
mailman 3309 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s
mailman 3310 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s
mailman 3311 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s
mailman 3312 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s
mailman 3313 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
mailman 3314 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s
mailman 3315 3304 0 Sep02 ? 00:00:00 /usr/bin/python /usr/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s
root 3343 1 0 Sep02 ? 00:00:14 /usr/sbin/portsentry -atcp
root 3347 1 0 Sep02 ? 00:00:00 /usr/sbin/portsentry -audp
root 3358 1 0 Sep02 tty1 00:00:00 /sbin/mingetty tty1
root 3359 1 0 Sep02 tty2 00:00:00 /sbin/mingetty tty2
root 3360 1 0 Sep02 tty3 00:00:00 /sbin/mingetty tty3
root 3361 1 0 Sep02 tty4 00:00:00 /sbin/mingetty tty4
root 3362 1 0 Sep02 tty5 00:00:00 /sbin/mingetty tty5
root 3363 1 0 Sep02 tty6 00:00:00 /sbin/mingetty tty6
root 3364 1 0 Sep02 ttyS0 00:00:00 /sbin/agetty -L 9600 ttyS0 vt100
root 3988 1 0 Sep02 ? 00:00:00 [loop0]
root 3989 1 0 Sep02 ? 00:00:00 [kjournald]
psaadm 5803 3124 0 01:32 ? 00:00:13 /usr/local/psa/admin/bin/httpsd
psaadm 5806 3124 0 01:32 ? 00:00:13 /usr/local/psa/admin/bin/httpsd
root 9717 2740 0 07:16 ? 00:00:00 sshd: admin [priv]
admin 9719 9717 0 07:17 ? 00:00:56 sshd: admin@pts/1
admin 9720 9719 0 07:17 pts/1 00:00:00 -bash
root 9749 9720 0 07:17 pts/1 00:00:00 su
root 9750 9749 0 07:17 pts/1 00:00:00 bash
root 20605 3 0 21:32 ? 00:00:00 [pdflush]
root 20618 3 0 21:35 ? 00:00:00 [pdflush]
root 20637 1 0 21:36 ? 00:00:00 /usr/sbin/httpd
root 20645 20637 0 21:36 ? 00:00:00 /usr/sbin/httpd
apache 20647 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20648 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20649 20637 0 21:36 ? 00:00:07 /usr/sbin/httpd
apache 20650 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20651 20637 0 21:36 ? 00:00:09 /usr/sbin/httpd
apache 20652 20637 0 21:36 ? 00:00:06 /usr/sbin/httpd
apache 20653 20637 0 21:36 ? 00:00:07 /usr/sbin/httpd
apache 20654 20637 0 21:36 ? 00:00:09 /usr/sbin/httpd
apache 20655 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20656 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20657 20637 0 21:36 ? 00:00:09 /usr/sbin/httpd
apache 20658 20637 0 21:36 ? 00:00:08 /usr/sbin/httpd
apache 20677 20637 0 21:38 ? 00:00:07 /usr/sbin/httpd
apache 20765 20637 0 21:51 ? 00:00:01 /usr/sbin/httpd
root 20821 9750 0 21:55 pts/1 00:00:00 ps -ef
Ideas????
X-Istence
Sep 11 2007, 02:42 PM
Looks like Apache is hit fast and hard at that time of day, and that is why your load goes up.
James Jhurani
Sep 11 2007, 05:10 PM
thats a lot of httpd processes =\
fkatzenb
Sep 14 2007, 09:34 PM
Any advise? I have cleaned up alot of settings and it looks rather good, however I still have isues about once every 4 days. Its hard to monitor for issue. I am finding that I have to leave top up on my SSH terminal and literally watch for days. Today I actually saw the load shoot up before I saw the spam of httpd processes.
Any ideas?
Martyn Dale
Sep 15 2007, 05:11 AM
There are a number of differnt approaches you can take, which will depend on where you think the nature of the problem is, or what information you already have on the situation.
First i would suggest posting your my.cnf file, and roughly how many pageviews you get in a given day.
-- SQL --
As its SQL related, i think a good start will be to look at the runtime variables.
I find that the display in phpMyAdmin is quite helpful if you use it.
If you dont, it maybe worth it purely because of its nice output for the variables, along with a brief description for them all.
Either way, if you clear the log, and leave it for a few hours, preferably over one of the spikes, you will have some useful information to work from.
If you have a lot of "slow queries", then you should think about enabling the slow queries logging.
If Handler_read_rnd_next is high, this could certainly indicate an indexing problem on the table, however the types of queries you make also has to be taken into consideration. For example if you always want to select all rows from a table, (say for example a ban list) there wont be an index, and you will be simply loading this entire table. If its 100 rows long, that value will be increased by 100 every page view for that table alone, just make sure you take it into account, and dont over react if you were to see a value in the 100's of thousands. Depending on your scenario, this could be very much normal.
You also have the option of setting the slow queries log, to log all queries, which dont make use of an index. If you were to do that, just take a look at the queries, and see if they make sence to not be indexed.
SELECT ip FROM Bans
Would of course be fine
However if SELECT username FROM Members WHERE username='BLAH'
Should not be in there, as you should have the username indexed
Sort_merge_passes can be another nice spot for optimizing. If the buffer is large enough, it can sort all your results in a single pass in the RAM, if its too small, then you will have to have multiple passes to sort the data.
If any of the values are at 0 however, thats very good, and you can afford to lower the values in the my.cnf file, to free up more memory
-- System processes --
Something your TOP output didnt show, was the ram and CPU usage. If either of these are out of a reasonable range, sort the top results by that (shift+m for memory or shift+p for CPU) and look at the worst offender
You could well find its a problem totally unrelated to your web setup, and its something else on the system. Ive had sendmail go rather crazy on me in the past, making the entire system go unstable, even though at first glance it appeared to be related to web processes
-- Generally --
Its most likely going to be some SQL queries, which dont go well together in a certain combination, resulting in the wrong tables getting locked, meaning lots of waits, up to the total wait time, and a massive backlog forming.
Id imagine your tables are using myisam, which uses full table locking instead of row locking. Even so, without knowing more, i wouldnt suggest moving to innodb
If at a "bad" time, you can run a "SHOW PROCESSLIST;" in sql, you can get a glimpse of all active queries, and if they are waiting for a lock. If they are, look at whats holding the lock, and go from there
Theres a LOT of angles to go from on these kinds of problems, theres are tonnes of possibilities that it could be, and even if its not those, all viewpoints are great for getting every last bit out of the server. I know i have sat there for hours at a time before, tweaking index's and SQL variables and seeing how it affects page load time, and server load, and finding the best middle ground
Soory about the ramblings, its hard to try and even start covering every point you can get something out of your system on, but hopefully we can make it a bit more precise once we ahve a little more info