I need to hire a database expert fast.
My server has been working great for months, and then all of the sudden today I am having serious problems.
First, I was getting intermittent query issues with mysql. So, thinking that my var harddrive partition might be getting full, I made a symbolic link to ibdata1 and moved it into a different partition. Everything then worked fine for about 10 hours.
But, an hour ago, I could no longer reach any of my sites. So, I used ssh and did a traceroute on my nameserver and got this response:
traceroute ns1.mydomain.info
ns1.domain.info: Temporary failure in name resolution
Cannot handle "host" cmdline arg `ns1.myccta.info' on position 1 (argc 1)
I've tried to restart mydns and receive this error:
service mydns start
Starting /usr/local/sbin/mydns: mydns[7148]: Error connecting to MySQL server at
localhost: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) (errno=2)
I try to restart mysqld and get this error in my error logs:
071129 22:00:48 mysqld started
071129 22:00:48 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
071129 22:00:48 InnoDB: Starting log scan based on checkpoint at
InnoDB: log sequence number 1 262110839.
InnoDB: Doing recovery: scanned up to log sequence number 1 262110839
InnoDB: Page directory corruption: supremum not pointed to
071129 22:00:48 InnoDB: Page dump in ascii and hex (16384 bytes):
len 16384; hex
and so on.....