Files in Directory Maxing Out Options

[jevansnc]

I have a perl script that goes out and gets data from a real estate database with photos and puts the data into a mysql database each night. The script works fine. The problem is the directory is maxing out. No more files can be downloaded into the directory once the number of files hits 9740. I am running a Redhat ES4 box with Plesk 7.5 Reloaded. Any help or suggestions would be greatly appreciated.

[James Erickson]

Unfortunately, this sounds like you've hit the file system limit, best thing that I could tell you is create separate directories inside the main one, that separate them into categories, or alphabetical.

[klandreth]

I would just like to note that I have put over 250K empty files into a single directory before and not had any problems. One of the biggest problems with filesystems is choosing your blocksize to properly compliment your usages types. Do you go with larger blocks and fewer inodes, or many inodes with lots of little blocks.

You may want to check and see if you are out of inodes by using df -i.

what kind of errors are you recieving when it stops putting files into the directory? Is it a pause/hang or is it an exact error?

[jevansnc]

I would just like to note that I have put over 250K empty files into a single directory before and not had any problems. One of the biggest problems with filesystems is choosing your blocksize to properly compliment your usages types. Do you go with larger blocks and fewer inodes, or many inodes with lots of little blocks.

You may want to check and see if you are out of inodes by using df -i.

what kind of errors are you recieving when it stops putting files into the directory? Is it a pause/hang or is it an exact error?

I have over 8 million free inodes. I'm currently using 12% of the available inodes. There is not solid error that I know of. Would I check a perl log or something similar for this error. All of the records make it successfully into the database but the images stop at the 9740 mark everytime. I can store them anywhere and that is where they stop.