I develop some PHP project on Linux platform. Are there any disadvantages of putting several thousand images (files) in one directory? This is closed set which won’t grow. The alternative would be to separate this files using directory structure based on some ID (this way there would be let’s say only 100 in one directory).
I ask this question, because often I see such separation when I look at images URLs on different sites. You can see that directory separation is done in such way, that no more then several hundreds images are in one directory.
What would I gain by not putting several thousand files (of not growing set) in one directory but separating them in groups of e.g. 100? Is it worth complicating things?
UPDATE:
- There won’t be any programmatic iteration over files in a directory (just a direct access to an image by it’s filename)
- I want to emphasize that the image set is closed. It’s less then 5000 images, and that is it.
- There is no logical categorization of this images
- Human access/browse is not required
- Images have unique filenames
- OS: Debian/Linux 2.6.26-2-686, Filesystem: ext3
VALUABLE INFORMATION FROM THE ANSWERS:
Why separate many files to different directories:
- “32k files limit per directory when using ext3 over nfs”
- performance reason (access speed) [but for several thousand files it is difficult to say if it’s worth, without measuring ]
usually the reason for such splitting is file system performance.
for a closed set of 5000 files I am not sure it’s worth the hassle.
I suggest that you try the simple approach of putting all the files in one directory thing, but keep an eye open on the actual time it takes to access the files.
if you see that it’s not fast enough for your needs, you can split it like you suggested.
I had to split files myself for performance reasons.
in addition I bumped into a 32k files limit per directory when using ext3 over nfs (not sure if it’s a limit of nfs or ext3).
so that’s another reason to split into multiple directories.
in any case, try with a single dir and only split if you see it’s not fast enough.