Whenever I have lots of files that need to go into a directory, I'll split into subdirs by prefix (or other partitioning scheme)--look in .git/objects for example.

Also be careful if the function that returns directory contents sorts results that you don't need done.