I've always used XFS when I expect lots of small files. Maybe 10 or 15 years ago, I was benchmarking filesystems to store maildirs; XFS was the fastest by far when it came to directory scans. I'm not sure if that's still the case, but I haven't had a reason to re-examine.