[nylug-talk] The best way to mirror 6M+ files?

[alex@pilosoft.com]

On Mon, 8 May 2006, David Rosenstrauch wrote:

> alex at pilosoft.com wrote:
> > On Mon, 8 May 2006, Yusuke Shinyama wrote:
> > 
> >> Actually one of the top-level directories has already 3M+ files and
> >> the structure of the subdirectories might change. Maybe I need to ask
> >> the users to organize them in a more consistent way.
> > In this case, you have already failed. It is a very bad idea to have
> > >10k files in same directory
> 
> Well, that's not necessarily true.  It really depends on the file system
> being used.  Some file systems (reiserfs comes to mind) can handle large
> numbers of files - i.e., much larger than 10K - without any problem.
Of course, some of us will dispute any claim of reiserfs handling 
*anything* without a problem. Back 4 years ago when it was all the rage, 
I've tested it for nntp spool - and it got hosed quickly. Reiserfsck is 
simply broken and unable to fix anything etc etc.

reiserfs is old and busted. xfs/jfs is the new hotness.

-alex