[nylug-talk] The best way to mirror 6M+ files?

[Matt Stockdale]

Well, depending on your purpose for syncing the files, you might be able
run them as a Raid 1 volume, whereby you add the disk in, let it sync,
and break the mirror until you next need to sync. If you tweak
speed_limit_max in proc this may be quite fast indeed.
 
On Mon, 2006-05-08 at 09:46 -0400, Yusuke Shinyama wrote:
> Hello,
> 
> I am trying to mirror two disks that have the same size (320GB).
> The source drive has about 6 million files in ext3 filesystem and
> the number of files keeps growing every day.  I tried rsync and
> found it impossible because it requires so much memory (the
> machine has 3G, but that was not enough).  I could use dd to copy
> raw data, but I am wondering if there is a better way to do
> this. Any hints?
> 
> Thanks,
> Yusuke
> _____________________________________________________________________________
> Hire expert Linux talent by posting jobs here :: http://jobs.nylug.org
> The nylug-talk mailing list is at nylug-talk at nylug.org
> The list archive is at http://nylug.org/pipermail/nylug-talk
> To subscribe or unsubscribe: http://nylug.org/mailman/listinfo/nylug-talk
>