My old slackware 10 box is dying, so I built a FreeBSD box to replace it. I have a great amount of data on the slackware box, so I got it running (no easy feat) and after setting up samba on the BSD machine, mounted the shared drive and started a cp -R on the directory last night and let it run overnight. Unfortunately, it bombed out in short order because it hit upon a file larger than it could handle. (I believe I have one about 80 gig in there...) If I'm not mistaken, samba emulates a FAT file system and is subject to those limitations even though the underlying file system is ZFS.
I've googled and found rcp, scp, and rsync as common methods of transferring files over the network. Never having used any of them, I don't know if the same or a similar limitation will be present in them. Further, none of them are set up on either my slackware or BSD boxes. I also thought of tar-ing up the whole directory and splitting it into 2-gig chunks, but honestly don't think this would be a good idea - not only would be it exceedingly slow, but I'd have to monitor it closely because there's not enough drive space to do it all at once. This is hopefully going to be a one-time thing, so I don't want to spend a ton of time setting up/configuring a complex system to do it if avoidable. I'm in a secure local environment and can safely drop the firewalls on both machines if needed.
Is anybody familiar with the rcp/scp/rsync utilities? Are they capable of transferring very large files over the network? Are there any other tools/services I should consider using instead?
I've googled and found rcp, scp, and rsync as common methods of transferring files over the network. Never having used any of them, I don't know if the same or a similar limitation will be present in them. Further, none of them are set up on either my slackware or BSD boxes. I also thought of tar-ing up the whole directory and splitting it into 2-gig chunks, but honestly don't think this would be a good idea - not only would be it exceedingly slow, but I'd have to monitor it closely because there's not enough drive space to do it all at once. This is hopefully going to be a one-time thing, so I don't want to spend a ton of time setting up/configuring a complex system to do it if avoidable. I'm in a secure local environment and can safely drop the firewalls on both machines if needed.
Is anybody familiar with the rcp/scp/rsync utilities? Are they capable of transferring very large files over the network? Are there any other tools/services I should consider using instead?
