Is rsync reliable enough?

S

sdf

Hello everyone,

When the source file is being written, if using rsync for synchronization at this time, will get a corrupted file?

Furthermore, if the source host is corrupted at this time, it will not work properly for the synchronized target host to replace the corrupted source host because it has files that have not yet been written. Is this the case?


And which one is the best choice for the "--delete" option?

--delete-before
--delete-during
--delete-delay
--delete-after


Thanks.
 
sdf said:
When the source file is being written, if using rsync for synchronization at this time, will get a corrupted file?
Click to expand...
If you're worried about that happening, why not just remove that possibility from the equation and only rsync from snapshots? Or better yet, just sync with the snapshots themselves (e.g. zfs send/recv)...
sdf said:
Furthermore, if the source host is corrupted at this time, it will not work properly for the synchronized target host to replace the corrupted source host because it has files that have not yet been written. Is this the case?
Click to expand...
I'm not sure what you're asking here.
sdf said:
And which one is the best choice for the "--delete" option?
Click to expand...
This depends. There's a reason for each one.
 
If you have corruption on the sending host at the time when rsync is running there's nothing that can help you, faulty hardware and operating level software bugs are on a different level altogether. It's not something that net/rsync could guard against because software can't be written with the assumption that it runs on quicksand foundations.
 
TomHsiung said:
That's why we need HASH and MD5.
Click to expand...

You're missing the point of what I'm saying. I know very well that rsync uses cryptographic hashes for checking if the files need updating on the destination side and making sure nothing got corrupted in transit and this works as expected as long as you can trust both the hardware and the operating system you're using.

However, it all breaks down as soon as you can no longer trust the system you're using, all bets are off, cows may fly. The tools you're using such as rsync can't be expected to catch hardware or OS level software problems, it simply isn't their responsibility.
 
You must log in or register to reply here.
Back
Top