Background
The original version of this backup system is detailed in this other thread.
This thread will describe the newly-refactored and streamlined rsbackup system that we're using. See the original thread for all the gory hardware and OS details.
rsbackup v3.2
The latest version of rsbackup is attached to this message later in this thread.
We've upgraded our systems to 9.2-RELEASE, are using a split head node/storage node for a couple of the servers (better expandability down the line, up to 360 TB of raw storage using 2 TB harddrives), and using ZFS-on-Root for all systems now (easier to upgrade using Boot Environments). We've also upgraded to the latest version of ZFS, and have removed dedupe from 2 of the systems, instead using LZ4 compression.
rsbackup v3.0
The main reason for this refactoring was to simplify things, especially the configuration file setup. The second reason was to implement the ability to run a command on the remote system before and/or after running the backup. We've implemented several virtual servers recently, and needed a way to snapshot the VMs before running the backup. Relying on crontab timing for this was not reliable enough.
Earlier versions of rsbackup required several wrapper scripts. Now, everything is in one script, with proper command-line options.
We've also greatly improved the comments, so it should be easier to see how things are done, why they're done that way, etc.
The only bit that has changed since the original version was posted is that we're now running running 7-STABLE with ZFSv13 support, the ARC has been configure to cache metadata only, and 1 raidz2 vdev has been updated with 1.5 TB drives. We're waiting on delivery of a 30 GB SSD which will be configured as an L2ARC. We're still not sure whether to have the SSD be a data or metadata cache.
Enjoy!
The original version of this backup system is detailed in this other thread.
This thread will describe the newly-refactored and streamlined rsbackup system that we're using. See the original thread for all the gory hardware and OS details.
rsbackup v3.2
The latest version of rsbackup is attached to this message later in this thread.
We've upgraded our systems to 9.2-RELEASE, are using a split head node/storage node for a couple of the servers (better expandability down the line, up to 360 TB of raw storage using 2 TB harddrives), and using ZFS-on-Root for all systems now (easier to upgrade using Boot Environments). We've also upgraded to the latest version of ZFS, and have removed dedupe from 2 of the systems, instead using LZ4 compression.
rsbackup v3.0
The main reason for this refactoring was to simplify things, especially the configuration file setup. The second reason was to implement the ability to run a command on the remote system before and/or after running the backup. We've implemented several virtual servers recently, and needed a way to snapshot the VMs before running the backup. Relying on crontab timing for this was not reliable enough.
Earlier versions of rsbackup required several wrapper scripts. Now, everything is in one script, with proper command-line options.
We've also greatly improved the comments, so it should be easier to see how things are done, why they're done that way, etc.
The only bit that has changed since the original version was posted is that we're now running running 7-STABLE with ZFSv13 support, the ARC has been configure to cache metadata only, and 1 raidz2 vdev has been updated with 1.5 TB drives. We're waiting on delivery of a 30 GB SSD which will be configured as an L2ARC. We're still not sure whether to have the SSD be a data or metadata cache.
Enjoy!