ZFS ZFS to S3

[zader]

Just wondering if it's possible to ZFS send/receive or replicate from a FreeBSD system / zpool or dataset directly to an S3 bucket?

Seems like it would be a very useful way of interacting with Amazon.


Thanks.

 

[ShelLuser]

Depends. If you can set up a direct access to an S3 bucket from FreeBSD using a tool which also supports a filestream through stdin then this should theoretically be possible.

All which zfs send does is create a stream which gets sent to stdout. Anything beyond that is up to the admin.

 

[grahamperrin]

… way of interacting with Amazon.

Via <https://github.com/openzfs/zfs/issues/12119#issuecomment-986292660>:

• ZFS on Object Storage by George Wilson, Matt Ahrens, Paul Dagnelie, Manoj Joseph - YouTube
• ZettaCache: fast access to slow storage by Mark Maybee & Serapheim Dimitropoulos - YouTube
• OpenZFS Developer Summit 2021 - OpenZFS

 

[grahamperrin]

Not S3, but a way of interacting with Amazon:

New – Amazon FSx for OpenZFS | AWS News Blog (2021-11-30)

– thanks to tehpeh for his hint in Twitter.

From the product page:

Amazon FSx for OpenZFS provides fully managed shared file storage built on the OpenZFS file system, powered by the AWS Graviton family of processors, and accessible via the NFS protocol (v3, v4, v4.1, v4.2).