• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.



Active Member

Thanks: 27
Messages: 168

A little bird told me that net/glusterfs is capable of creating a ZFS file system that spans multiple computers/pools. However, I have not been able to find any decent "howto's" or the such on how exactly one would go about implementing it or "best practices" and the such. Would be eternally grateful for any input anyone could offer.
Last edited by a moderator:


Well-Known Member

Thanks: 103
Messages: 311

Last time i've read GlusterFS on ZFS in FreeBSD is still experimental; which probably explains the lack of "official" tutorials for end user testing.

You can probably follow the comments in Thread 46923 and some entries in this bug report to get started.



Thanks: 646
Messages: 1,100

(Disclaimer: I've never actually used or installed GlusterFS, but am familiar with other cluster file systems.)

A: Other than some details like how to configure firewalls and how to set up / start services (systemd vs. init), the instructions for Fedora or RHEL should work just fine on FreeBSD; the gluster commands should all be the same. I've read the gluster documentation a few months ago, and I remember seeing a howto guide or a simple install guide, and the commands manual was unusually clear.

B: But cluster file systems tend to be complex and powerful beasts. When using high-end networking hardware and storage backends, they have obvious advantages (in particular for high performance), but the price you pay is extra work configuring and maintaining. Unless you are doing this just for fun to learn something, you might want to consider simpler solutions, like one machine with the disks in it (suitably RAIDed) acting as a file server, or an active/standby pair of nodes doing the same.


Active Member

Thanks: 123
Messages: 227

I made a test two-node cluster with net/pacemaker, net/corosync, net-mgmt/crmsh and net/glusterfs in a VM environment on ESXi. It took a while to set it up right but it was a fun learning experience. I used ufs file systems for it and didn't try zfs.

Regardless of the filesystem, I could not mount the cluster locally on the host nodes until after the server was completely up - even mount late would not work, however that's not a requirement for a true clustered host. Client's could mount it without any problems and failover worked great.

Be sure to put fuse_load="YES" in /boot/loader.conf


Active Member

Thanks: 15
Messages: 178

I'm not familiar with GlusterFS and I'm just researching this topic now.

I checked this wiki and it sounds pretty official to me https://wiki.freebsd.org/GlusterFS which is:
GlusterFS (last edited 2018-05-22 09:40:16 by LapoLuchini)
And the wiki says:
As of date, GlusterFS server is tested on Linux, FreeBSD and Opensolaris, and client runs on only Linux machines.
The key here - client runs only on Linux?
Does it mean that FreeBSD can manage this filesystem as a server, but you cannot mount and browse files it as a client?

Did you manage to do it all on FreeBSD? Client side + server side?



Active Member

Thanks: 123
Messages: 227

Send me a PM and I will send you a link to my howto for setting up pacemaker/corosync and glusterfs. I won't post anything publicly because I don't want to be accused of giving "bad advice".