UFS NVMe raid array

[Phishfry]

Has anyone built an array of NVMe storage devices? I am considering a 4 slot M.2 solution in a RAID10 type arrangement.
Mirrored and Striped.
I am currently using gmirror with SSD's and it works fine.
I will probably continue using geom tools as I prefer the UFS simplicity to ZFS.

Can I raid together NVMe devices with software raid on FreeBSD ?

i would really like to see some head to head numbers of UFS versus ZFS in this type arrangement of ultra fast storage..
2TB RAID10 Array -4 ea. one terrabyte NVMe's = $1100+

NVMe fabric seems to be a key speaking point in storage these days. Who out there is sewing together some NVMe fabric?

 

[Phishfry]

I sure would like details on this rig. 10 NVMe drives on FreeBSD.
https://lists.freebsd.org/pipermail/freebsd-stable/2016-September/085763.html

Looking at some of his hardware output I see: Intel NVMe drives on a NUMA(Multiprocessor board)
He talks about a Green LED for the boards so I assume a Intel or IBM server with hotswap, defiantly not a homebrew.
10 Intel 2.5" NVMe drives. I wonder what the NVMe controller is.

 

[ralphbsz]

Yes, NVMe RAID arrays exist. I know several. Some of them use NVMe over fabric. The ones I know are sold by the big companies in the storage industry, and tend to be very expensive (6 digits in US-$, and the first digit is not small). I have not heard any pro or con at the hobbyist or self-built system level. I might worry that the consumer-grade M.2 packaged NVMe cards don't have sufficient write endurance to survive heavy use, based on the assumption that people who care enough to build RAID also likely have intense workloads.

 

[SirDice]

Can I raid together NVMe devices with software raid on FreeBSD ?

I don't have experience with these devices but they're presented as 'regular' geom(4) disks by nvd(4). So they should be usable in any of the software RAIDs.