ZFS replacing a drive in a raidz3 based pool

Hi, this is my first post to the forum, please forgive me if there are faults in my submission.

I have been using zfs on FreeBSD for about 7 years and have been able to fix issues by myself before but this one has me confused.

I am trying to replace a device in a raidz3 pool.

I have done this many times without trouble but since upgrading to FreeBSD 13, I see an error that I have not encountered before and I am stuck.

The pool that is giving me trouble is based on 9 drives in a zraid3 configuration. I am using gpt partitions rather than whole drives.

I am doing this because I have systems based on a large number of drives of different sizes.

My problem pool looks like this:

Code:
pool: tank
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(5) for details.
  scan: scrub repaired 0B in 04:23:04 with 0 errors on Wed Jul 14 23:34:34 2021
config:

        NAME                              STATE     READ WRITE CKSUM
        tank                              ONLINE       0     0     0
          raidz3-0                        ONLINE       0     0     0
            gpt/dz0                       ONLINE       0     0     0
            gpt/dz1                       ONLINE       0     0     0
            gpt/dz2                       ONLINE       0     0     0
            gpt/dz3                       ONLINE       0     0     0
            gpt/dz4                       ONLINE       0     0     0
            gpt/dz5                       ONLINE       0     0     0
            gpt/dz6                       ONLINE       0     0     0
            diskid/DISK-S13UJ1BQ710071p1  ONLINE       0     0     0
            gpt/dz8                       ONLINE       0     0     0

errors: No known data errors

I am running the following command:

zpool replace tank diskid/DISK-S13UJ1BQ710071p1 gpt/dz7b

I get the following message:

Code:
cannot replace diskid/DISK-S13UJ1BQ710071p1 with gpt/dz7b: already in replacing/spare config; wait for completion or use 'zpool detach'

If I try zpool detach I see:

Code:
zpool detach tank gpt/dz7b
cannot detach gpt/dz7b: no such device in pool

I know that gpt/dz7b is good, I get a different error message if I substitute it with gpt/dz7c.

I have searched the net for similar issues and I see that others have reported seeing this message but none of the solutions that I have seen work with raidz3.

I am not sure what to try next.
 
Back
Top