ZFS Broken filesystem recovery

Have RAIDZ2 with 13 drives on FreeBSD 11.2.
Had closure/controller failure and 5 drives out of 13 bekame disconnected.
After couple server reset and HDD's transfering to another brand new server, got this message:

Code:
cannot import 'data': I/O error
Recovery is possible, but will result in some data loss.
Returning the pool to its state as of **some date**
should correct the problem.  Approximately **some number** seconds of data
must be discarded, irreversibly.  Recovery can be attempted
by executing 'zpool import -F data'.  A scrub of the pool
is strongly recommended after recovery.

So I made zpool import -F data and everything was fine except when I made zpool status -v I got this:

Code:
errors: Permanent errors have been detected in the following files:
        data/video/400:<0x0>

Cause I can't find in zpool manual any mentions of -FX and -T to rewind some transactions, I boot to livecd with last ZOL and when I make zpool import -d /dev data, got this:

Code:
unable to fetch ZFS version for filesystem 'data/video/400'
cannot mount 'data/video/400': Resource temporarily unavailable

When I am trying to revert any transactions with zpool import -d /dev -FX -T 3903520 data got this:

Code:
cannot import 'data': one or more devices is currently unavailable

and this in /proc/spl/kstat/zfs/dbgmsg:

Code:
1562084934   spa.c:5616:spa_tryimport(): spa_tryimport: importing data, max_txg=3903520
1562084934   spa_misc.c:408:spa_load_note(): spa_load($import, config trusted): LOADING
1562084935   spa_misc.c:393:spa_load_failed(): spa_load($import, config untrusted): FAILED: no valid uberblock found
1562084935   spa_misc.c:408:spa_load_note(): spa_load($import, config untrusted): UNLOADING
1562084935   spa.c:5473:spa_import(): spa_import: importing data, max_txg=3903520 (RECOVERY MODE)
1562084935   spa_misc.c:408:spa_load_note(): spa_load(data, config trusted): LOADING
1562084935   spa_misc.c:393:spa_load_failed(): spa_load(data, config untrusted): FAILED: no valid uberblock found
1562084935   spa_misc.c:408:spa_load_note(): spa_load(data, config untrusted): UNLOADING

This FS got 19TB of data I really don't want to lose. I am really want to restore/recover/dump them somehow.
 
Back
Top