ZFS Need help to recover data from damaged ZFS pool

AndrewS
If the command dd if=<zfs partition> | strings |grep pool_guid does not return "pool_guid" string, I don't think the pool is recoverable. The real guid is binary, it won't be visible with strings.
You may need to copy (using dd the (relevant part of) content of your disk into a file on a different disk then use a tool like mcedit or bvi to locate the offset of pool_guid string.
I couldn't find an (easy to use) hex editor able to open directly the disk (eg. /dev/ada0). But I'm no guru ;)
I recomend to try to use an extra USB stick to create a partition scheme and a new pool on it. Then try to practice a similar recovery on it, after destroying it's partition scheme.
Don't write anything on your valuable disks, until you succeed to revive the USB pool.
 
It's a bit worrying that so many people seem to be having what appears to be exactly the same issue. I'm guessing it's highly unlikely something has been done in FreeNAS that has re-configured the disks?

Looking at the only ZFS spec document I can find, it suggests the labels on disk should be 256k and laid out as follows:
8k - Left clear for boot information
8k - Reserved
112k - Name/Value pairs (this is where you find all the label data shown when you run zdb -l disk)
128k - Uberblock array.

The uberblock should start with 00bab10c in hex, although it's reversed as '0c b1 ba 00' on little-endian systems.
However even though 8+8+112 = 128, suggesting the uberblock should start 128k into the disk, I'm finding mine at 132k.
I don't know if the spec was changed or if I'm misunderstanding something.

Code:
# dd if=/dev/gpt/disk0 bs=1k skip=132 count=1 | hd
1+0 records in
1+0 records out
1024 bytes transferred in 0.000083 secs (12341860 bytes/sec)
00000000  0c b1 ba 00 00 00 00 00  1c 00 00 00 00 00 00 00  |................|

The second uberblock magic number shows up as expected 256k further on -

Code:
# dd if=/dev/gpt/disk0 bs=1k skip=388 count=1 | hd
1+0 records in
1+0 records out
1024 bytes transferred in 0.000080 secs (12782641 bytes/sec)
00000000  0c b1 ba 00 00 00 00 00  1c 00 00 00 00 00 00 00  |................|

You could probably try and locate the uberblock on disk by dd'ing the disk (or part of it) through hd() as above, but then grepping for 0c b1 ba 00.

Of course unless the disks have been re-partitioned (which seems unlikely with the number of people showing the problem), it's a bit worrying that zdb -l can't find any labels on the disk at all.
 
I run into the SAME exact issue last year, and put the drive in storage until i could tend to it. I had a similar issue as others. Something went wrong, and I had a kernel panic. Forced to reboot to recover, but was left with ruins. Now I'm forced to deal with it, and i pretty much literally have the same exact results. I would appreciate any help as well. I am not familiar enough with ZFS or much of the tools to be meandering around my zfs safely. I have created a notepad++ file (txt) to document my searches and results.
The two disks that were apart of a Mirrored Raid was ada2 and ada4. They are 3tb drives. Everything else is my "new" FreeNAS I pulled together so i could get past the crashed one.

Code:
[root@freenas] ~# gpart show ada2
=>        34  5860533101  ada2  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# gpart list ada2
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5bb15a9-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5d31f0f-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [root@freenas] ~# zdb -lu /dev/ada2p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3
#########################################################################
[root@freenas] ~# gpart show ada4
=>        34  5860533101  ada4  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)
  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  [root@freenas] ~# gpart list ada4
Geom name: ada4
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6acbe2c-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada4p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6c138dd-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada4
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [root@freenas] ~# zdb -lu /dev/ada4p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3


@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

##########################################################################
###########  Sachiru from #zfs Aided using these commands & results
###########
##########################################################################

[root@freenas] ~# zpool import -d /dev/ada2p2 -FDf storage
cannot open '/dev/ada2p2/': Not a directory
cannot import 'storage': no such pool available

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# zdb -l /dev/gptid/e5d31f0f-8262-11e3-ac54-643150244f0d
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
##########################################################################
###########  https://forums.freebsd.org/threads/need-help-to-recover-data-from-damaged-zfs-pool.49782/#post-279702
###########
##########################################################################


[root@freenas] ~# gpart show -l
=>      34  62529469  da0  GPT  (29G)
        34      1024    1  1  (512k)
      1058         6       - free -  (3.0k)
      1064  62528432    2  1  (29G)
  62529496         7       - free -  (3.5k)

=>       1  62529535  da1  MBR  (29G)
         1    792287    1  (null)  [active]  (386M)
    792288  61737248       - free -  (29G)

=>       34  312581741  ada0  GPT  (149G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  308387336     2  1  (147G)
  312581768          7        - free -  (3.5k)

=>       34  234441581  ada1  GPT  (111G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  230247176     2  1  (109G)
  234441608          7        - free -  (3.5k)

=>        34  5860533101  ada2  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  5856338696     2  1  (2.7T)
  5860533128           7        - free -  (3.5k)

=>        34  3907029101  ada3  GPT  (1.8T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  3902834696     2  1  (1.8T)
  3907029128           7        - free -  (3.5k)

=>        34  5860533101  ada4  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  5856338696     2  1  (2.7T)
  5860533128           7        - free -  (3.5k)

=>       34  976773101  ada5  GPT  (465G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  972578696     2  1  (463G)
  976773128          7        - free -  (3.5k)

=>       34  234441581  ada6  GPT  (111G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  230247176     2  1  (109G)
  234441608          7        - free -  (3.5k)

=>       1  62529535  iso9660/FreeNAS_INSTALL  MBR  (29G)
         1    792287                        1  (null)  [active]  (386M)
    792288  61737248                           - free -  (29G)

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# zdb -l /dev/ada2p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3
 
Last edited by a moderator:
Last edited by a moderator:
From what I've been reading, FreeNAS always creates a 2GB swap partition and the second partition is actually used for ZFS. So your best bet would be to start scanning at the beginning of that second partition.
 
Hi, try to make a flash drive with the latest mfsBSD (10.2) and boot from it. It contain the latest ZFS code. After you boot, try to zpool import or zpool import data (seen that you had zpool.cache file in /data directory - so probably your pool is named data). If it will work just copy all your data out from it, and then re-install/re-create everything.

I had a big trouble with my file server with 12 drives in 2 vdev's after power loss related to a glorious death of uninterruptible power supply - I wasn't been able to import or get the status of the whole pool - I always got the same - core dumped on initialization of the pool. A big thanks going to Martin Matuška for creating mfsBSD that solved all my problems.

Hope it will help You!
 
Hi, try to make a flash drive with the latest mfsBSD (10.2) and boot from it. It contain the latest ZFS code. After you boot, try to zpool import or zpool import data (seen that you had zpool.cache file in /data directory - so probably your pool is named data). If it will work just copy all your data out from it, and then re-install/re-create everything.

I had a big trouble with my file server with 12 drives in 2 vdev's after power loss related to a glorious death of uninterruptible power supply - I wasn't been able to import or get the status of the whole pool - I always got the same - core dumped on initialization of the pool. A big thanks going to Martin Matuška for creating mfsBSD that solved all my problems.

Hope it will help You!
Thank you for the input, but iI'm pretty sure that file uryou are talking about is for my current ZFS and FreeNAS setup. Not the old one, unless that file directory you say iI have, exists on the 3TB drives. (I have no idea).
Would it be on the drive that the ZFS is hosted on?
Basically, last year iI had a FreeNAS setup with ZFS, and it crashed. I took the drives out of the machine and stored them for a day when iI could attend to it (this week). So iI put them into a new FreeNAS setup iI have thinking it would make it easier to address.
 
Mostly, zpool.cache must be inside of /boot/zfs/ directory. Sometimes it's being corrupted, so you can try to rename (not delete) that file and try to import your pool after it. ZFS will re-create this file on import of the pool. ZFS keeps physical drives information and some options for a pool in that file. Just check it's length - it's must be greater than 0. If it's zero - then something is gone wrong - rename it and try to import pool.
 
I wouldn't be too worried about the zpool.cache. If even zdb can't find any labels on the disks there are more serious problems. A lot of the responses here seem to relate to issues where disks were detached or the system was hanging, but the labels were still visible. ZFS will store pool config in the cache, but it's still going to validate the labels on disk during import, which it can't do if it can't find them.

I would be trying to locate the labels to see if they still exist (using a recent live image). Easiest way of doing that seems to be to look for the uberblock magic number. It doesn't look good though; I don't see anything particularly wrong with the partitions. All of the partition tables provided seem to start the 2G swap partition as block 128, which is probably a FreeNAS thing, and then the ZFS partition after this. I'd be highly surprised if all the disks had been automatically repartitioned with a different layout, such that ZFS can't find labels at either end of the partition.

Had any FreeNAS updates been installed since the previous reboot? This may be something FreeNAS devs may be interested in looking at, if you can find any. Multiple users seeing all ZFS labels are corrupt after a simple reboot seems a fairly serious issue.
 
Mostly, zpool.cache must be inside of /boot/zfs/ directory. Sometimes it's being corrupted, so you can try to rename (not delete) that file and try to import your pool after it. ZFS will re-create this file on import of the pool. ZFS keeps physical drives information and some options for a pool in that file. Just check it's length - it's must be greater than 0. If it's zero - then something is gone wrong - rename it and try to import pool.

I'm not entirely sure that will help. My installation was on an old build from a year ago. The installation was on FreeNAS 8, and while it was running, there was a ZFS upgrade it demanded. So I upgraded it. Some time later while I was away there was a kernel panic and hang. I was forced to do a manual reboot to recover system functionality. With that, iI lost my ZFS. I removed the drives, and stored them for later recovery. I then created a new FreeNAS system with FreeNAS 9 and installed older drives to give me something to work with while iI was away at school. I came back for break, and reinstalled the crashed ZFS drives for recovery. - So iI'm not entirely sure the zpool.cache will hold the information you're looking/talking about.
 
I wouldn't be too worried about the zpool.cache. If even zdb can't find any labels on the disks there are more serious problems. A lot of the responses here seem to relate to issues where disks were detached or the system was hanging, but the labels were still visible. ZFS will store pool config in the cache, but it's still going to validate the labels on disk during import, which it can't do if it can't find them.

I would be trying to locate the labels to see if they still exist (using a recent live image). Easiest way of doing that seems to be to look for the uberblock magic number. It doesn't look good though; I don't see anything particularly wrong with the partitions. All of the partition tables provided seem to start the 2G swap partition as block 128, which is probably a FreeNAS thing, and then the ZFS partition after this. I'd be highly surprised if all the disks had been automatically repartitioned with a different layout, such that ZFS can't find labels at either end of the partition.

Had any FreeNAS updates been installed since the previous reboot? This may be something FreeNAS devs may be interested in looking at, if you can find any. Multiple users seeing all ZFS labels are corrupt after a simple reboot seems a fairly serious issue.

How do I look for the uberblock #? If you could read the comment iI posted for ab2k, iI detailed the situation a bit.

If anyone has any commands I can run to provide information for the situation, iI would appreciate it. I am not a ZFS or FreeNAS guru, so I'm not the most knowledgeable person for self diag's on this system. But, with all the basic commands and from what iI can see (and have been told), my partitions and information maybe intact, but - the labels are simply missing. But there are no basic commands iI have been given or read that will recover them. I've gone through quite a number of threads, with basically all the same commands. SO if there is something anyone believes would assist in retrieving them, please suggest it.
 
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.

I run into the SAME exact issue last year, and put the drive in storage until i could tend to it. I had a simliar issue as others. Something went wrong, and i had a kernel panic. Forced to reboot to recover, but was left with ruins. Now I'm forced to deal with it, and i pretty much literally have the same exact results. I would appreciate any help as well. I am not familiar enough with ZFS or much of the tools to be meandering around my zfs safely. I have created a notepad++ file (txt) to document my searches and results.
The two disks that were apart of a Mirrored Raid was ada2 and ada4. They are 3tb drives. Everything else is my "new" Freenas i pulled together so i could get past the crahsed one.

Code:
[root@freenas] ~# gpart show ada2
=>        34  5860533101  ada2  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# gpart list ada2
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5bb15a9-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5d31f0f-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [root@freenas] ~# zdb -lu /dev/ada2p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3
#########################################################################
[root@freenas] ~# gpart show ada4
=>        34  5860533101  ada4  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)
  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  [root@freenas] ~# gpart list ada4
Geom name: ada4
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6acbe2c-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada4p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6c138dd-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada4
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [root@freenas] ~# zdb -lu /dev/ada4p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3


@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

##########################################################################
###########  Sachiru from #zfs Aided using these commands & results
###########
##########################################################################

[root@freenas] ~# zpool import -d /dev/ada2p2 -FDf storage
cannot open '/dev/ada2p2/': Not a directory
cannot import 'storage': no such pool available

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# zdb -l /dev/gptid/e5d31f0f-8262-11e3-ac54-643150244f0d
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
##########################################################################
###########  https://forums.freebsd.org/threads/need-help-to-recover-data-from-damaged-zfs-pool.49782/#post-279702
###########
##########################################################################


[root@freenas] ~# gpart show -l
=>      34  62529469  da0  GPT  (29G)
        34      1024    1  1  (512k)
      1058         6       - free -  (3.0k)
      1064  62528432    2  1  (29G)
  62529496         7       - free -  (3.5k)

=>       1  62529535  da1  MBR  (29G)
         1    792287    1  (null)  [active]  (386M)
    792288  61737248       - free -  (29G)

=>       34  312581741  ada0  GPT  (149G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  308387336     2  1  (147G)
  312581768          7        - free -  (3.5k)

=>       34  234441581  ada1  GPT  (111G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  230247176     2  1  (109G)
  234441608          7        - free -  (3.5k)

=>        34  5860533101  ada2  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  5856338696     2  1  (2.7T)
  5860533128           7        - free -  (3.5k)

=>        34  3907029101  ada3  GPT  (1.8T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  3902834696     2  1  (1.8T)
  3907029128           7        - free -  (3.5k)

=>        34  5860533101  ada4  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  1  (2.0G)
     4194432  5856338696     2  1  (2.7T)
  5860533128           7        - free -  (3.5k)

=>       34  976773101  ada5  GPT  (465G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  972578696     2  1  (463G)
  976773128          7        - free -  (3.5k)

=>       34  234441581  ada6  GPT  (111G)
         34         94        - free -  (47k)
        128    4194304     1  1  (2.0G)
    4194432  230247176     2  1  (109G)
  234441608          7        - free -  (3.5k)

=>       1  62529535  iso9660/FreeNAS_INSTALL  MBR  (29G)
         1    792287                        1  (null)  [active]  (386M)
    792288  61737248                           - free -  (29G)

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[root@freenas] ~# zdb -l /dev/ada2p2
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3
 
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.
I booted in, and tried :
zpool import -R /mnt poolname

I don't entirely remember what the pool name was. But I tried it. The command said there was no such pool available. I did dmesg, but there was a lot there. I'm not entirely familiar with the usage of this, so basic troubleshooting isn't a strong point. I'm going to fiddle around a bit with some commands. But- honestly, it seems like the commands are the same as if I was in FreeNAS. So, what makes mfsBSD special?
 
What was the system configuration on these machines? In the FreeNAS forums they make quite a big deal about making sure that people use ECC RAM when using ZFS.
 
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.

I'm having issues creating a working bootable mfsBSD USB Drive. I have used YUMI, Unetbootin, and DD. The only one that has worked is YUMI, but It was giving me issues with mounting an second USB drive to save the information to post for you. Any suggestions?
 
Last edited by a moderator:
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.

Ok, I got logged in via mfsBSD- But the results were the same.
Here are the results of the some commands.

gpart list

gpart show

zpool import

smartctl -a -q noserial /dev/ada2

camcontrol devlist

glabel status

zdb -l /dev/ada1

zpool history

dmesg

###################################################
gpart list
Code:
Geom name: da1
modified: false
state: CORRUPT
fwheads: 255
fwsectors: 63
last: 485406
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 8d62bdb8-4b11-11e5-9b48-3085a9a4510d
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: boot
   length: 524288
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 1057
   start: 34
2. Name: da1p2
   Mediasize: 247986688 (236M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 541696
   Mode: r0w0e0
   rawuuid: 8e2fc2cb-4b11-11e5-9b48-3085a9a4510d
   rawtype: 516e7cb6-6ecf-11d6-8ff8-00022d09712b
   label: rootfs
   length: 247986688
   offset: 541696
   type: freebsd-ufs
   index: 2
   end: 485406
   start: 1058
Consumers:
1. Name: da1
   Mediasize: 8000110592 (7.5G)
   Sectorsize: 512
   Mode: r0w0e0

Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5bb15a9-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada0p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5d31f0f-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada0
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6acbe2c-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada1p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6c138dd-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: ada1
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: diskid/DISK-20053551930EEB63709E
modified: false
state: CORRUPT
fwheads: 255
fwsectors: 63
last: 485406
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: diskid/DISK-20053551930EEB63709Ep1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: 8d62bdb8-4b11-11e5-9b48-3085a9a4510d
   rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
   label: boot
   length: 524288
   offset: 17408
   type: freebsd-boot
   index: 1
   end: 1057
   start: 34
2. Name: diskid/DISK-20053551930EEB63709Ep2
   Mediasize: 247986688 (236M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 541696
   Mode: r0w0e0
   rawuuid: 8e2fc2cb-4b11-11e5-9b48-3085a9a4510d
   rawtype: 516e7cb6-6ecf-11d6-8ff8-00022d09712b
   label: rootfs
   length: 247986688
   offset: 541696
   type: freebsd-ufs
   index: 2
   end: 485406
   start: 1058
Consumers:
1. Name: diskid/DISK-20053551930EEB63709E
   Mediasize: 8000110592 (7.5G)
   Sectorsize: 512
   Mode: r0w0e0

Geom name: diskid/DISK-WD-WCC4N0094983
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: diskid/DISK-WD-WCC4N0094983p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5bb15a9-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: diskid/DISK-WD-WCC4N0094983p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e5d31f0f-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: diskid/DISK-WD-WCC4N0094983
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: diskid/DISK-WD-WCC4N0129034
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: diskid/DISK-WD-WCC4N0129034p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6acbe2c-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: diskid/DISK-WD-WCC4N0129034p2
   Mediasize: 2998445412352 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: e6c138dd-8262-11e3-ac54-643150244f0d
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: 1
   length: 2998445412352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 5860533127
   start: 4194432
Consumers:
1. Name: diskid/DISK-WD-WCC4N0129034
   Mediasize: 3000592982016 (2.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
 
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.

gpart show:
Code:
=>    34  485373  da1  GPT  (7.5G) [CORRUPT]
      34    1024    1  freebsd-boot  (512K)
    1058  484349    2  freebsd-ufs  (236M)

=>        34  5860533101  ada0  GPT  (2.7T)
          34          94        - free -  (47K)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5K)

=>        34  5860533101  ada1  GPT  (2.7T)
          34          94        - free -  (47K)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5K)

=>    34  485373  diskid/DISK-20053551930EEB63709E  GPT  (7.5G) [CORRUPT]
      34    1024                                 1  freebsd-boot  (512K)
    1058  484349                                 2  freebsd-ufs  (236M)

=>        34  5860533101  diskid/DISK-WD-WCC4N0094983  GPT  (2.7T)
          34          94                               - free -  (47K)
         128     4194304                            1  freebsd-swap  (2.0G)
     4194432  5856338696                            2  freebsd-zfs  (2.7T)
  5860533128           7                               - free -  (3.5K)

=>        34  5860533101  diskid/DISK-WD-WCC4N0129034  GPT  (2.7T)
          34          94                               - free -  (47K)
         128     4194304                            1  freebsd-swap  (2.0G)
     4194432  5856338696                            2  freebsd-zfs  (2.7T)
  5860533128           7                               - free -  (3.5K)

zpool import:
Nothing shows, moves to new line.

smartctl -a -q noserial /dev/ada2:
Code:
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.2-RELEASE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Green
Device Model:     WDC WD30EZRX-00D8PB0
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun Jan 24 00:25:48 2016 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)    Offline data collection activity
                    was completed without error.
                    Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever
                    been run.
Total time to complete Offline
data collection:         (41940) seconds.
Offline data collection
capabilities:             (0x7b) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    Offline surface scan supported.
                    Self-test supported.
                    Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine
recommended polling time:     (   2) minutes.
Extended self-test routine
recommended polling time:     ( 420) minutes.
Conveyance self-test routine
recommended polling time:     (   5) minutes.
SCT capabilities:           (0x7035)    SCT Status supported.
                    SCT Feature Control supported.
                    SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   177   176   021    Pre-fail  Always       -       6150
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       67
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   093   093   000    Old_age   Always       -       5255
10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       67
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       38
193 Load_Cycle_Count        0x0032   080   080   000    Old_age   Always       -       361684
194 Temperature_Celsius     0x0022   123   101   000    Old_age   Always       -       27
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
 
Hi,

let's start from start.

1. Burn mfsBSD 10.2 to a flash drive (it contain latest ZFS).
2. Remove all HDD drives, just leave ada2 and ada4 connected (bad idea to start playing with a BAD pool with a working one - if you get a kernel panic it may crash the working pool).
3. Boot from flash drive with mfsBSD 10.2.
4. Try to import your broken pool - if it imported - connect an external drive and start to rescue your data from it or just export it to do it later (DON'T upgrade it); if its not imported - please write here what it will say on importing.
5. Do the same with your other pool.

Just try it.

Small addition: it's actually very strange that gpart(8) does not recognize the partitions... Your drives are not encrypted? Please post dmesg here.


camcontrol devlist:
Code:
<WDC WD30EZRX-00D8PB0 80.00A80>    at scbus4 target 0 lun 0 (ada0,pass0)
<WDC WD30EZRX-00D8PB0 80.00A80>    at scbus6 target 0 lun 0 (ada1,pass1)
<SanDisk Cruzer 1.00>              at scbus10 target 0 lun 0 (pass3,da1)

glabel status:
Code:
                                      Name  Status  Components
          diskid/DISK-20053551930EEB63709E     N/A  da1
               diskid/DISK-WD-WCC4N0094983     N/A  ada0
               diskid/DISK-WD-WCC4N0129034     N/A  ada1
                                  gpt/boot     N/A  da1p1
gptid/8d62bdb8-4b11-11e5-9b48-3085a9a4510d     N/A  da1p1
                                gpt/rootfs     N/A  da1p2
gptid/8e2fc2cb-4b11-11e5-9b48-3085a9a4510d     N/A  da1p2
gptid/e5bb15a9-8262-11e3-ac54-643150244f0d     N/A  ada0p1
gptid/e5d31f0f-8262-11e3-ac54-643150244f0d     N/A  ada0p2
gptid/e6acbe2c-8262-11e3-ac54-643150244f0d     N/A  ada1p1
gptid/e6c138dd-8262-11e3-ac54-643150244f0d     N/A  ada1p2
gparted recover
Code:
ada0 recovering is not needed

zdb -l /dev/ada1
Code:
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3

zpool history:
Code:
no pools available
 
dmesg:
Code:
Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015
    root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: AMD Phenom(tm) II X2 555 Processor (3210.87-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x100f43  Family=0x10  Model=0x4  Stepping=3
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x802009<SSE3,MON,CX16,POPCNT>
  AMD Features=0xee500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM,3DNow!+,3DNow!>
  AMD Features2=0x37ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT>
  SVM: NP,NRIP,NAsids=64
  TSC: P-state invariant
real memory  = 8589934592 (8192 MB)
avail memory = 8200699904 (7820 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <050410 APIC1420>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 64/32 (20150515/tbfadt-644)
ioapic0 <Version 2.1> irqs 0-23 on motherboard
random: <Software, Yarrow> initialized
kbd1 at kbdmux0
acpi0: <050410 XSDT1420> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Event timer "HPET1" frequency 14318180 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_ec0: <Embedded Controller: GPE 0xa> port 0x62,0x66 on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 19 at device 3.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xb000-0xb0ff mem 0xd0000000-0xdfffffff,0xfe6f0000-0xfe6fffff irq 19 at device 0.0 on pci1
vgapci0: Boot video device
vgapci1: <VGA-compatible display> mem 0xfe6e0000-0xfe6effff at device 0.1 on pci1
pcib2: <ACPI PCI-PCI bridge> irq 17 at device 9.0 on pci0
pci2: <ACPI PCI bus> on pcib2
xhci0: <NEC uPD720200 USB 3.0 controller> mem 0xfe7fe000-0xfe7fffff irq 17 at device 0.0 on pci2
xhci0: 32 bytes context size, 32-bit DMA
usbus0 on xhci0
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 10.0 on pci0
pci3: <ACPI PCI bus> on pcib3
atapci0: <JMicron JMB361 UDMA133 controller> port 0xcc00-0xcc07,0xc880-0xc883,0xc800-0xc807,0xc480-0xc483,0xc400-0xc40f mem 0xfe8fe000-0xfe8fffff irq 18 at device 0.0 on pci3
ahci0: <JMicron JMB361 AHCI SATA controller> at channel -1 on atapci0
ahci0: AHCI v1.00 with 2 3Gbps ports, Port Multiplier supported
ahci0: quirks=0x1<NOFORCE>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ata2: <ATA channel> at channel 0 on atapci0
ahci1: <AMD SB7x0/SB8x0/SB9x0 AHCI SATA controller> port 0xa000-0xa007,0x9000-0x9003,0x8000-0x8007,0x7000-0x7003,0x6000-0x600f mem 0xfe5ffc00-0xfe5fffff irq 19 at device 17.0 on pci0
ahci1: AHCI v1.20 with 6 6Gbps ports, Port Multiplier supported
ahci1: quirks=0x22000<ATI_PMP_BUG,1MSI>
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ahcich4: <AHCI channel> at channel 2 on ahci1
ahcich5: <AHCI channel> at channel 3 on ahci1
ahcich6: <AHCI channel> at channel 4 on ahci1
ahcich7: <AHCI channel> at channel 5 on ahci1
ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe5fe000-0xfe5fefff irq 18 at device 18.0 on pci0
usbus1 on ohci0
ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe5ff800-0xfe5ff8ff irq 17 at device 18.2 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci0
ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe5fd000-0xfe5fdfff irq 18 at device 19.0 on pci0
usbus3 on ohci1
ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe5ff400-0xfe5ff4ff irq 17 at device 19.2 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci1
hdac0: <ATI SB600 HDA Controller> mem 0xfe5f4000-0xfe5f7fff irq 16 at device 20.2 on pci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib4: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci4: <ACPI PCI bus> on pcib4
emu10kx0: <Creative SBLive! Value [CT4832]> port 0xdc00-0xdc1f irq 20 at device 5.0 on pci4
pcm0: <EMU10Kx DSP front PCM interface> on emu10kx0
pcm0: <SigmaTel STAC9721/23 AC97 Codec>
pcm1: <EMU10Kx DSP rear PCM interface> on emu10kx0
pci4: <input device> at device 5.1 (no driver attached)
rl0: <D-Link DFE-530TX+ 10/100BaseTX> port 0xd400-0xd4ff mem 0xfe9fbc00-0xfe9fbcff irq 21 at device 6.0 on pci4
miibus0: <MII bus> on rl0
rlphy0: <RealTek internal media interface> PHY 0 on miibus0
rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl0: Ethernet address: 00:40:05:08:90:8f
pci4: <serial bus, FireWire> at device 7.0 (no driver attached)
ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe5fc000-0xfe5fcfff irq 18 at device 20.5 on pci0
usbus5 on ohci2
pcib5: <ACPI PCI-PCI bridge> at device 21.0 on pci0
pci5: <ACPI PCI bus> on pcib5
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xe800-0xe8ff mem 0xfdfff000-0xfdffffff,0xfdff8000-0xfdffbfff irq 16 at device 0.0 on pci5
re0: Using 1 MSI-X message
re0: ASPM disabled
re0: Chip rev. 0x2c000000
re0: MAC rev. 0x00100000
miibus1: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus1
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: 20:cf:30:07:b6:ac
ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe5f3000-0xfe5f3fff irq 18 at device 22.0 on pci0
usbus6 on ohci3
ehci2: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe5ff000-0xfe5ff0ff irq 17 at device 22.2 on pci0
usbus7: EHCI version 1.0
usbus7 on ehci2
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (9600,n,8,1)
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcefff,0xd3800-0xd67ff,0xd6800-0xd77ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
md0: Preloaded image </mfsroot> 67928064 bytes at 0xffffffff8199ddb0
random: unblocking device.
usbus0: 5.0Gbps Super Speed USB v3.0
Timecounters tick every 1.000 msec
hdacc0: <Realtek ALC892 HDA CODEC> at cad 0 on hdac0
hdaa0: <Realtek ALC892 Audio Function Group> at nid 1 on hdacc0
pcm2: <Realtek ALC892 (Rear Analog 7.1/2.0)> at nid 20,22,21,23 and 24,26 on hdaa0
pcm3: <Realtek ALC892 (Front Analog)> at nid 27 and 25 on hdaa0
pcm4: <Realtek ALC892 (Rear Digital)> at nid 30 on hdaa0
pcm5: <Realtek ALC892 (Onboard Digital)> at nid 17 on hdaa0
usbus1: 12Mbps Full Speed USB v1.0
ugen0.1: <0x1033> at usbus0
uhub0: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <ATI> at usbus1
uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
ugen2.1: <ATI> at usbus2
uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen3.1: <ATI> at usbus3
uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
usbus4: 480Mbps High Speed USB v2.0
usbus5: 12Mbps Full Speed USB v1.0
ugen4.1: <ATI> at usbus4
uhub0: 4 ports with 4 removable, self powered
uhub4: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
uhub1: 5 ports with 5 removable, self powered
ugen5.1: <ATI> at usbus5
uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
usbus6: 12Mbps Full Speed USB v1.0
usbus7: 480Mbps High Speed USB v2.0
ugen6.1: <ATI> at usbus6
uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen7.1: <ATI> at usbus7
uhub7: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
uhub3: 5 ports with 5 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub6: 4 ports with 4 removable, self powered
uhub2: 5 ports with 5 removable, self powered
uhub4: 5 ports with 5 removable, self powered
uhub7: 4 ports with 4 removable, self powered
ugen2.2: <PNY Technologies> at usbus2
umass0: <PNY Technologies USB 2.0 FD, class 0/0, rev 2.00/1.00, addr 2> on usbus2
umass0:  SCSI over Bulk-Only; quirks = 0x8100
umass0:9:0:-1: Attached to scbus9
ugen4.2: <SanDisk> at usbus4
umass1: <SanDisk Cruzer, class 0/0, rev 2.00/1.00, addr 2> on usbus4
umass1:  SCSI over Bulk-Only; quirks = 0xc100
umass1:10:1:-1: Attached to scbus10
ugen3.2: <Logitech> at usbus3
ukbd0: <Logitech USB Receiver, class 0/0, rev 2.00/12.01, addr 2> on usbus3
kbd2 at ukbd0
ahcich1: AHCI reset: device not ready after 31000ms (tfd = 000000ff)
ahcich1: Poll timeout on slot 1 port 15
ahcich1: is 00000000 cs 00000002 ss 00000000 rs 00000002 tfd 77 serr 00020000 cmd 0004c111
(aprobe1:ahcich1:0:15:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe1:ahcich1:0:15:0): CAM status: Command timeout
(aprobe1:ahcich1:0:15:0): Error 5, Retries exhausted
run_interrupt_driven_hooks: still waiting after 60 seconds for xpt_config
ahcich1: Poll timeout on slot 2 port 15
ahcich1: is 00000000 cs 00000004 ss 00000000 rs 00000004 tfd 77 serr 00020000 cmd 0004c211
(aprobe1:ahcich1:0:15:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe1:ahcich1:0:15:0): CAM status: Command timeout
(aprobe1:ahcich1:0:15:0): Error 5, Retries exhausted
ahcich1: Poll timeout on slot 3 port 0
ahcich1: is 00000000 cs 00000008 ss 00000000 rs 00000008 tfd 77 serr 00020000 cmd 0004c311
(aprobe0:ahcich1:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich1:0:0:0): CAM status: Command timeout
(aprobe0:ahcich1:0:0:0): Error 5, Retries exhausted
ada0 at ahcich3 bus 0 scbus4 target 0 lun 0
ada0: <WDC WD30EZRX-00D8PB0 80.00A80> ACS-2 ATA SATA 3.x device
da0 at umass-sim0 bus 0 scbus9 target 0 lun 0
da0: <PNY USB 2.0 FD 0.00> Removable Direct Access SPC-2 SCSI device
da0: Serial Number UT2B191900000176
da0: 40.000MB/s transfers
da0: 15274MB (31281152 512 byte sectors: 255H 63S/T 1947C)
da0: quirks=0x2<NO_6_BYTE>
da1 at umass-sim1 bus 1 scbus10 target 0 lun 0
da1: <SanDisk Cruzer 1.00> Removable Direct Access SCSI-2 device
da1: Serial Number 20053551930EEB63709E
da1: 40.000MB/s transfers
da1: 7629MB (15625216 512 byte sectors: 255H 63S/T 972C)
da1: quirks=0x2<NO_6_BYTE>
ada0: Serial Number WD-WCC4N0094983
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada0: quirks=0x1<4K>
ada0: Previously was known as ad12
ada1 at ahcich5 bus 0 scbus6 target 0 lun 0
ada1: <WDC WD30EZRX-00D8PB0 80.00A80> ACS-2 ATA SATA 3.x device
ada1: Serial Number WD-WCC4N0129034
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad16
GEOM: da1: the secondary GPT header is not in the last LBA.
SMP: AP CPU #1 Launched!
Timecounter "TSC-low" frequency 1605436013 Hz quality 800
GEOM: diskid/DISK-20053551930EEB63709E: the secondary GPT header is not in the last LBA.
Trying to mount root from ufs:/dev/md0 []...
ugen2.2: <PNY Technologies> at usbus2 (disconnected)
umass0: at uhub2, port 3, addr 2 (disconnected)
da0 at umass-sim0 bus 0 scbus9 target 0 lun 0
da0: <PNY USB 2.0 FD 0.00> s/n UT2B191900000176 detached
(da0:umass-sim0:0:0:0): Periph destroyed
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
 
Hi,

Thank you for posting that data. I don't see that your drives are bad (GPT partitions are visible) and seems they are not encrypted (no GELIO things are here).
You doing zdb -l /dev/ada1, but think you should do it on ZFS volume, located on /dev/ada1p2.
Btw, few posts before you have asked how you can find the uberblocks - just add the -u command to the command before ( zdb -l -u /dev/ada1p2).

Additions:
do you remember your pool name ?
if yes - then what shows zpool status *POOLNAME* ?
And did you tried to do zpool import *POOLNAME* ?
Ofc, *POOLNAME* must be replaced with the name of ZFS pool you had.
 
Hi,

Thank you for posting that data. I don't see that your drives are bad (GPT partitions are visible) and seems they are not encrypted (no GELIO things are here).
You doing zdb -l /dev/ada1, but think you should do it on ZFS volume, located on /dev/ada1p2.
Btw, few posts before you have asked how you can find the uberblocks - just add the -u command to the command before ( zdb -l -u /dev/ada1p2).
Both resulted in:
Code:
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3

I had also noticed that one of the read it stated a partition was corrupt.
Any information toward a recovery method would be appreciated. Anything. Ty.
 
Hi again,
the corrupt one is USB stick (da1) (where is mfsBSD live image resides), it's OK, it's always says on it, check my additions to my last post.
 
Hi. Two days ago I had exactly same problem, after power failure. The way I have sorted out.
1. Boot 10.1 from usb/DVD
2. Pick live system
3. mkdir /var/name_of_your_pool
4. zpool import -f -R /var/name_of_your_pool name_of_your_pool
5. zpool status
6. Even you have 0 errors type: zpool scrub name_of_your_pool
7. Every so often you can check % by zpool scrub.
8. It might tell you, no errors, it should work.

PS. You can connect drives to different PC. For ZFS it shouldn't make a difference.
 
Hi. Two days ago I had exactly same problem, after power failure. The way I have sorted out.
1. Boot 10.1 from usb/DVD
2. Pick live system
3. mkdir /var/name_of_your_pool
4. zpool import -f -R /var/name_of_your_pool name_of_your_pool
5. zpool status
6. Even you have 0 errors type: zpool scrub name_of_your_pool
7. Every so often you can check % by zpool scrub.
8. It might tell you, no errors, it should work.

PS. You can connect drives to different PC. For ZFS it shouldn't make a difference.
I don't recall the name of the pools.
 
Back
Top