ZFS CAM Status error + pool lost

S

Stauf

Hi,

I have a big problem with my NAS.
The first issue was a Degraded pool (2 disks in Raid1-ZFS), with one disk REMOVED. I tried to put it back online but it was impossible.
OK, I don't tell the whole story since that moment (several tries+ I lost the other disk stupidly...). Nevermind.

All I'd like now is to know if I have a chance to get back the data. Here is the current situation:

System Information
Hostname freenas.local
Build FreeNAS-9.1.1-RELEASE-x86 (a752d35)
Platform AMD Sempron(tm) Processor LE-1250
Memory 1903MB

Initially, two disks 2 TB in RAID1
ZFS File system (I know, I'd have needed more memory)
OS on USB stick


Behavior at boot:
OS starts. No anomaly except:
a CAM error, like:
Code: 
(aprobe0:ahcich1:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich1:0:15:0): CAM status: Command timeout
(aprobe0:ahcich1:0:15:0): Error 5, Retries exhausted
Then, the last thing I can see are:

Behavior at boot
Code: 
savecore: reboot after panic: page fault
savecore: no dump, not enough free space on device (19410 available, 24600 needed)
savecore: unsaved dumps found but not saved
No crash dumps in /data/crash.
No suitable dump device was found.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
GEOM_ELI: Device ada0p1.eli created.
GEOM_ELI: Encryption: AEES-XTS 256
GEOM_ELI: Crypto: Software
Starting file system checks:
/dev/ufs/FreeNASs1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ufs/FreeNASs1a: clean, 751410 free (2050 frags, 93670 blocks, 0.1% fragmentation)
/dev/ufs/FreeNASs3: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ufs/FreeNASs3: clean, 2829 free (21 frags, 351 blocks, 0.7% fragmentation)
/dev/ufs/FreeNASs4; FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ufs/FreeNASs4: clean, 38821 free (45 frags, 4847 blocks, 0.1% fragmentation)
Mounting local file systems:.
Then, the system freezes.

Behavior at boot, disk being disconnected
I've then tried to boot without any disk, then plug it when the OS is ready.
Here is the a part dmesg output
dmesg(1)
Code: 
ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
...
atapci0: <ATI IXP700/800 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
...
Timecounter "TSC-low" frequency 1100065815 Hz quality 800
Root mount waiting for: usbus2
Root mount waiting for: usbus2
ugen2.2: <SanDisk> at usbus2
umass0: <SanDisk SDDR-113, class 0/0, rev 2.00/94.12, addr 2> on usbus2
Trying to mount root from ufs:/dev/ufs/FreeNASs1a [ro]...
mountroot: waiting for device /dev/ufs/FreeNASs1a ...
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <SanDisk SDDR-113 9412> Removable Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: 3886MB (7959552 512 byte sectors: 255H 63S/T 495C)
da0: quirks=0x2<NO_6_BYTE>
WARNING: /data was not properly dismounted
ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable,
add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)
(aprobe0:ahcich1:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich1:0:15:0): CAM status: Command timeout
(aprobe0:ahcich1:0:15:0): Error 5, Retries exhausted
ada0 at ahcich1 bus 0 scbus1 target 0 lun 0
ada0: <SAMSUNG HD203WI 1AN10002> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
...
atapci0: <ATI IXP700/800 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
...
ada0 at ahcich1 bus 0 scbus1 target 0 lun 0
ada0: <SAMSUNG HD203WI 1AN10002> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
Timecounter "TSC-low" frequency 1100064232 Hz quality 800
Root mount waiting for: usbus2
Root mount waiting for: usbus2
ugen2.2: <SanDisk> at usbus2
umass0: <SanDisk SDDR-113, class 0/0, rev 2.00/94.12, addr 2> on usbus2
Trying to mount root from ufs:/dev/ufs/FreeNASs1a [ro]...
mountroot: waiting for device /dev/ufs/FreeNASs1a ...
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <SanDisk SDDR-113 9412> Removable Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: 3886MB (7959552 512 byte sectors: 255H 63S/T 495C)
da0: quirks=0x2<NO_6_BYTE>
ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable,
add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)
GEOM_ELI: Device ada0p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI: Crypto: software
...
Timecounter "TSC-low" frequency 1100064088 Hz quality 800
Root mount waiting for: usbus2
Root mount waiting for: usbus2
ugen2.2: <SanDisk> at usbus2
umass0: <SanDisk SDDR-113, class 0/0, rev 2.00/94.12, addr 2> on usbus2
Trying to mount root from ufs:/dev/ufs/FreeNASs1a [ro]...
mountroot: waiting for device /dev/ufs/FreeNASs1a ...
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <SanDisk SDDR-113 9412> Removable Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: 3886MB (7959552 512 byte sectors: 255H 63S/T 495C)
da0: quirks=0x2<NO_6_BYTE>
WARNING: /data was not properly dismounted
ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable,
add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)

Then, I plug the disk and get:
Code: 
(aprobe0:ahcich1:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich1:0:15:0): CAM status: Command timeout
(aprobe0:ahcich1:0:15:0): Error 5, Retries exhausted
ada0 at ahcich1 bus 0 scbus1 target 0 lun 0
ada0: <SAMSUNG HD203WI 1AN10002> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
 
Then:


On the WedGUI, I can see:

Code: 
- The volume:
Name  SafeData
Used  0 (Error)
Available  Error getting available space
Size  Error getting total space
Status       UNKNOWN

- The disk:
Name  ada0

Serial  S1UYJ1BZ103550
Description
Transfer Mode  Auto
HDD Standby  Always On
Advanced Power Management  Disabled
Acoustic Level  Disabled
Enable S.M.A.R.T.  true
S.M.A.R.T. extra options

When I try to change permissions on the mountpoint, I get:
Code: 
Request Method: GET
Request URL: [URL]https://192.168.0.18:4443/storage/mountpoint/permission/mnt/SafeData/[/URL]
Software Version: FreeNAS-9.1.1-RELEASE-x86 (a752d35)
Exception Type: OSError

Exception Value:
Invalid mountpoint mnt/SafeData
Exception Location: /usr/local/www/freenasUI/../freenasUI/middleware/notifier.py in mp_get_owner, line 2270
Server time: Fri, 31 Jul 2015 12:39:38 +0200
Traceback

Environment:
Software Version: FreeNAS-9.1.1-RELEASE-x86 (a752d35)
Request Method: GET
Request URL: [URL]https://192.168.0.18:4443/storage/mountpoint/permission/mnt/SafeData/[/URL]
Traceback: File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py" in get_response 109. response = middleware_method(request, callback, callback_args, callback_kwargs)

File "/usr/local/www/freenasUI/../freenasUI/freeadmin/middleware.py" in process_view 165. return login_required(view_func)(request, *view_args, **view_kwargs)

File "/usr/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py" in _wrapped_view 25. return view_func(request, *args, **kwargs)

File "/usr/local/www/freenasUI/../freenasUI/storage/views.py" in mp_permission 489. form = forms.MountPointAccessForm(initial={'path': path})

File "/usr/local/www/freenasUI/../freenasUI/storage/forms.py" in __init__ 1397. user, group = notifier().mp_get_owner(path)

File "/usr/local/www/freenasUI/../freenasUI/middleware/notifier.py" in mp_get_owner 2270. raise OSError('Invalid mountpoint %s' % (path, ))


Exception Type: OSError at /storage/mountpoint/permission/mnt/SafeData/

Exception Value: Invalid mountpoint mnt/SafeData


Request information

GET
No GET data


POST
No POST data


FILES
No FILES data



Operations on shell:


Code: 
#Zpool status

No pools available


#Zpool import -a

<system freezes>





I've also tried to mount the disk on another computer with Ubuntu 14.04

- I've performed SMART test : All is Clean

Results of commands:
Code: 
root@xx# zpool list

no pools available


root@xx# zpool status

no pools available


root@xx# zpool import -a

cannot import 'SafeData': pool may be in use from other system, it was last accessed by freenas.local (hostid: 0xcb2e3d52) on Wed Jul 29 10:32:48 2015

use '-f' to import anyway


root@xx# zpool import -af

<system freezes>



Here it is. Please help!!
I've no backup of the data and really need them.

Thanks in advance
 
You must log in or register to reply here.
Back
Top