Hello All!
I have a server FreeBSD 10.1-RELEASE with some zfs pools and datasets on it.
When I was removing 1.3 TB file in /pool1/iscsi/NID/blade-nid/blade01 system hangs after 20-30 minutes. There was no one error in console, but I was forced to reset server. After boot I waited ~40 minutes before system was able to mount zfs datasets. At that time HDD of pool1 was blinking. After that file has disappeared.
A week ago same problem was when I removing 100 GB file. I was forced to reset server too.
Now I fear to removing large file on that server.
Thanks for any help!
I have a server FreeBSD 10.1-RELEASE with some zfs pools and datasets on it.
$ zpool status
Code:
pool: pool1
state: ONLINE
scan: resilvered 420K in 0h0m with 0 errors on Fri Mar 27 14:58:21 2015
config:
NAME STATE READ WRITE CKSUM
pool1 ONLINE 0 0 0
raidz3-0 ONLINE 0 0 0
multipath/pd01 ONLINE 0 0 0
multipath/pd02 ONLINE 0 0 0
multipath/pd03 ONLINE 0 0 0
multipath/pd04 ONLINE 0 0 0
multipath/pd05 ONLINE 0 0 0
multipath/pd06 ONLINE 0 0 0
multipath/pd07 ONLINE 0 0 0
multipath/pd08 ONLINE 0 0 0
multipath/pd09 ONLINE 0 0 0
multipath/pd10 ONLINE 0 0 0
multipath/pd11 ONLINE 0 0 0
multipath/pd12 ONLINE 0 0 0
multipath/pd13 ONLINE 0 0 0
logs
mirror-1 ONLINE 0 0 0
diskid/DISK-CVWL435200Y1480QGNp1 ONLINE 0 0 0
diskid/DISK-CVWL4353000F480QGNp1 ONLINE 0 0 0
cache
diskid/DISK-CVWL435200Y1480QGNp4 ONLINE 0 0 0
diskid/DISK-CVWL4353000F480QGNp4 ONLINE 0 0 0
errors: No known data errors
.
.
.
$ zfs list
Code:
NAME USED AVAIL REFER MOUNTPOINT
pool1 28,7T 6,18T 45,7K /pool1
pool1/iscsi 15,1T 6,18T 45,7K /pool1/iscsi
pool1/iscsi/NID 13,8T 6,18T 48,8K /pool1/iscsi/NID
pool1/iscsi/NID/blade-nid 314G 6,18T 17,6G /pool1/iscsi/NID/blade-nid
pool1/iscsi/NID/blade-nid/blade01 76,8G 6,18T 117G /pool1/iscsi/NID/blade-nid/blade01
pool1/iscsi/NID/blade-nid/blade03 219G 6,18T 117G /pool1/iscsi/NID/blade-nid/blade03
pool1/iscsi/NID/vol01 3,51T 6,18T 3,51T /pool1/iscsi/NID/vol01
pool1/iscsi/NID/vol02 3,38T 6,18T 3,38T /pool1/iscsi/NID/vol02
pool1/iscsi/NID/vol03 3,08T 6,18T 3,08T /pool1/iscsi/NID/vol03
pool1/iscsi/NID/vol04 3,51T 6,18T 3,51T /pool1/iscsi/NID/vol04
pool1/iscsi/nid 1,32T 6,18T 45,7K /pool1/iscsi/nid
pool1/iscsi/nid/blade01 1,19T 6,18T 45,7K /pool1/iscsi/nid/blade01
pool1/iscsi/nid/blade01/boot 45,7K 6,18T 45,7K /pool1/iscsi/nid/blade01/boot
pool1/iscsi/nid/blade01/data 1,19T 6,18T 1,19T /pool1/iscsi/nid/blade01/data
pool1/iscsi/nid/blade02 56,1G 6,18T 45,7K /pool1/iscsi/nid/blade02
pool1/iscsi/nid/blade02/boot 56,1G 6,18T 56,1G /pool1/iscsi/nid/blade02/boot
pool1/iscsi/nid/blade03 84,8G 6,18T 45,7K /pool1/iscsi/nid/blade03
pool1/iscsi/nid/blade03/boot 84,8G 6,18T 84,8G /pool1/iscsi/nid/blade03/boot
pool1/iscsi/nid/subt 229K 6,18T 45,7K /pool1/iscsi/nid/subt
pool1/iscsi/nid/subt/vol01 45,7K 6,18T 45,7K /pool1/iscsi/nid/subt/vol01
pool1/iscsi/nid/subt/vol02 45,7K 6,18T 45,7K /pool1/iscsi/nid/subt/vol02
pool1/iscsi/nid/subt/vol03 45,7K 6,18T 45,7K /pool1/iscsi/nid/subt/vol03
pool1/iscsi/nid/subt/vol04 45,7K 6,18T 45,7K /pool1/iscsi/nid/subt/vol04
pool1/samba 13,6T 6,18T 45,7K /pool1/samba
pool1/samba/NMO 6,37T 643G 6,37T /pool1/samba/NMO
pool1/samba/Science 7,20T 823G 45,7K /pool1/samba/Science
pool1/samba/Science/ASR 2,06T 823G 2,02T /pool1/samba/Science/ASR
pool1/samba/Science/DB 5,14T 823G 45,7K /pool1/samba/Science/DB
pool1/samba/Science/DB/ASR 5,14T 823G 5,14T /pool1/samba/Science/DB/ASR
pool1/samba/Science/DB/SIV 45,7K 823G 45,7K /pool1/samba/Science/DB/SIV
pool1/samba/Science/SIV 45,7K 823G 45,7K /pool1/samba/Science/SIV
pool1/samba/testsmb 45,7K 6,18T 45,7K /pool1/samba/testsmb
.
.
.
$ zfs get all pool1/iscsi/NID/blade-nid/blade01
Code:
NAME PROPERTY VALUE SOURCE
pool1/iscsi/NID/blade-nid/blade01 type filesystem -
pool1/iscsi/NID/blade-nid/blade01 creation ВР ДЕЙ 11 15:57 2014 -
pool1/iscsi/NID/blade-nid/blade01 used 76,8G -
pool1/iscsi/NID/blade-nid/blade01 available 6,18T -
pool1/iscsi/NID/blade-nid/blade01 referenced 117G -
pool1/iscsi/NID/blade-nid/blade01 compressratio 1.00x -
pool1/iscsi/NID/blade-nid/blade01 mounted yes -
pool1/iscsi/NID/blade-nid/blade01 origin pool1/iscsi/NID/blade-nid/blade03@make-clones -
pool1/iscsi/NID/blade-nid/blade01 quota none default
pool1/iscsi/NID/blade-nid/blade01 reservation none default
pool1/iscsi/NID/blade-nid/blade01 recordsize 4K inherited from pool1/iscsi/NID
pool1/iscsi/NID/blade-nid/blade01 mountpoint /pool1/iscsi/NID/blade-nid/blade01 default
pool1/iscsi/NID/blade-nid/blade01 sharenfs off default
pool1/iscsi/NID/blade-nid/blade01 checksum on default
pool1/iscsi/NID/blade-nid/blade01 compression off default
pool1/iscsi/NID/blade-nid/blade01 atime off inherited from pool1
pool1/iscsi/NID/blade-nid/blade01 devices on default
pool1/iscsi/NID/blade-nid/blade01 exec on default
pool1/iscsi/NID/blade-nid/blade01 setuid on default
pool1/iscsi/NID/blade-nid/blade01 readonly off default
pool1/iscsi/NID/blade-nid/blade01 jailed off default
pool1/iscsi/NID/blade-nid/blade01 snapdir hidden default
pool1/iscsi/NID/blade-nid/blade01 aclmode discard default
pool1/iscsi/NID/blade-nid/blade01 aclinherit restricted default
pool1/iscsi/NID/blade-nid/blade01 canmount on default
pool1/iscsi/NID/blade-nid/blade01 xattr off temporary
pool1/iscsi/NID/blade-nid/blade01 copies 1 default
pool1/iscsi/NID/blade-nid/blade01 version 5 -
pool1/iscsi/NID/blade-nid/blade01 utf8only off -
pool1/iscsi/NID/blade-nid/blade01 normalization none -
pool1/iscsi/NID/blade-nid/blade01 casesensitivity sensitive -
pool1/iscsi/NID/blade-nid/blade01 vscan off default
pool1/iscsi/NID/blade-nid/blade01 nbmand off default
pool1/iscsi/NID/blade-nid/blade01 sharesmb off default
pool1/iscsi/NID/blade-nid/blade01 refquota none default
pool1/iscsi/NID/blade-nid/blade01 refreservation none default
pool1/iscsi/NID/blade-nid/blade01 primarycache all default
pool1/iscsi/NID/blade-nid/blade01 secondarycache all default
pool1/iscsi/NID/blade-nid/blade01 usedbysnapshots 0 -
pool1/iscsi/NID/blade-nid/blade01 usedbydataset 76,8G -
pool1/iscsi/NID/blade-nid/blade01 usedbychildren 0 -
pool1/iscsi/NID/blade-nid/blade01 usedbyrefreservation 0 -
pool1/iscsi/NID/blade-nid/blade01 logbias latency default
pool1/iscsi/NID/blade-nid/blade01 dedup off default
pool1/iscsi/NID/blade-nid/blade01 mlslabel -
pool1/iscsi/NID/blade-nid/blade01 sync standard default
pool1/iscsi/NID/blade-nid/blade01 refcompressratio 1.00x -
pool1/iscsi/NID/blade-nid/blade01 written 76,8G -
pool1/iscsi/NID/blade-nid/blade01 logicalused 66,3G -
pool1/iscsi/NID/blade-nid/blade01 logicalreferenced 101G -
pool1/iscsi/NID/blade-nid/blade01 volmode default default
pool1/iscsi/NID/blade-nid/blade01 filesystem_limit none default
pool1/iscsi/NID/blade-nid/blade01 snapshot_limit none default
pool1/iscsi/NID/blade-nid/blade01 filesystem_count none default
pool1/iscsi/NID/blade-nid/blade01 snapshot_count none default
pool1/iscsi/NID/blade-nid/blade01 redundant_metadata all default
When I was removing 1.3 TB file in /pool1/iscsi/NID/blade-nid/blade01 system hangs after 20-30 minutes. There was no one error in console, but I was forced to reset server. After boot I waited ~40 minutes before system was able to mount zfs datasets. At that time HDD of pool1 was blinking. After that file has disappeared.
A week ago same problem was when I removing 100 GB file. I was forced to reset server too.
Now I fear to removing large file on that server.
Thanks for any help!
Last edited by a moderator: