Solved Where is my space?

tarkhil

Member

Reaction score: 6
Messages: 48

Hello

Code:
# zpool list store-4-18
NAME         SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
store-4-18  65.5T  62.9T  2.60T        -         -    44%    96%  1.00x    ONLINE  -
# zfs list store-4-18
NAME         USED  AVAIL     REFER  MOUNTPOINT
store-4-18  45.7T   397G      140K  none

zfs get shows
Code:
store-4-18  used                  45.7T                  -
store-4-18  usedbychildren        45.7T                  -
store-4-18  logicalused           50.6T                  -

Why zfs is full while zpool shows 13 tb more allocated than used and still have some free space?

Well, store-4-18 is made of 4x18 Tb, so it should have 54 Tb total size, not 65; and, having 10% of space to be reserved, well, am I correct that I've used all REALLY available space?
 

mer

Aspiring Daemon

Reaction score: 402
Messages: 636

4x18 how? Mirrors, 2x2 then mirrored? All striped? Do you have any snapshots?
 
OP
tarkhil

tarkhil

Member

Reaction score: 6
Messages: 48

4x18 how? Mirrors, 2x2 then mirrored? All striped? Do you have any snapshots?
RAIDZ. I do have some snapshots, but they are not that big.

Code:
tarkhil@stor:~ % zpool status store-4-18
  pool: store-4-18
 state: ONLINE
  scan: scrub in progress since Mon Oct 18 03:42:01 2021
  7.72T scanned at 51.9M/s, 6.10T issued at 41.0M/s, 60.8T total
  0B repaired, 10.03% done, 16 days 04:20:45 to go
config:

  NAME                STATE     READ WRITE CKSUM
  store-4-18          ONLINE       0     0     0
    raidz1-0          ONLINE       0     0     0
      gpt/ZR52E1E9    ONLINE       0     0     0
      gpt/ZR528SGJ    ONLINE       0     0     0
      gpt/ZR525L4F    ONLINE       0     0     0
      gpt/ZR52BK53    ONLINE       0     0     0
  cache
    gpt/cache-4-18-0  ONLINE       0     0     0
    gpt/cache-4-18-1  ONLINE       0     0     0

errors: No known data errors

Code:
tarkhil@stor:~ % zfs list -S used -t snapshot -r store-4-18 | head
NAME                                                  USED  AVAIL     REFER  MOUNTPOINT
store-4-18/pg@daily-2021-10-17                       24.5G      -     3.74T  -
store-4-18/pg@daily-2021-10-15                       16.8G      -     3.69T  -
store-4-18/pg@daily-2021-10-19                       16.7G      -     3.78T  -
store-4-18/pg@daily-2021-10-13                       13.4G      -     3.65T  -
store-4-18/pg@daily-2021-10-18                       8.87G      -     3.75T  -
store-4-18/pg@hourly-2021-10-19-17                   8.03G      -     3.79T  -
store-4-18/pg@daily-2021-10-16                       7.95G      -     3.71T  -
store-4-18/pg@weekly-2021-41                         5.67G      -     3.71T  -
store-4-18/pg@daily-2021-10-14                       5.55G      -     3.67T  -
 

SirDice

Administrator
Staff member
Administrator
Moderator

Reaction score: 12,767
Messages: 39,377

Why zfs is full while zpool shows 13 tb more allocated than used and still have some free space?
Compression?

store-4-18 is made of 4x18 Tb, so it should have 54 Tb total size, not 65;
54 TB (4x18 TB RAID-Z) is about 49 TiB. Drive sizes are given in decimal (SI) prefixes (factors of 1000), computers tend to use binary prefixes (factors of 1024). The bigger the drives are the bigger this difference is going to be.
 
OP
tarkhil

tarkhil

Member

Reaction score: 6
Messages: 48

Compression?


54 TB (4x18 TB RAID-Z) is about 49 TiB. Drive sizes are given in decimal (SI) prefixes (factors of 1000), computers tend to use binary prefixes (factors of 1024). The bigger the drives are the bigger this difference is going to be.
Yes, that's all clear now.

  1. zpool status shows raw space, including parity
  2. 18 Tb is not 18 Terabytes
So, all my space is now ok (at least, I see where it is).
 

SirDice

Administrator
Staff member
Administrator
Moderator

Reaction score: 12,767
Messages: 39,377

18 Tb is not 18 Terabytes
Tb is Terrabits, lowercase b is typically used for bits, uppercase B is Bytes. Network speeds are typically given in bits per second (1 Gb/s for example), storage capacity is given in bytes (1 TB for example).
 
Top