Hi there.
I have a machine (FreeBSD 8.1, 12GB of RAM, Intel i7 920, ZFS pool 14: raidz 6 x 2TB disks).
AHCI is enabled
One of the folder is exported using samba and mounted on Windows 7 clients connected by 100Mbit/s LAN
When saving from the application on the samba shared drive ; it takes between 35 and 55s to save the file. You see the save progress bar getting to 100% in about 2-3s then it sits at 100% for a long time.
During this time, the server is still idling at around 99%, with smbd/nmbd taking about 2% of CPU usage.
Now if the share points to a UFS partition, the time to save the file goes down to 23s and that's a constant time ; doesn't matter what you do, it always takes 23s.
Now, with the share pointing to the ZFS pool again, if I disable ZIL , then the saving time goes down to a constant 6s!
So obviously, ZIL is the culprit here: ZIL active = 55s, zil not active it's 6s (the file being saved is around 5MB)..
I've played with every single loader option I could find, tweaked the sysctl.conf version: it never gets any better quite the opposite.
Here is my loader.conf
Here is /etc/sysctl.conf
I thought I could try playing with the L2ARC options, but it didn't give me any write benefits (and I've just added it so i didn't expect much there)
So I added a 40GB Intel X25 SSD drive.
I also added AIO support to samba and added the following to smb.conf
Not much difference in the end.
I have been using ZFS for this file system for 18 months now. I do make daily snapshots, not sure if this would affect performance like that?
So what am I supposed to do now ?
Don't really feel like writing to the UFS boot disk for this share, and doing a backup to the zfs pool a few times a day, would be such a waste.
Any help would be greatly appreciated.
Merry Christmas to all !
I have a machine (FreeBSD 8.1, 12GB of RAM, Intel i7 920, ZFS pool 14: raidz 6 x 2TB disks).
AHCI is enabled
One of the folder is exported using samba and mounted on Windows 7 clients connected by 100Mbit/s LAN
When saving from the application on the samba shared drive ; it takes between 35 and 55s to save the file. You see the save progress bar getting to 100% in about 2-3s then it sits at 100% for a long time.
During this time, the server is still idling at around 99%, with smbd/nmbd taking about 2% of CPU usage.
Now if the share points to a UFS partition, the time to save the file goes down to 23s and that's a constant time ; doesn't matter what you do, it always takes 23s.
Now, with the share pointing to the ZFS pool again, if I disable ZIL , then the saving time goes down to a constant 6s!
So obviously, ZIL is the culprit here: ZIL active = 55s, zil not active it's 6s (the file being saved is around 5MB)..
I've played with every single loader option I could find, tweaked the sysctl.conf version: it never gets any better quite the opposite.
Here is my loader.conf
Code:
nvidia_load="YES"
hw.ata.to=15
vboxdrv_load="YES"
aio_load="YES"
ahci_load="YES"
# ZFS tuning
kern.maxvnodes=800000
vm.kmem_size_max="4096M"
vfs.zfs.arc_max="1024M"
vfs.zfs.vdev.min_pending=4
vfs.zfs.vdev.max_pending=12
vfs.zfs.cache_flush_disable=1
#vfs.zfs.zil_disable="1"
Here is /etc/sysctl.conf
Code:
vfs.read_max=64
I thought I could try playing with the L2ARC options, but it didn't give me any write benefits (and I've just added it so i didn't expect much there)
So I added a 40GB Intel X25 SSD drive.
Code:
[root@server4 /pool/data/shares/elec/.zfs/snapshot]# zpool status
pool: pool
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
pool ONLINE 0 0 0
raidz1 ONLINE 0 0 0
ada2 ONLINE 0 0 0
ada3 ONLINE 0 0 0
ada4 ONLINE 0 0 0
ada5 ONLINE 0 0 0
ada6 ONLINE 0 0 0
ada7 ONLINE 0 0 0
cache
ada1 ONLINE 0 0 0
errors: No known data errors
I also added AIO support to samba and added the following to smb.conf
Code:
aio write size = 16384
aio read size = 16384
write cache size = 262144
Not much difference in the end.
I have been using ZFS for this file system for 18 months now. I do make daily snapshots, not sure if this would affect performance like that?
So what am I supposed to do now ?
Don't really feel like writing to the UFS boot disk for this share, and doing a backup to the zfs pool a few times a day, would be such a waste.
Any help would be greatly appreciated.
Merry Christmas to all !