Crest said:zfs->io means that nginx is waiting for reads or writes on ZFS. You could try to reduce the number of concurrent "random" disk accesses.
einthusan said:Do you think this is because of nginx settings or zfs sysctl settings? Nginx and ZFS seem to be fine until after 1-2 days, then even with low I/O load, nginx goes into this state often.