I am trying to track down if I have a problem. Basically, Bonnie results look good except for the "Per Char" benchmarks. If I do a single drive with UFS I am getting about 500kb per second, but with a ZFS 3 disk stripe I am only getting 135kb for sequential output. I have several systems running ZFS, all of them have the same issue. Hardware varies from Dell R200s with SAS6ir cards, and Dell R610s with H200s. All of them seem to max out at around 135kb per second. Other then those 2 tests, it outperforms our other hardware raids. These are not 4k drives, but I did test with everything aligned, made no difference. Tried with disk cache enabled/disabled, made no difference for this test. Does anyone have any idea why this is? Below is output from one server, this is 6 10k SAS drives in a raid 10 configuration.
Code:
Version 1.97 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
em02 24G 130 99 485372 95 312260 87 344 99 1070812 95 1319 24
Latency 106ms 5545us 149ms 61254us 407ms 159ms
Version 1.97 ------Sequential Create------ --------Random Create--------
em02 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 17896 96 +++++ +++ 19303 96 26814 96 +++++ +++ 21697 97
Latency 16973us 135us 181us 14612us 66us 142us