Code:
[B][U]HW[/U][/B]
CHA: HP DL180 G6
CPU: Xeon E5620 @ 2.40GHz
RAM: 32GB DDR3 REG ECC
HBA: LSI 9211 (PH13 FW)
HDD: HP(WD) MB2000EAZNL
Code:
[B][U]SW[/U][/B]
[CMD="#"]uname -a[/CMD]
FreeBSD hostname 9.0-RELEASE FreeBSD 9.0-RELEASE #0: Tue Jan 3 07:46:30 UTC 2012 root@farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
[CMD="#"]kldstat[/CMD]
Id Refs Address Size Name
1 19 0xffffffff80200000 11cd9b0 kernel
2 1 0xffffffff813ce000 203d70 zfs.ko
3 2 0xffffffff815d2000 5c50 opensolaris.ko
4 1 0xffffffff81812000 51b3 tmpfs.ko
5 1 0xffffffff81818000 ce78 geom_eli.ko
6 2 0xffffffff81825000 1b11e crypto.ko
7 1 0xffffffff81841000 a4d9 zlib.ko
8 1 0xffffffff8184c000 1a3f aesni.ko
Code:
[B][U]PART[/U][/B]
[CMD="#"]gpart create -s gpt da(0,1,2,3,4)[/CMD]
[CMD="#"]gpart add -t freebsd-zfs -l disk(1,2,3,4,5) -b 2048 -a 4k da(0,1,2,3,4)[/CMD]
Code:
[B][U]GELI[/U][/B]
[CMD="#"]dd if=/dev/random of=/boot/geli/disks.key bs=64 count=1[/CMD]
[CMD="#"]geli init -s 4096 -K /boot/geli/disks.key -P -l (128,192,256) -e (AES-XTS,AES-CBC,Blowfish-CBC,Camellia-CBC,3DES-CBC) /dev/gpt/disk(1,2,3,4,5)[/CMD]
[CMD="#"]geli attach -p -k /boot/geli/disks.key /dev/gpt/disk(1,2,3,4,5)[/CMD]
Code:
[B][U]MO[/U][/B]
[CMD="#"]mdmfs -s 2048m md0 /mnt/ram[/CMD]
[CMD="#"]umount /mnt/ram[/CMD]
(Because I don´t know the [FILE]mdconfig[/FILE]-syntax to do the same thing)
[CMD="#"]dd if=/dev/random of=/dev/md0 bs=1024000 count=2048[/CMD]
[CMD="#"]dd if=/dev/md0 of=/dev/gpt/disk(1,2,3,4,5).eli bs=1024000 count=2048[/CMD]
[CMD="#"]dd if=/dev/md0 of=/dev/gpt/disk(1,2,3,4,5).eli bs=1024000 count=2048[/CMD]
[CMD="#"]dd if=/dev/md0 of=/dev/gpt/disk(1,2,3,4,5).eli bs=1024000 count=2048[/CMD]
Code:
[B][U]GELI SCORE[/U][/B]
[B]Bit MB/s[/B]
Raw 146
AES-XTS 128 70,5
AES-CBC 128 [B]114,4[/B] (65,5 without aesni.ko loaded)
Blowfish-CBC 128 27,8
Camellia-CBC 128 43,0
3DES-CBC 192 14,6
AES-XTS 256 67,7
AES-CBC 256 [B]106,5[/B]
Blowfish-CBC 256 27,8
Camellia-CBC 256 37,6
Proceeding by choosing the fastest GELI option (AES-CBC 128bit) and testing the performance of a filesystem on top of that.
Code:
[B][U]ZFS/GELI MO:[/U][/B]
[CMD="#"]zpool create -O mountpoint=legacy -O compress=on tank mirror gpt/disk{1.eli,2.eli} mirror gpt/disk{3.eli,4.eli}
mirror gpt/disk{5.eli,6.eli} mirror gpt/disk{7.eli,8.eli}[/CMD]
[CMD="#"]mount -t zfs tank /mnt/tank/[/CMD]
[CMD="#"]bonnie++ -d /mnt/tank/ -u 0 -s 64g[/CMD]
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hostname 64G 138 99 383394 69 292000 63 337 98 891332 82 506.4 28
Latency 399ms 5960ms 8642ms 168ms 31746us 182ms
Version 1.96 ------Sequential Create------ --------Random Create--------
hostname -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 24120 95 +++++ +++ 22920 96 21911 94 +++++ +++ 24014 97
Latency 13852us 139us 2164us 14589us 92us 174us
1.96,1.96,hostname,1,1334621912,64G,,138,99,383394,69,292000,63,337,98,891332,82,506.4,28,1
6,,,,,24120,95,+++++,+++,22920,96,21911,94,+++++,+++,24014,97,399ms,5960ms,8642ms,168ms,317
46us,182ms,13852us,139us,2164us,14589us,92us,174us
[CMD="#"]zpool create -O mountpoint=legacy -O compress=on tank raidz2 gpt/disk{1.eli,2.eli,3.eli,4.eli} raidz2 gpt/disk{5.eli,6.eli,7.eli,8.eli}[/CMD]
[CMD="#"]mount -t zfs tank /mnt/tank/[/CMD]
[CMD="#"]bonnie++ -d /mnt/tank/ -u 0 -s 64g[/CMD]
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hostname 64G 135 99 407474 74 297102 65 334 99 797934 72 372.7 7
Latency 77224us 1074ms 2944ms 79237us 62840us 305ms
Version 1.96 ------Sequential Create------ --------Random Create--------
hostname -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 24776 98 +++++ +++ 23919 97 24210 95 15289 99 4257 98
Latency 13907us 140us 169us 17596us 324us 7133us
1.96,1.96,hostname,1,1334627599,64G,,135,99,407474,74,297102,65,334,99,797934,72,372.7,7,16
,,,,,24776,98,+++++,+++,23919,97,24210,95,15289,99,4257,98,77224us,1074ms,2944ms,79237us,62
840us,305ms,13907us,140us,169us,17596us,324us,7133us
[CMD="#"]zpool create -O mountpoint=legacy -O compress=on tank raidz2 gpt/disk{1.eli,2.eli,3.eli,4.eli,5.eli,6.eli,7.eli,8.eli}[/CMD]
[CMD="#"]mount -t zfs tank /mnt/tank/[/CMD]
[CMD="#"]bonnie++ -d /mnt/tank/ -u 0 -s 64g[/CMD]
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hostname 64G 136 99 426207 76 296597 65 331 98 784113 71 313.5 19
Latency 64337us 493ms 2187ms 94173us 53133us 286ms
Version 1.96 ------Sequential Create------ --------Random Create--------
hostname -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 23478 93 +++++ +++ 24146 97 22300 97 +++++ +++ 23719 97
Latency 14004us 139us 171us 29080us 142us 170us
1.96,1.96,hostname,1,1334624351,64G,,136,99,426207,76,296597,65,331,98,784113,71,313.5,19,1
6,,,,,23478,93,+++++,+++,24146,97,22300,97,+++++,+++,23719,97,64337us,493ms,2187ms,94173us,
53133us,286ms,14004us,139us,171us,29080us,142us,170us
Code:
[B][U]ZFS/GELI SCORE[/U][/B]
[B]Write Rewrite Read[/B] (MB/s)
4xmirror 374 285 870
2xraidz2 397 290 779
1xraidz2 416 289 765
/Sebulon