Fatman vs ZFS – Who will win

I'm guessing you need more devices in /dev for
each drive (1sa, 1sb, etc). I just skimmed the
posts but I could be wrong.
The following .ko (one can load before "boot" though
at the loader prompt). in /boot/loader.conf should
create more devices if they are missing (myself and
another poster fixed problems that way)
geom_bsd.ko geom_label.ko geom_mbr.ko.
..........
Sorry that while posting I haven't a clue
whether that is 10 percent or 90 percent a
chance of helping.
 
Thanks Jb,

Could you please break it down it to simpler terms for a newb? I don't really understand what I need to do to fix the issue.
 
*IF* it fixes the issue (I don't know enough about
the current issue in your thread) you can (maybe)
in /boot/loader.conf
Code:
geom_mbr_load="YES"
geom_label_load="YES"
geom_bsd_load="YES"
and the devices will appear if they are missing.
(IF that is the cause of the current issue).
A shorter way, (I recall from another thread, I
could be mistaken in the syntax)
...
(escape to loader prompt > boot)
Code:
load /boot/loader/geom_bsd.ko
(or, load geom_bsd (or, with .ko also)
(and whichever of the above three works,
the same for the other two).
boot
Although I suspect only two of the three are needed.
AND, it may not be the issue. But it fixed things
here.
 
Thanks for the quick response. I don't mind trying it tonight however I'm concerned about applying something that I don't know much about.

I will do my due dilligence tonight and research what you've showed me before applying it. Is there a possibily that what you presented as a fix could screw my sata drives so that the data can no longer be read in OpenSolaris.

I'm almost tempted tonight to re-install OpenSolaris and pull off the important data that I didn't backup.
 
Thanks for the advice Jb but unfortunetly I still have the same problem.

Code:
ad4: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata2-master SATA300
ad6: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata3-master SATA300
ad8: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata4-master SATA300
ad10: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata5-master SATA300
ad12: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata6-master SATA300
GEOM: ad4: corrupt or invalid GPT detected.
GEOM: ad4: GPT rejected -- may not be recoverable.
ad14: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata7-master SATA300
GEOM: ad6: corrupt or invalid GPT detected.
GEOM: ad6: GPT rejected -- may not be recoverable.
SMP: AP CPU #1 Launched!
GEOM: ad8: corrupt or invalid GPT detected.
GEOM: ad8: GPT rejected -- may not be recoverable.
GEOM: ad10: corrupt or invalid GPT detected.
GEOM: ad10: GPT rejected -- may not be recoverable.
GEOM: ad12: corrupt or invalid GPT detected.
GEOM: ad12: GPT rejected -- may not be recoverable.
GEOM: ad14: corrupt or invalid GPT detected.
GEOM: ad14: GPT rejected -- may not be recoverable.
Root mount waiting for: usbus1 usbus0
uhub0: 10 ports with 10 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub1: 10 ports with 10 removable, self powered
Trying to mount root from zfs:zroot
bge0: link state changed to UP

mrnas# zdb -l /dev/ad4
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3

I think I'm stuck upgrading to the stable branch or wait until the next release. :(

I'll let you guys know what happens. Thanks again,

Fatman
 
I still think your issue is completely explained in the mailing list thread, you'll need to upgrade to get the patch to fix it.
 
Voltar,

I'm updating the stable version now using the info from:

http://www.freebsd.org/doc/handbook/makeworld.html

I've changed the standard-supfile to reflect the Stable branch and synching up with RELENG_8 src now.

Code:
#csup -L 2 /standard-supfile
#csup -L 2 /ports-supfile
Code:
#standard-supfile
*default host=cvsup11.FreeBSD.org
*default base=/var/db
*default prefix=/usr
*default release=cvs tag=RELENG_8
*default delete use-rel-suffix
*default compress
src-all

#ports-supfile
*default host=cvsup11.FreeBSD.org
*default base=/var/db
*default prefix=/usr
*default release=cvs tag=.
*default delete use-rel-suffix
*default compress
ports-all

Code:
refuse file: I'm sure there should be more but I don't have time to start searching.

src-games
doc/bn_*
doc/da_*
doc/de_*
doc/el_*
doc/es_*
doc/fr_*
doc/hu_*
doc/it_*
doc/ja_*
doc/mn_*
doc/nl_*
doc/no_*
doc/pl_*
doc/pt_*
doc/ru_*
doc/sr_*
doc/tr_*
doc/zh_*

This is going to take a while.. I'll let you know of the results afterwards.
 
Dam, too late. Will I run into problems if I start using portsnap from now on instead of csup?

I'm also stuck. I synched my source, make buildworld, builtkernel, installed kernel and now booted into single user mode.

However, I don't think I should be running mount -a -t ufs. Am I to replace ufs with zfs?

Code:
# adjkerntz -i
# mount -a -t ufs
# mergemaster -p
# cd /usr/src
# make installworld
# mergemaster
# reboot
 
Portsnap may complain that it didn't create the ports tree, and you'll have to fetch and extract a new tree. Shouldn't be an issue.

As for mounting, you might run # mount and see what is already mounted, your ZFS filesystems may already be there. If not, I'd try # zfs mount -a.
 
I figured another way around, the lazy way. I restarted and booted into the os as usual. I than used shutdown now which allowed me to than executed mergemaster -p. :)

Okay, i'm done. I'll need to go back and re-run mergemaster because I left them all for later because I'm dead tired.

Code:
FreeBSD mrnas.citywidenetworks.com 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Dec  4 23:15:45 EST 2009     root@mrnas.citywidenetworks.com:/usr/obj/usr/src/sys/GENERIC  amd64

Well, it worked.

ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version 13
ZFS storage pool version 13
Timecounters tick every 1.000 msec
The GEOM class LABEL is already loaded.
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 480Mbps High Speed USB v2.0
ad0: 38204MB <SAMSUNG SP0411N TW100-11> at ata0-master UDMA100
ugen0.1: <nVidia> at usbus0
uhub0: <nVidia OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <nVidia> at usbus1
uhub1: <nVidia EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
acd0: DVDROM <HL-DT-STDVD-ROM GDR8164B/0L06> at ata0-slave UDMA33
ad4: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata2-master SATA300
ad6: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata3-master SATA300
ad8: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata4-master SATA300
ad10: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata5-master SATA300
ad12: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata6-master SATA300
ad14: 953869MB <WDC WD10EADS-00L5B1 01.01A01> at ata7-master SATA300
SMP: AP CPU #1 Launched!
uhub0: 10 ports with 10 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub1: 10 ports with 10 removable, self powered
Trying to mount root from zfs:zroot
bge0: link state changed to UP

mrnas# zpool import
pool: zstorage
id: 7729955510381236292
state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
the '-f' flag.
see: http://www.sun.com/msg/ZFS-8000-EY
config:

zstorage ONLINE
raidz2 ONLINE
ad4 ONLINE
ad14 ONLINE
ad12 ONLINE
ad10 ONLINE
ad8 ONLINE
ad6 ONLINE

Hmm... This doesn't look good but I seem to be able to view my files and copy them.

mrnas# zpool import -f zstorage
Unsupported share protocol: 1.
Unsupported share protocol: 1.

Should I be concerned about losing my data? I noticed a couple of post online about it.

Anyhow, Thanks again Voltar for all your help. I really appreciate it.
 
Code:
mrnas# zpool import -f zstorage
Unsupported share protocol: 1.
Unsupported share protocol: 1.

I haven't seen that before, and a quick search did not turn much up.

Pure speculation here, but were you sharing the mounts directly via NFS/CIFS? That is the only thing that I could think of that may show an error like that.

Sorry I can't be more help on that one.
 
Ya, I assumed it was related to some sort of previous permission that were set in OpenSolaris. It seems to be working fine so far and I'm able to copy files (mp3s) off the server without problems.

Code:
mrnas# zpool status -v zstorage
  pool: zstorage
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        zstorage    ONLINE       0     0     0
          raidz2    ONLINE       0     0     0
            ad4     ONLINE       0     0     0
            ad14    ONLINE       0     0     0
            ad12    ONLINE       0     0     0
            ad10    ONLINE       0     0     0
            ad8     ONLINE       0     0     0
            ad6     ONLINE       0     0     0

errors: No known data errors
 
Dam,

I just noticed that I can't use freebsd-update with the stable release... :\

Code:
mrnas# freebsd-update fetch
Looking up update.FreeBSD.org mirrors... 3 mirrors found.
Fetching public key from update4.FreeBSD.org... failed.
Fetching public key from update5.FreeBSD.org... failed.
Fetching public key from update2.FreeBSD.org... failed.
No mirrors remaining, giving up.

Is there a low volume bug and security mailing-list that I can sign up for with the 8.0 Stable release? I'm also planning on installing samba so that my winblows clients can access it. Do you recommend any postings or wiki's.

I was thinking of installing it from ports and follow this link:
http://wiki.samba.org/index.php/Main_Page
 
You have to manually fetch the sources and recompile on STABLE, but it does hold advantages. You can customize your make flags in /etc/make.conf specific for your machine, which can yield performance increases; See make.conf(). Likewise, you can use /etc/src.conf to exclude parts of the OS that you don't need, see src.conf().

Mailing list for freebsd-security: http://lists.freebsd.org/mailman/listinfo/freebsd-security

Edit: freebsd-annouce might be of interest to you also: http://lists.freebsd.org/mailman/listinfo/freebsd-announce

I use net/samba33 on my fileserver with great results. I had to tweak a few samba settings and sysctl's to get the most out of my Gigabit link, and I can pull 600-800+ Mbps to my workstation from my fileserver.
 
Wow 800mbps+... That's great.

Thanks again for all the help and advice. I'll look into the customization of the make flags once samba is up and running. It will be interresting to see what's going to happen. I have 160 Gigs worth of junk (videos, mp3s, pictures, software) that I need to transfer over into my zpool from a laptop.

What's the best way to track the transfer rate/speed?
 
Voltar,

Why am I seeing so much disk space available to me in my zpool if i'm running 6 x 1TB HD with Raidz2? Shouldn't I lose almost half for parity? I remember seeing 3.5T in OpenSolaris.

Code:
mrnas# zpool list
NAME       SIZE   USED  AVAIL    CAP  HEALTH  ALTROOT
zroot     33.2G  3.39G  29.9G    10%  ONLINE  -
zstorage  5.44T   262G  5.18T     4%  ONLINE  -

mrnas# zpool status
  pool: zroot
 state: ONLINE
 scrub: none requested
config:

        NAME         STATE     READ WRITE CKSUM
        zroot        ONLINE       0     0     0
          gpt/disk0  ONLINE       0     0     0

errors: No known data errors

  pool: zstorage
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        zstorage    ONLINE       0     0     0
          raidz2    ONLINE       0     0     0
            ad4     ONLINE       0     0     0
            ad14    ONLINE       0     0     0
            ad12    ONLINE       0     0     0
            ad10    ONLINE       0     0     0
            ad8     ONLINE       0     0     0
            ad6     ONLINE       0     0     0

errors: No known data errors

mrnas# zdb -l /dev/ad4
--------------------------------------------
LABEL 0
--------------------------------------------
failed to unpack label 0
--------------------------------------------
LABEL 1
--------------------------------------------
failed to unpack label 1
--------------------------------------------
LABEL 2
--------------------------------------------
failed to unpack label 2
--------------------------------------------
LABEL 3
--------------------------------------------
failed to unpack label 3
 
I'm not sure how zpool displays sizes on (Open)Solaris, but on all my FreeBSD machines it shows the entire capacity of the pool, including parity.

This is from a FreeBSD system with 12x500 GB drives (3 vdevs of 4 drives in RAIDZ).
Code:
amnesiac# zpool list
NAME      SIZE   USED  AVAIL    CAP  HEALTH  ALTROOT
storage  5.44T  4.34T  1.10T    79%  ONLINE  -
amnesiac# zpool status
  pool: storage
 state: ONLINE
 scrub: none requested
config:

        NAME                     STATE     READ WRITE CKSUM
        storage                  ONLINE       0     0     0
          raidz1                 ONLINE       0     0     0
            label/storage_01_1   ONLINE       0     0     0
            label/storage_01_2   ONLINE       0     0     0
            label/storage_01_3   ONLINE       0     0     0
            label/storage_01_4   ONLINE       0     0     0
          raidz1                 ONLINE       0     0     0
            label/storage_02_1   ONLINE       0     0     0
            label/storage_02_2   ONLINE       0     0     0
            label/storage_02_3   ONLINE       0     0     0
            label/storage_02_4   ONLINE       0     0     0
          raidz1                 ONLINE       0     0     0
            label/storage_03_1   ONLINE       0     0     0
            label/storage_03_2   ONLINE       0     0     0
            label/storage_03_3   ONLINE       0     0     0
            label/storage_03_4   ONLINE       0     0     0

errors: No known data errors

And from an Ubuntu system that I've yet to reinstall (4x250 GB drives in RAIDZ).
Code:
admin@htpc:~$ sudo zpool list
NAME      SIZE   USED  AVAIL    CAP  HEALTH  ALTROOT
storage   928G   913G  15.0G    98%  ONLINE  -
admin@htpc:~$ sudo zpool status
  pool: storage
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        storage     ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            sda     ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0

errors: No known data errors
admin@htpc:~$ df -h | grep storage
storage/home          684G  683G  346M 100% /home
storage               346M   27K  346M   1% /storage

I only have ~4TB and ~690GB of space, respectively.


As for testing transfer speeds, there are so many different ways, ftp, smb, http, nc/pv, and I think there is something in the ports tree who's name slips my mind right now.
 
Back
Top