• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

ZFS 2 drives appearing as same zpool problem

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#1
I have a usb expansion card.

I think the speed only appears when I copy between 2 external 4t usb3 drives.

Why would the speed be slow from usb3 attached 4t drive to local disk?

How do I check it is running in usb3 MODE?

I have a sneeking suspicion that 1 of the 2 ports is bad on the expansion care.

11.1 amd64 on 965 amd 6 core w 16g ram with ufs on 2 internal 500g drives, one mounted as /a
2x 4t usb3 drive zfs

I saw some stuff about xhci? in another thread......will get in front of the rig once I am off work and pop back in here to try any suggestions or read docs pointed to.

thx all
 

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#3
Code:
# usbconfig
ugen5.1: <ATI OHCI root HUB> at usbus5, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen6.1: <ATI EHCI root HUB> at usbus6, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen4.1: <ATI OHCI root HUB> at usbus4, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen2.1: <ATI OHCI root HUB> at usbus2, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen0.1: <0x1b6f XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen3.1: <ATI EHCI root HUB> at usbus3, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen1.1: <ATI OHCI root HUB> at usbus1, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen7.1: <ATI OHCI root HUB> at usbus7, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen0.2: <Western Digital My Book 1230> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON (26mA)
ugen3.2: <vendor 0x1a40 USB 2.0 Hub> at usbus3, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (100mA)
ugen3.3: <CHICONY USB NetVista Full Width Keyboard> at usbus3, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen3.4: <Logitech USB Optical Mouse> at usbus3, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (98mA)
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#4
USB2 speed!! 480MB not 5GB!!

It's an USB3 expansion card!!
Something is wrong!

PS the cable is USB 3 compatible

from dmesg:
Code:
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xff600000-0xff607fff irq 16 at device 0.0 on pci2
xhci0: 64 bytes context size, 64-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib3: <ACPI PCI-PCI bridge> irq 17 at device 5.0 on pci0
pci3: <ACPI PCI bus> on pcib3

usbd_setup_device_desc: getting device descriptor at addr 1 failed, USB_ERR_TIMEOUT
usbd_setup_device_desc: getting device descriptor at addr 1 failed, USB_ERR_TIMEOUT
ugen0.2: <Unknown > at usbus0 (disconnected)
uhub_reattach_port: could not allocate new device
ugen0.2: <Western Digital My Book 1230> at usbus0
umass0 on uhub1
umass0: <Western Digital My Book 1230, class 0/0, rev 2.10/10.65, addr 1> on usbus0
umass0:  SCSI over Bulk-Only; quirks = 0x8000
umass0:7:0: Attached to scbus7
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <WD My Book 1230 1065> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number 57584C314836343335333353
da0: 40.000MB/s transfers
da0: 5723134MB (1465122304 4096 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#5
Code:
root@kyfho:~ # dmesg|grep usbus0
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ugen0.1: <0x1b6f XHCI root HUB> at usbus0
uhub1: <0x1b6f XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen0.2: <Unknown > at usbus0 (disconnected)
ugen0.2: <Western Digital My Book 1230> at usbus0
umass0: <Western Digital My Book 1230, class 0/0, rev 2.10/10.65, addr 1> on usbus0
ugen0.3: <Unknown > at usbus0 (disconnected)
ugen0.3: <Seagate Backup+  Desk> at usbus0
umass1: <Seagate Backup+  Desk, class 0/0, rev 2.10/1.00, addr 2> on usbus0
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#6
Code:
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <WD My Book 1230 1065> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number 57584C314836343335333353
da0: 40.000MB/s transfers
da0: 5723134MB (1465122304 4096 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
da1 at umass-sim1 bus 1 scbus8 target 0 lun 0
da1: <Seagate Backup+  Desk 0406> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number NA7EFVW5
da1: 40.000MB/s transfers
da1: 4769307MB (1220942645 4096 byte sectors)
da1: quirks=0x2<NO_6_BYTE>
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#7
I really don't know whats going on here.....
Code:
root@kyfho:~ # uname -a
FreeBSD kyfho 11.1-RELEASE-p1 FreeBSD 11.1-RELEASE-p1 #0: Wed Aug  9 11:55:48 UTC 2017     [email]root@amd64-builder.daemonology.net[/email]:/usr/obj/usr/src/sys/GENERIC  amd64
root@kyfho:~ # zpool status
  pool: vance
 state: ONLINE
  scan: resilvered 360K in 0h0m with 0 errors on Thu Jun  8 03:02:44 2017
config:

        NAME        STATE     READ WRITE CKSUM
        vance       ONLINE       0     0     0
          da0       ONLINE       0     0     0

errors: No known data errors

  pool: vogt
 state: ONLINE
  scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        vogt        ONLINE       0     0     0
          da1       ONLINE       0     0     0

errors: No known data errors
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#8
Code:
root@kyfho:~ # dmesg | grep xhci
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xff600000-0xff607fff irq 16 at device 0.0 on pci2
xhci0: 64 bytes context size, 64-bit DMA
usbus0 on xhci0
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#10
I added a Seagate, also ZFS, to the second USB3 slot on the expansion USB3 card
Code:
root@kyfho:~ # usbconfig
ugen5.1: <ATI OHCI root HUB> at usbus5, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen6.1: <ATI EHCI root HUB> at usbus6, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen4.1: <ATI OHCI root HUB> at usbus4, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen2.1: <ATI OHCI root HUB> at usbus2, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen0.1: <0x1b6f XHCI root HUB> at usbus0, cfg=0 md=HOST spd=SUPER (5.0Gbps) pwr=SAVE (0mA)
ugen3.1: <ATI EHCI root HUB> at usbus3, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)
ugen1.1: <ATI OHCI root HUB> at usbus1, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen7.1: <ATI OHCI root HUB> at usbus7, cfg=0 md=HOST spd=FULL (12Mbps) pwr=SAVE (0mA)
ugen3.2: <vendor 0x1a40 USB 2.0 Hub> at usbus3, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (100mA)
ugen3.3: <CHICONY USB NetVista Full Width Keyboard> at usbus3, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (100mA)
ugen3.4: <Logitech USB Optical Mouse> at usbus3, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON (98mA)
ugen0.2: <Western Digital My Book 1230> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON (26mA)
ugen0.3: <Seagate Backup+  Desk> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON (0mA)
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#11
The second device caused the first to become unmounted. I removed it. Now first device scanning itself.
I think something happened where da0 and 1 switched and confused ZFS.
faaak
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#12
Now I seem to have lost all pools
faaaak

I closed the terminal when it was scrubbing vogt

unplugged everything

now trying zpool import vance

nothing

no pools seen

now trying plug everything back in
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#13
Code:
root@kyfho:~ # zpool import vogt
cannot import 'vogt': more than one matching pool
import by numeric ID instead
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#14
Unplugged vance Western Digital drive and was able to import vogt
Somehow it thinks vance is vogt
Some kinda kind of ZFS confusion.
funky!

abubis! I thought I had lost all files on both
Code:
root@kyfho:~ # zpool import vogt
root@kyfho:~ # df -h
Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ada0p2    447G    153G    258G    37%    /
devfs          1.0K    1.0K      0B   100%    /dev
/dev/ada1p1    451G     16K    415G     0%    /a
vogt           4.4T    3.3T    1.1T    75%    /vogt
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#15
Code:
root@kyfho:~ # zpool status -v
  pool: vogt
 state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: [URL]http://illumos.org/msg/ZFS-8000-8A[/URL]
  scan: scrub in progress since Tue Sep 12 00:21:02 2017
        11.7G scanned out of 4.32T at 29.9M/s, 42h2m to go
        0 repaired, 0.26% done
config:

        NAME        STATE     READ WRITE CKSUM
        vogt        ONLINE       0     0     0
          da0       ONLINE       0     0     0

errors: Permanent errors have been detected in the following files:

        vogt:<0x0>
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#16
OK, I got vogt to mount, it seems that both drives appear as pool vogt now.

vance is just a memory

Now when I zpool export vogt, and unplug the Seagate, I can then zpool import vogt and what was vance is now mounted as /vogt.

Maybe because I closed the zpool export vogt terminal by accident?

funky!

The post before this shows some kinda kind of checker thing but it's running slow.
 
Last edited by a moderator:

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#17
https://forums.freebsd.org/threads/62452/

Ok so
/ mount "journaled softupdates"
is this superior to my 3rd usb external drive, connected to usb2 port, mounted as /cook, which was newfs -U for just soft updates?

Should I use tunefs to add journalling?
/ was created by default install of 11.0 amd64.

gjournal says journal+async mount > soft update. Is this the case? and if so why is / journaled+softudate?

https://forums.freebsd.org/threads/62240/ This is my thead where I have 2 port usb3 card and 2 usb external drives, and something happened where I was in middle of zpool export and the system thinks both pool are vogt, when one is vance.
I was able to eventually zpool import vogt of 1 of the 2 drives by unpluggin the other.
i am now moving important files to a 3rd drive as I said above plugged into usb2 port and that drive is ufs with soft updates (newfs -U as handbook says in example)

Once the important files are copied over tonight I might try and recover the vance pool on the 2nd drive, but first I need a strong back up because at one point zpool status was showing nothing until I just brute force tried zpool import vogt. It said 2 drives appear as vogt. I then did zpool export vogt and unplugged one of the drives.

I wonder if the usb3 external card is not seated correctly as so is acting flaky? I might open the box and reseat the card.
The usb external drive speed is another thing.
I wonder if I should move 62240 thread to storage?
How do I move a thread?
 

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#18
There is a scrub running on vogt. It says take 224 hours. It's working at 1MB/s or something. Should I stop that scrub?
 

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#19
I think the usb3 addon card is flakey?
It also didn't give usb3 speed.
I wonder if the usb external drives are just slow? some of the dmesg shows 40MB/s
Right now I have da0 running as vogt, and I think it was originally vance pool.
I am moving files to drive da2 which is ufs +soft update (newfs -U)
da1 is plugged in but not active.
Once essential files are copied. I might try to recover da1. da1 was the original vogt and da0 was vance.
When this first happened, zpool status showed nothing.
After reboot and unplugging da1, but before pluggin in da2, zpool status said 2 drives appear as vogt.
I unplugged da1.
I did zpool import vogt and it mounted vance as vogt.
I then replugged into da1.
zpool status I think at that point still said 2 drives appear as vogt.
I then pluggin in da2, formatted it with newfs -U and stated rsync backup.
Its copying at about 31MB/s
I think the addon usb3 card with 2 ports if flakey...or something.
I want to use zfs but this is scary.
I don't want to lose all my files.
 

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#21
https://forums.freebsd.org/threads/62240/

I think one of the drives lost connection due to a addon usb3 card.

Both are external usb drives.

ZFS somehow thinks both are pool vogt.

The original da0, now mounted as vogt, was vance. I had to unplug da1 to get the other drive da0 to "mount" with zpool import vogt.
before that zpool status showed neither vogt nor vance...

There is a scrub underway I want to cancel, 224 hours to finish it says.

I am backing up "vogt" files to ufs da2 drive today and will try to sort this out tonight after work.
 

SirDice

Administrator
Staff member
Administrator
Moderator

Thanks: 5,508
Messages: 25,692

#22
How do I move this thread to storage?
You don't. You ask a mod or admin to do it for you.

And please start formatting your posts.
 

azathoth

Well-Known Member

Thanks: 13
Messages: 373

#23
Thank you for the response.
I humbly request that this post be moved to storage.
How would you like me to format future posts?
 

SirDice

Administrator
Staff member
Administrator
Moderator

Thanks: 5,508
Messages: 25,692

#24