102d1 [Solved] 3ware RAID - one unit INOPERABLE - The FreeBSD Forums
The FreeBSD Forums  

Go Back   The FreeBSD Forums > Base System > System Hardware
Reload this Page [Solved] 3ware RAID - one unit INOPERABLE
Register FAQ Calendar Search Today's Posts Mark Forums Read

System Hardware Internal storage, motherboards, PCI cards, stuff inside the case.

Reply
 
Thread Tools Display Modes
  #1  
Old November 12th, 2011, 18:51
dvl@'s Avatar
dvl@ dvl@ is offline
FreshPorts Guru
  
Join Date: Nov 2008
Location: Near Philadelphia PA, USA
Posts: 200
Thanks: 17
Thanked 12 Times in 10 Posts
Default 3ware RAID - one unit INOPERABLE
After a reboot (to upgrade the kernel), one of the spare HDD is inoperable...

Before I proceed with a fix, I wanted a second opinion. This is what I think I need to do:

Code:
# tw_cli maint deleteunit c0 u2
# tw_cli maint createunit c0 p0 rspare
Make sense?

The current state of the system is:

Code:
FreeBSD supernews.example.org 8.2-STABLE FreeBSD 8.2-STABLE #0: Fri Nov 11 20:08:41 UTC 2011     
dvl@supernews.example.org:/usr/obj/usr/src/sys/OPTI  amd64
Code:
# tw_cli info

Ctl   Model        (V)Ports  Drives   Units   NotOpt  RRate   VRate  BBU
------------------------------------------------------------------------
c0    9550SX-8LP   8         8        3       1       4       1      OK       

# tw_cli info c0

Unit  UnitType  Status         %RCmpl  %V/I/M  Stripe  Size(GB)  Cache  AVrfy
------------------------------------------------------------------------------
u0    RAID-10   OK             -       -       64K     195.548   ON     ON     
u1    SPARE     OK             -       -       -       69.2404   -      ON     
u2    RAID-10   INOPERABLE     -       -       64K     195.548   OFF    ON     

Port   Status           Unit   Size        Blocks        Serial
---------------------------------------------------------------
p0     OK               u2     69.25 GB    145226112     WD-WMAKE2379003     
p1     OK               u1     69.25 GB    145226112     WD-WMAKE2379069     
p2     OK               u0     69.25 GB    145226112     WD-WMAKE2379066     
p3     OK               u0     69.25 GB    145226112     WD-WMAKE2379012     
p4     OK               u0     69.25 GB    145226112     WD-WMAKE2379286     
p5     OK               u0     69.25 GB    145226112     WD-WMAKE2379019     
p6     OK               u0     69.25 GB    145226112     WD-WMAKE2394339     
p7     OK               u0     69.25 GB    145226112     WD-WMAKE2378696     

Name  OnlineState  BBUReady  Status    Volt     Temp     Hours  LastCapTest
---------------------------------------------------------------------------
bbu   On           Yes       OK        OK       OK       255    02-Sep-2010
__________________
--
Dan Langille
Last edited by dvl@; November 13th, 2011 at 14:20. Reason: proper formatting: http://forums.freebsd.org/showthread.php?t=8816 / no fonts.
Reply With Quote
  #2  
Old November 15th, 2011, 17:03
User23's Avatar
User23 User23 is offline
Member
  
Join Date: Nov 2008
Location: Germany near Berlin
Posts: 297
Thanks: 16
Thanked 28 Times in 28 Posts
Default
Quote:
Originally Posted by dvl@ View Post
Code:
Unit  UnitType  Status         %RCmpl  %V/I/M  Stripe  Size(GB)  Cache  AVrfy
------------------------------------------------------------------------------
u0    RAID-10   OK             -       -       64K     195.548   ON     ON     
u1    SPARE     OK             -       -       -       69.2404   -      ON     
u2    RAID-10   INOPERABLE     -       -       64K     195.548   OFF    ON
Hm, it looks like the u2 disk was used in a raid-10 configuration. strange if the u0 wasnt degraded.
I would check the disk itself before adding it again as spare disk.
Reply With Quote
  #3  
Old November 15th, 2011, 20:04
phoenix's Avatar
phoenix phoenix is offline
Moderator
  
Join Date: Nov 2008
Location: Kamloops, BC, Canada
Posts: 3,178
Thanks: 43
Thanked 713 Times in 586 Posts
Default
I've seen similar situations where a disk in a RAID array drops off the bus, the spare kicks in and rebuilds the array, and then the original disk comes back online. The RAID metadata on the disk says it's part of an array ... but the array it's part of is already complete, so the disk is shown as part of an inoperable/incomplete array. Happens quite a bit on our RAID5+spare setups, and is kind of annoying.

You just need to double-check that all disks in the u0 array are actually online and running correctly. If so, then just delete the u2 unit. And then re-add it as a spare or whatever.
__________________
Freddie

Help for FreeBSD: Handbook, FAQ, man pages, mailing lists.
Reply With Quote
  #4  
Old November 15th, 2011, 20:08
dvl@'s Avatar
dvl@ dvl@ is offline
FreshPorts Guru
  
Join Date: Nov 2008
Location: Near Philadelphia PA, USA
Posts: 200
Thanks: 17
Thanked 12 Times in 10 Posts
Default
Quote:
Originally Posted by phoenix View Post
You just need to double-check that all disks in the u0 array are actually online and running correctly.
How is that done?
__________________
--
Dan Langille
Reply With Quote
  #5  
Old November 15th, 2011, 22:34
phoenix's Avatar
phoenix phoenix is offline
Moderator
  
Join Date: Nov 2008
Location: Kamloops, BC, Canada
Posts: 3,178
Thanks: 43
Thanked 713 Times in 586 Posts
Default
Via the 3dm2 web-GUI it's easy enough, just click on the unit to get the overview, then click on each disk to get the smartctl output which shows its online and running. Not sure how to do it via the CLI, never had to use it much.
__________________
Freddie

Help for FreeBSD: Handbook, FAQ, man pages, mailing lists.
Reply With Quote
  #6  
Old November 15th, 2011, 22:38
phoenix's Avatar
phoenix phoenix is offline
Moderator
  
Join Date: Nov 2008
Location: Kamloops, BC, Canada
Posts: 3,178
Thanks: 43
Thanked 713 Times in 586 Posts
Default
Ah, your post above shows it, although you use slightly different syntax than I (tw_cli /c0 show). There are 6 drives listed as part of unit u0, all listed with status OK (ports p2 through p7).

If the RAID10 array is comprised of those 6 drives, then everything is kosher, and you can delete the "extra" u2.
__________________
Freddie

Help for FreeBSD: Handbook, FAQ, man pages, mailing lists.
Reply With Quote
  #7  
Old November 15th, 2011, 23:12
dvl@'s Avatar
dvl@ dvl@ is offline
FreshPorts Guru
  
Join Date: Nov 2008
Location: Near Philadelphia PA, USA
Posts: 200
Thanks: 17
Thanked 12 Times in 10 Posts
Default
Phoenix: Yes, indeed. The RAID10 array is composed of 6 drives.

Thanks y'all
__________________
--
Dan Langille
Reply With Quote
Reply

Tags
3ware raid-10 tw_cli

« Previous Thread | Next Thread »
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Using a different default unit for playback and recording llwang Multimedia 2 November 14th, 2011 17:49
[Solved] Freebsd 7.2 3ware hardware raid-5. partition lost vladget System Hardware 4 May 27th, 2010 18:11
HOWTO: Convert Dangerously Dedicated Disks to FreeBSD 8.0 with 3ware 9650SE RAID dgs Howtos & FAQs (Moderated) 3 April 20th, 2010 17:13
partition c doesn't cover the whole unit! freepaddler Installing & Upgrading 2 December 11th, 2009 07:57
freebsd and raid 3ware 9560se stasmus System Hardware 5 March 5th, 2009 08:37


All times are GMT +1. The time now is 08:36.

Contact Us - FreeBSD - Archive - Top

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2013, vBulletin Solutions, Inc.
The mark FreeBSD is a registered trademark of The FreeBSD Foundation and is used by The FreeBSD Project with the permission of The FreeBSD Foundation.
Web protection and acceleration provided by CloudFlare
0