Document fins/I0786-1
FIN #: I0786-1
SYNOPSIS: 'hot_add' of an A1000/A3x00/A3500FC array may need to be followed by
a reconfiguration reboot on Solaris 8
DATE: Jun/26/02
KEYWORDS: 'hot_add' of an A1000/A3x00/A3500FC array may need to be followed by
a reconfiguration reboot on Solaris 8
---------------------------------------------------------------------
- Sun Proprietary/Confidential: Internal Use Only -
---------------------------------------------------------------------
FIELD INFORMATION NOTICE
(For Authorized Distribution by SunService)
SYNOPSIS: 'hot_add' of an A1000/A3x00/A3500FC array may need to be
followed by a reconfiguration reboot on Solaris 8.
Sun Alert: No
TOP FIN/FCO REPORT: No
PRODUCT_REFERENCE: StorEdge A1000/A3x00 Arrays
PRODUCT CATEGORY: Storage / Service
PRODUCTS AFFECTED:
Systems Affected:
-----------------
Mkt_ID Platform Model Description Serial Number
------ -------- ----- ----------- -------------
- ANYSYS - System Platform Independent -
X-Options Affected:
-------------------
Mkt_ID Platform Model Description Serial Number
------ -------- ----- ----------- -------------
- A3000 ALL A3000 Storage Array -
- A3500 ALL A3500 Storage Array -
- A3500FC ALL A3500FC Storage Array -
PART NUMBERS AFFECTED:
Part Number Description Model
----------- ----------- -----
798-0188-01 SS, CD ASSY, RAID Manager 6.1 -
798-0522-01 RAID Manager 6.1.1 -
798-0522-02 RAID Manager6.1.1 Update 1 -
798-0522-03 RAID Manager6.1.1 Update 2 -
704-6708-10 CD, SUN STOREDGE RAID Manager6.22 -
REFERENCES:
BugId: 4492436: LUNS of new A1000 not seen from format using just hot_add
on Solaris 8.
4506425: Dynamic addition of 2nd A3500 array does not work everytime
on SAN 2.1.
DOC: 816-0830-12 - Sun StorEdge Network FC Switch-8 and Switch-16
Installation and Configuration Guide.
Manual: 805-7756-10 - Sun StorEdge RAID Manager 6.22 Installation and
Support Guide for Solaris.
PROBLEM DESCRIPTION:
Newly installed A1000/A3x00/A3500FC arrays might not be useable under
Solaris 8 when added with the RAID Manager 'hot_add' command. The LUNs
for these arrays will not be recognized and are not listed in the
output of 'format'. This FIN will describe the problem and provide the
proper procedures for adding these arrays under Solaris 8.
This problem can occur with any system running Solaris 8 to which
A1000/A3x00/A3500FC arrays are hot-plugged. It has been noticed that the
problem can be exacerbated by Solaris 8 Update 4 and later.
The LUNs in the arrays are not seen because the devices under /devices/psuedo
are not getting built correctly. The rdnexus entries are all files and not
directories as they should be.
crw------- 1 root sys 231,1856 Aug 7 11:47 rdnexus@29:devctl
crw------- 1 root sys 231,1857 Aug 7 11:47 rdnexus@29:scsi
crw------- 1 root sys 231,128 Aug 7 11:47 rdnexus@2:devctl
crw------- 1 root sys 231,129 Aug 7 11:47 rdnexus@2:scsi
crw------- 1 root sys 231,1920 Aug 7 11:47 rdnexus@30:devctl
crw------- 1 root sys 231,1921 Aug 7 11:47 rdnexus@30:scsi
crw------- 1 root sys 231,1984 Aug 7 11:47 rdnexus@31:devctl
Viewing the /dev/rdsk entries will show that the links are not correct.
# ls -lL /dev/rdsk
/dev/rdsk/c2t5d0s0: No such file or directory
/dev/rdsk/c2t5d0s1: No such file or directory
/dev/rdsk/c2t5d0s2: No such file or directory
/dev/rdsk/c2t5d0s3: No such file or directory
/dev/rdsk/c2t5d0s4: No such file or directory
/dev/rdsk/c2t5d0s5: No such file or directory
/dev/rdsk/c2t5d0s6: No such file or directory
The '/usr/lib/osa/bin/lad' command does show the LUNs:
c2t5d0s0 1t####### LUNS: 0
This problem occurs due to insufficient coordination between RDAC, the sd
driver and the devfsadmd daemon. See bugID 4506425 to obtain a more detailed
root cause.
The correct way to add A3500FC arrays to a SAN is discussed in the Sun StorEdge
Network FC Switch-8 and Switch-16 Installation and Configuration Guide,
816-0830-12. Page 124 describes hot-plugging an A3500FC.
1) 1st array, run 'boot -r'
2) 2nd array, run '/usr/lib/osa/bin/hot_add'
For all other types of arrays, please follow the procedures given in
the Corrective Action section below.
IMPLEMENTATION: (Proactive vs Reactive)
---
| | MANDATORY (Fully Proactive)
---
---
| | CONTROLLED PROACTIVE (per Sun Geo Plan)
---
---
| X | REACTIVE (As Required)
---
CORRECTIVE ACTION:
The following recommendation is provided as a guideline for authorized
Enterprise Services Field Representatives who may encounter the above
mentioned problem.
Please perform the following procedures as needed:
Here is the procedure to follow to add a new array to an existing host
configuration. All these steps have been tested using RM 6.22.1, but
not prior releases.
After you physically connect the array, then
For an A3500FC on a SAN:
------------------------
1. 1st array, do a 'boot -r'
2. 2nd array, do '/usr/lib/osa/bin/hot_add'
If this does not work and you have already installed the RM6.22.1
patch 
112126, you will see a warning message as below:
Array Hot Add warning: The array driver was unable to attach to
one or more array devices, and needs to be re-loaded. This may
require a system reboot.
There will be no warning message if your RM6.22.1 patch is -03 or
before, however in both cases, you need to follow the same procedure
as below to reload the array driver,
'/etc/init.d/amdemon stop'
'modinfo |grep rdriver'
'modunload -i <1st number from above modinfo>'
'/etc/init.d/amdemon start'
'/usr/lib/osa/bin/hot_add'
For an A3500FC:
---------------
'/usr/lib/osa/bin/hot_add'
If this does not work and you have already installed the RM6.22.1
patch 112126, you will see a warning message as below:
Array Hot Add warning: The array driver was unable to attach to
one or more array devices, and needs to be re-loaded. This may
require a system reboot.
There will be no warning message if your RM6.22.1 patch is -03 or
before, however in both cases, you need to follow the same procedure
as below to reload the array driver,
'/etc/init.d/amdemon stop'
'modinfo |grep rdriver'
'modunload -i <1st number from above modinfo>'
/etc/init.d/amdemon start
'/usr/lib/osa/bin/hot_add'
For an A3x00 (SCSI):
--------------------
'/usr/lib/osa/bin/hot_add'
If this does not work and you are running Solaris 8 Update 4 with
RM6.22.1 patch 112126, you will see a warning message as below:
WARNING: set_drivers: No arrays were found that are controlled by
either the sd or the ssd driver
There will be no warning message if your RM6.22.1 patch is -03 or
before, however in both cases, you need to follow the same procedure
as below to reconfigure the /devices directory,
'rm -r /devices/pseudo/rdnexus@*' (from bug 4492436 workaround)
'drvconfig -i rdnexus'
'drvconfig -i rdriver'
If the above are insufficient, then 'boot -r'.
For an A1000:
-------------
'/usr/lib/osa/bin/hot_add'
If this does not work and you are running Solaris 8 Update 4 with
RM6.22.1 patch 112126, you will see a warning message as below:
WARNING: set_drivers: No arrays were found that are controlled by
either the sd or the ssd driver
There will be no warning message if your RM6.22.1 patch is -03 or
before, however in both cases, you need to follow the same procedure
as below to reconfigure the /devices directory,
'rm -r /devices/pseudo/rdnexus@*' (from bug 4492436 workaround)
'drvconfig -i rdnexus'
'drvconfig -i rdriver'
If the above are insufficient, then 'boot -r'.
NOTE: You can tell that the 'hot_add' did not work if you see the warning
message(with 112124 installed), the 'format' command does not
see the drives, or the RM6 GUI does not recognize them.
COMMENTS:
None
============================================================================
Implementation Footnote:
i) In case of MANDATORY FINs, Enterprise Services will attempt to
contact all affected customers to recommend implementation of
the FIN.
ii) For CONTROLLED PROACTIVE FINs, Enterprise Services mission critical
support teams will recommend implementation of the FIN (to their
respective accounts), at the convenience of the customer.
iii) For REACTIVE FINs, Enterprise Services will implement the FIN as the
need arises.
----------------------------------------------------------------------------
All released FINs and FCOs can be accessed using your favorite network
browser as follows:
SunWeb Access:
--------------
* Access the top level URL of http://sdpsweb.ebay/FIN_FCO/
* From there, select the appropriate link to query or browse the FIN and
FCO Homepage collections.
SunSolve Online Access:
-----------------------
* Access the SunSolve Online URL at http://sunsolve.Corp/
* From there, select the appropriate link to browse the FIN or FCO index.
Internet Access:
----------------
* Access the top level URL of https://infoserver.Sun.COM
--------------------------------------------------------------------------
General:
--------
* Send questions or comments to finfco-manager@sdpsweb.EBay
--------------------------------------------------------------------------
Copyright (c) 1997-2003 Sun Microsystems, Inc.