Document fins/I0709-1
FIN #: I0709-1
SYNOPSIS: After replacing a controller FRU on A1000/A3x00/A3500FC with RM
6.22.1, the NVSRAM must be reloaded
DATE: Nov/12/01
KEYWORDS: After replacing a controller FRU on A1000/A3x00/A3500FC with RM
6.22.1, the NVSRAM must be reloaded
---------------------------------------------------------------------
- Sun Proprietary/Confidential: Internal Use Only -
---------------------------------------------------------------------
FIELD INFORMATION NOTICE
(For Authorized Distribution by SunService)
SYNOPSIS: After replacing a controller FRU on A1000/A3x00/A3500FC with
RM 6.22.1, the NVSRAM must be reloaded.
Sun Alert: No
TOP FIN/FCO REPORT: No
PRODUCT_REFERENCE: A1000/A3x00/A3500FC Storage Array
PRODUCT CATEGORY: Storage / Service
PRODUCTS AFFECTED:
Systems Affected
----------------
Mkt_ID Platform Model Description Serial Number
------ -------- ----- ----------- -------------
- ANYSYS - System Platform Independent -
X-Options Affected
------------------
Mkt_ID Platform Model Description Serial Number
------ -------- ----- ----------- -------------
- A1000 ALL StorEdge A1000 -
- A3000 ALL StorEdge A3000 -
- A3500 ALL StorEdge A3500 -
- A3500FC ALL StorEdge A3500FC -
6530A - - Sun RSM Array 63GB 15X4GB -
6531A - - Sun RSM Array 147GB 7X4GB -
6532A - - A3000 15*4.2GB/7200 FWSCSI -
6533A - - RSM2000 35*4.2GB/7200 FWSCSI -
6534A - - A3000 15*9.1GB/7200 FWSCSI -
6535A - - A3000 35*9.1GB/7200 FWSCSI -
SG-XARY1* - - STOREDGE A1000/RACK -
SG-XARY3* - - STOREDGE A3500/RACK -
UG/CU-A3500FC* - - ASSY,TOP OPT,1X5X9,MAX,9GB,10K -
UG-A3K-A3500FC - - ASSY,UPGRADE,A3500FC/TABASCO -
UG-A3500-A3500FC - - ASSY,UPGRADE,A3500FC/DILBERT -
X6538A - - X-OPT,A3500FC CONTROLLER -
6538A - - FCTY, CONTROLLER, A3500FC -
X2611A - - OPT INT I/O BD FOR EXX00 -
X2612A - - OPT INT I/O BD EXX00 W/FC-AL -
X2622A - - OPT INT GRAPHICS I/O BD EXX00 -
PART NUMBERS AFFECTED:
Part Number Description Model
----------- ----------- -----
704-6708-10 CD, SUN STOREDGE RAID Manager6.22 -
704-7937-05 CD, RM 6.22.1 -
REFERENCES:
BugId: 4310356 - Incorrect ProductID observed when performing A3500FC
upgrade.
PatchId: 
109232: RAID Manager 6.22: upgrade to FC requires A3500
w/D1000 NVSRAM file.
109233: RAID Manager 6.22: upgrade to FC requires A3000
w/RSM NVSRAM file.
ECO: WO_21899
MANUAL: 805-7758-13 - Sun StorEdge RAID Manager 6.22.1 Release Notes.
805-7854-12 - Sun StorEdge A3x00 Controller FRU Replacement Guide
805-2624-10 - Sun StorEdge A1000 and D1000 Installation, Operations
and Service Manual
URL: http://www.sun.com/storage/disk-drives/raid.html
PROBLEM DESCRIPTION:
The A1000 Controller FRU's do not have the latest RAID Manager 6.22.1
NVSRAM, so the NVSRAM will need to be reloaded as well as the firmware.
A3x00 and A3500FC controllers are replaced only when there has been a
failure in the controller, so the storage arrays behind the controller
pair is exposed to a single point of failure during this time. Any
mis-step at this point could cause loss of access to that storage. An
A1000 controller is not redundant, so replacement will always cause a
reversion of NVSRAM when RM 6.22.1 is installed.
This problem is independent of host or host bus adapter type. With RAID
Manager 6.22.1, there is a new NVSRAM file loaded into the controllers
during installation of RM 6.22.1 on all A3x00 and A3500FC storage
arrays. On the A1000, when the Controller is replaced, the NVSRAM is
replaced. Since the A1000 Controller FRU's do not have the latest
NVSRAM, the RAID Manager 6.22.1 NVSRAM will need to be reloaded.
The "Sun StorEdge A3x00 Controller FRU Replacement Guide", 805-7854-12,
describes the proper procedures for replacing one controller at a time
while the array is powered on. If a controller is replaced while the
array is powered off, then the array firmware does not detect the
change and hence does not reload the correct NVSRAM from its saved copy
on disk.
When the wrong NVSRAM is in one or both A3x00 controllers then various
failures can occur. Bugs that are fixed in RM 6.22.1 will suddenly not
be fixed. During host reboot the following messages will appear:
The Status notification bit (disabled) NVSRAM field of controller
c2t5d0(1T93401584)at offset 0x1d is invalid, The value is 0x0 (the
valid value should be 0x80).
The Bus device reset message NVSRAM field of controller
c2t5d0(1T93401584)at offset 0x28 is invalid, The value is 0xc (the
valid value should be0x2c).
The Product revision level NVSRAM field of controller
c2t5d0(1T93401584)at offset 0x33 is invalid, The value is 0x1 (the
valid value should be 0x5).
The incorrect NVSRAM settings of controller c2t5d0(1T93401584)
have been fixed. The new settings will not take effect until the
controller is reset. While the subsystem is idle, turn the
controller module off, then back on.
When RM 6.22.1 is installed, all A1000 controller FRU replacements will
cause the NVSRAM on the FRU to be used instead of the NVSRAM delivered
in RM 6.22.1.
NOTE: This same problem could occur when using RAID Manager 6.22 or a
prior release on the A3x00/A3500FC. The proper NVSRAM files would
have to be retrieved from the NVSRAM patches 109232 and 109233 for
the A3x00FC or from your service representative in other cases.
However, the default NVSRAM's that come with the FRU's are
generally the correct NVSRAM already, so usually no mismatch is
caused in NVSRAM. If the FRU for a different array model is
used, then the wrong NVSRAM would be loaded.
Improper A3x00/A3500FC replacement procedure as described above, such as
cold-swapping controller FRU's, can cause the wrong NVSRAM to become
resident on the replaced controller. One can check whether the proper
NVSRAM is resident by giving the command "/etc/raid/bin/raidutil -c
<device> -i" where <device> is the controller ctd number as
show by the
lad(1m) command. The output of this command will show "Product Revision
0003" if the RM 6.22.1 NVSRAM is loaded.
For A1000, the NVSRAM must be loaded after replacing the controller FRU
as described in the Corrective Action.
The firmware in Raid Manager 6.22.x automatically reloads the correct
NVSRAM from a private repository on disk for the A3x00/A3500FC as long
as the correct replacement procedure is used.
IMPLEMENTATION:
---
| | MANDATORY (Fully Pro-Active)
---
---
| | CONTROLLED PRO-ACTIVE (per Sun Geo Plan)
---
---
| X | REACTIVE (As Required)
---
CORRECTIVE ACTION:
The following recommendation is provided as a guideline for authorized
Enterprise Services Field Representatives who may encounter the above
mentioned problem.
Replace a defective A1000/A3x00/A3500FC controller using either step A or B.
A. For A3x00/A3500FC controller replacement, use the procedures found in the
Sun StorEdge A3x00 Controller FRU Replacement Guide, 805-7854-12.
B. For A1000 controller replacement, follow the procedures in the Sun
StorEdge A1000 and D1000 Installation, Operations and Service
Manual, 805-2624-10.
NOTE: After the controller has been replaced, check the NVSRAM version
using the "/etc/raid/bin/raidutil -c <device> -i"
command. If the
product revision is not precisely "0003", then upgrade the NVSRAM
using the following steps.
Please adhere to the following NVSRAM installation guideline from the
RAID Manager 6.22.1 Release Notes, 805-7758-13.
1. Locate the NVSRAM for appropriate array types as shown on the
following table.
--------------------------------------
| NVSRAM file | Array Type |
|================+=====================|
| 44072dn.dl | A3500FC RSM Tray |
|----------------+---------------------|
| 44073dn.dl | A3500FC |
|----------------+---------------------|
| sie3240c.dl | A1000 |
|----------------+---------------------|
| sie3621g.dl | A3000 RSM Tray |
|----------------+---------------------|
| sie3621h.dl | A3500 |
--------------------------------------
If a controller contains the wrong NVSRAM, the NVSRAM must be
reloaded. The NVSRAM files were put into the /usr/lib/osa/fw
directory of the system during the RAID Manager installation or
upgrade process as part of the SUNWosanv package.
2. Launch the Configuration application of RAID Manager:
# /etc/raid/bin/rm6
3. Click Maintenance/Tuning -> the module name of the array ->
Firmware
Upgrade. Firmware upgrade button can be clicked alternately.
4. Click 'OK' if Important Note dialog is being seen.
5. In the Select Upgrade Type window, click offline.
6. Enter /usr/lib/osa/fw/NVSRAMfile in the path field, where NVSRAMfile
is the NVSRAM file from above table.
Click 'OK' in the Offline Firmware Upgrade dialog.
At this point the LUNs must not be otherwise accessed by the host, so
they should not be mounted nor under volume manager control as described
in the aforementioned documents.
7. Note power cycling each controller is no longer needed to activate
the new NVSRAM.
Do not reboot the host computer since rebooting the host computer
does not activate the NVSRAM.
NOTE: After downloading the RAID Manager firmware, verify the new NVSRAM
is installed with the raidutil -c device -i command. The module
profile should show a revision of "0003".
Also please refer to the "Sun StorEdge RAID Manager 6.22.1 Release
Notes", 805-7758-13, for more detail on other information on full
NVSRAM replacement procedure.
Then see the "Sun StorEdge A3x00 Controller FRU Replacement Guide",
805-7854-12, for directions on updating the firmware on the
A1000/A3x00/A3500FC.
COMMENTS:
None
============================================================================
Implementation Footnote:
i) In case of MANDATORY FINs, Enterprise Services will attempt to
contact all affected customers to recommend implementation of
the FIN.
ii) For CONTROLLED PROACTIVE FINs, Enterprise Services mission critical
support teams will recommend implementation of the FIN (to their
respective accounts), at the convenience of the customer.
iii) For REACTIVE FINs, Enterprise Services will implement the FIN as the
need arises.
----------------------------------------------------------------------------
All released FINs and FCOs can be accessed using your favorite network
browser as follows:
SunWeb Access:
--------------
* Access the top level URL of http://sdpsweb.ebay/FIN_FCO/
* From there, select the appropriate link to query or browse the FIN and
FCO Homepage collections.
SunSolve Online Access:
-----------------------
* Access the SunSolve Online URL at http://sunsolve.Corp/
* From there, select the appropriate link to browse the FIN or FCO index.
Supporting Documents:
---------------------
* Supporting documents for FIN/FCOs can be found on Edist. Edist can be
accessed internally at the following URL: http://edist.corp/.
* From there, follow the hyperlink path of "Enterprise Services Documenta-
tion" and click on "FIN & FCO attachments", then choose the
appropriate
folder, FIN or FCO. This will display supporting directories/files for
FINs or FCOs.
Internet Access:
----------------
* Access the top level URL of https://infoserver.Sun.COM
--------------------------------------------------------------------------
General:
--------
* Send questions or comments to finfco-manager@Sun.COM
---------------------------------------------------------------------------
Copyright (c) 1997-2003 Sun Microsystems, Inc.