[EXADATA UPGRADE] 升级IB 出现failed

yugui321

硬件型号：EXADATA X3-2 HALF RACK
操作：ibs upgrade to SUN DCS 36p version: 2.1.3-4
错误描述：./patchmgr -ibswitches ibs0_group -upgrade出现failed，进程中断

细节:
/patchmgr -ibswitches ibs0_group -upgrade -ibswitch_precheck
    [root@dm02db01 patch_11.2.3.3.1.140529.1]# ./patchmgr -ibswitches ibs0_group -upgrade -ibswitch_precheck

2014-07-16 15:29:04 +0800 1 of 1 :SUCCESS: DO: Initiate pre-upgrade validation check on InfiniBand switch(es).
----- InfiniBand switch update process started Wed Jul 16 15:29:05 CST 2014 -----
[NOTE     ] Log file at /var/log/cellos/upgradeIBSwitch.log

[INFO     ] List of InfiniBand switches for upgrade: ( 10.10.13.44 )
[PROMPT   ] Use the default password for all switches? (y/n) [n]: y

[PROMPT   ] Mismatch in the list of switches provided ( 10.10.13.44 ) and the output of the command ibswitches ( dm02sw-ibs0 dm02sw-iba0 dm02sw-ibb0 ). Are you sure you want to continue? (y/n) [n]: y

[PROMPT   ] Updating only 1 switch(es). Are you sure you want to continue? (y/n) [n]: y

[SUCCESS  ] Verifying Network connectivity to 10.10.13.44
[SUCCESS  ] Validating verify-topology output
[INFO     ] Master Subnet Manager is set to "dm02sw-ibs0" in all Switches
[INFO     ] Found 1 InfiniBand switches with subnet manager running. Continuing.

[INFO     ] ---------- Starting with IBSwitch 10.10.13.44
[SUCCESS  ] 10.10.13.44 is at 1.3.3-2. Meets minimal patching level 1.3.3-2
[SUCCESS  ] Verifying that /tmp has 120M in 10.10.13.44, found 139M
[SUCCESS  ] Verifying that / has 80M in 10.10.13.44, found 199M
[SUCCESS  ] Verifying that 10.10.13.44 has 120M free memory, found 293M
[SUCCESS  ] Verifying host details in /etc/hosts and /etc/sysconfig/network-scripts/ifcfg-eth0 /etc/sysconfig/network-scripts/ifcfg-eth1 for 10.10.13.44
[SUCCESS  ] Verifying that 10.10.13.44 has at least 1 NTP Server, found 1
[INFO     ] Manually validate the following entries Date:(YYYY-MM-DD) 2014-07-16 Time:(HH:MM:SS) 15:30:15
[SUCCESS  ] Pre-update validation on 10.10.13.44
[SUCCESS  ] Overall status

----- InfiniBand switch update process ended Wed Jul 16 15:30:19 CST 2014 -----
2014-07-16 15:30:20 +0800 1 of 1 :SUCCESS: DONE: Initiate pre-upgrade validation check on InfiniBand switch(es).
check无异常
[root@dm02db01 patch_11.2.3.3.1.140529.1]#  
./patchmgr -ibswitches ibs0_group -upgrade

  ROMPT   ] Mismatch in the list of switches provided ( dm02sw-ibb0 ) and the output of the command ibswitches ( dm02sw-ibs0 dm02sw-iba0 dm02sw-ibb0 ). Are you sure you want to continue? (y/n) [n]: y

[PROMPT   ] Updating only 1 switch(es). Are you sure you want to continue? (y/n) [n]: y

[SUCCESS  ] Verifying Network connectivity to dm02sw-ibb0
[SUCCESS  ] Validating verify-topology output
[INFO     ] Proceeding with upgrade of InfiniBand switches to version 2.1.3_4
[INFO     ] Master Subnet Manager is set to "dm02sw-ibb0" in all Switches
[PROMPT   ] Found 1 InfiniBand switches with subnet manager running. Are you sure you want to continue? (y/n) [n]: y

[INFO     ] Found 1 InfiniBand switches with subnet manager running. Continuing as per user request.

[INFO     ] ---------- Starting with IBSwitch dm02sw-ibb0
[SUCCESS  ] Disable Subnet Manager on dm02sw-ibb0
expect: spawn id exp8 not open
    while executing
"expect "*?assword:*" { send -- "welcome1\n" }"
[FAIL     ] Copy firmware packages to dm02sw-ibb0
[FAIL     ] Update switch dm02sw-ibb0 to 2.1.3_4
[INFO     ] Aborting the process. Not going to try anymore switches. Retry after resolving the problems.
[FAIL     ] Overall status

----- InfiniBand switch update process ended Wed Jul 16 13:41:23 CST 2014 -----
2014-07-16 13:41:24 +0800 1 of 1 :FAILED: Details in files /var/log/cellos/upgradeIBSwitch.log /u01/patches/patch_11.2.3.3.1.140529.1/patchmgr.stdout, /u01/patches/patch_11.2.3.3.1.140529.1/patchmgr.stderr
2014-07-16 13:41:24 +0800 1 of 1 :FAILED: DONE: Upgrade InfiniBand switch(es) to 2.1.3-4.
   

请MACLEAN帮忙看下，谢谢！

Maclean Liu(刘相兵

[SUCCESS  ] Disable Subnet Manager on dm02sw-ibb0
expect: spawn id exp8 not open
    while executing
"expect "*?assword:*" { send -- "welcome1\n" }"
[FAIL     ] Copy firmware packages to dm02sw-ibb0
[FAIL     ] Update switch dm02sw-ibb0 to 2.1.3_4
[INFO     ] Aborting the process. Not going to try anymore switches. Retry after resolving the problems.


你们修改过密码吗？

yugui321

Maclean Liu(刘相兵 发表于 2014-7-17 20:50
[SUCCESS  ] Disable Subnet Manager on dm02sw-ibb0
expect: spawn id exp8 not open
    while executing ...

没有修改过密码 nm2user和root都没有修改过。。

yugui321

Maclean Liu(刘相兵 发表于 2014-7-17 20:50
[SUCCESS  ] Disable Subnet Manager on dm02sw-ibb0
expect: spawn id exp8 not open
    while executing ...

问题已经解决了share一下：
是patch 11.2.3.3.1版本的问题，我们尝试使用11.2.3.3.0的版本成功升级了IBS VERSION

ps:maclean，我是今天想加您群的，您问我一个enquence的问题，一下子有点紧张。。说的有点乱，下次希望能成功加群。