Honcho

16 积分	0 好友	2 主题

发消息

确认一个 RAC vip 漂移的问题

1^#

发表于 2012-2-27 18:05:52 | 查看: 7880| 回复: 5

环境：Oracle RAC  10.2.0.4  for AIX 5.3
状况：客户反应RAC 节点一 LISTENER 服务起不来，过去查看相关信息如下：

具体文件名不记得了节点1 vip alert日志：
2012-02-24 15:12:37.796: [ RACG][1] [1741198][1][ora.ebiz_db1.vip]: Invalid parameters, or failed to bring up VIP (host=ebiz_db1)
2012-02-24 15:12:37.804: [ RACG][1] [1741198][1][ora.ebiz_db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/crs10g
2012-02-24 15:12:37.804: [ RACG][1] [1741198][1][ora.ebiz_db1.vip]: clsrcexecut: cmd = /oracle/crs10g/bin/racgeut -e _USR_ORA_DEBUG=0 54 /oracle/crs10g/bin/racgvip check ebiz_db1
2012-02-24 15:12:37.804: [ RACG][1] [1741198][1][ora.ebiz_db1.vip]: clsrcexecut: rc = 1, time = 4.306s
2012-02-24 15:12:37.804: [ RACG][1] [1741198][1][ora.ebiz_db1.vip]: end for resource = ora.ebiz_db1.vip, action = check, status = 1, time = 4.435s

节点一crsd.log
2012-02-24 15:12:37.808: [  CRSAPP][11147]32CheckResource error for ora.ebiz_db1.vip error code = 1
2012-02-24 15:12:37.817: [  CRSRES][11147]32In stateChanged, ora.ebiz_db1.vip target is ONLINE
2012-02-24 15:12:37.828: [  CRSRES][11147]32ora.ebiz_db1.vip on ebiz_db1 went OFFLINE unexpectedly
2012-02-24 15:12:37.828: [  CRSRES][11147]32StopResource: setting CLI values
2012-02-24 15:12:37.841: [  CRSRES][11147]32Attempting to stop `ora.ebiz_db1.vip` on member `ebiz_db1`
2012-02-24 15:12:38.300: [  CRSRES][11147]32Stop of `ora.ebiz_db1.vip` on member `ebiz_db1` succeeded.
2012-02-24 15:12:38.301: [  CRSRES][11147]32ora.ebiz_db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-02-24 15:12:38.340: [  CRSRES][11147]32ora.ebiz_db1.vip failed on ebiz_db1 relocating.
2012-02-24 15:12:38.492: [  CRSRES][11147]32StopResource: setting CLI values
2012-02-24 15:12:38.502: [  CRSRES][11147]32Attempting to stop `ora.ebiz_db1.LISTENER_EBIZ_DB1.lsnr` on member `ebiz_db1`
2012-02-24 15:13:55.790: [  CRSRES][11147]32Stop of `ora.ebiz_db1.LISTENER_EBIZ_DB1.lsnr` on member `ebiz_db1` succeeded.
2012-02-24 15:13:55.929: [  CRSRES][11147]32Attempting to start `ora.ebiz_db1.vip` on member `ebiz_db2`
2012-02-24 15:13:57.511: [  CRSRES][11147]32Start of `ora.ebiz_db1.vip` on member `ebiz_db2` succeeded.
2012-02-24 16:13:31.477: [  CRSRES][11456]32ora.ebiz.ebiz1.inst target set to OFFLINE before stop action
2012-02-24 16:13:31.477: [  CRSRES][11456]32StopResource: setting CLI values
2012-02-24 16:13:31.512: [  CRSRES][11456]32Attempting to stop `ora.ebiz.ebiz1.inst` on member `ebiz_db1`
2012-02-24 16:13:32.638: [  CRSRES][11456]32Stop of `ora.ebiz.ebiz1.inst` on member `ebiz_db1` succeeded.
2012-02-24 16:14:24.547: [  CRSRES][11464]32`ora.ebiz.ebiz1.inst` is already OFFLINE.
2012-02-24 16:16:33.039: [ CRSD][11209]32SM: Recovery processing done.0
2012-02-24 16:16:33.039: [ CRSD][11209]32SM: Ongoing commands done.0
2012-02-24 16:16:33.059: [ CRSD][11209]32SM: asked E2E to exit.
2012-02-24 16:16:33.059: [ CRSCOMM][10034]32CLEANUP: quiesceing connection 114237ab0
2012-02-24 16:16:33.070: [ CRSMAIN][10034]32runCommandServer for E2E exiting.
2012-02-24 16:16:33.070: [ CRSD][11209]32SM: E2E port closed.3
2012-02-24 16:16:33.070: [ CRSD][11209]32SM: stoppedResources: all =1 m_state = 3
2012-02-24 16:16:33.084: [  CRSRES][11467]32StopResource: setting CLI values
2012-02-24 16:16:33.095: [  CRSRES][10186]32StopResource: setting CLI values
2012-02-24 16:16:33.117: [  CRSRES][10186]32Attempting to stop `ora.ebiz_db1.gsd` on member `ebiz_db1`
2012-02-24 16:16:33.167: [  CRSRES][11467]32Attempting to stop `ora.ebiz_db1.ons` on member `ebiz_db1`
2012-02-24 16:16:33.641: [  CRSRES][10186]32Stop of `ora.ebiz_db1.gsd` on member `ebiz_db1` succeeded.
2012-02-24 16:16:33.729: [  CRSRES][11467]32Stop of `ora.ebiz_db1.ons` on member `ebiz_db1` succeeded.
2012-02-24 16:16:33.928: [ CSSCLNT][3352]clssgsGGetStatus: CSS shutting down.

节点1 实例alert 日志

Fri Feb 24 15:13:19 2012
ALTER SYSTEM SET service_names='' SCOPE=MEMORY SID='ebiz1';
Fri Feb 24 15:13:19 2012
Immediate Kill Session#: 1416, Serial#: 44660
Immediate Kill Session: sess: 70000020cdee5b0  OS pid: 1999066
Fri Feb 24 15:13:19 2012
Process OS id : 1999066 alive after kill
Errors in file
Immediate Kill Session#: 1444, Serial#: 18
Immediate Kill Session: sess: 70000020ce01160  OS pid: 1249588
Fri Feb 24 15:13:20 2012
Process OS id : 1249588 alive after kill
Errors in file /oracle/ora10g/admin/ebiz/udump/ebiz1_ora_483454.trc
Immediate Kill Session#: 1458, Serial#: 491
Immediate Kill Session: sess: 70000020ce0a738  OS pid: 1335618
Fri Feb 24 15:13:20 2012
Process OS id : 1335618 alive after kill
Errors in file /oracle/ora10g/admin/ebiz/udump/ebiz1_ora_483454.trc
Immediate Kill Session#: 1550, Serial#: 2546
Immediate Kill Session: sess: 70000020ce47fe8  OS pid: 1311070
Fri Feb 24 15:13:21 2012
Process OS id : 1311070 alive after kill
Errors in file /oracle/ora10g/admin/ebiz/udump/ebiz1_ora_483454.trc
Immediate Kill Session#: 1591, Serial#: 58151
Immediate Kill Session: sess: 70000020fe764d8  OS pid: 2003314
Fri Feb 24 15:13:22 2012
Process OS id : 2003314 alive after kill
Errors in file /oracle/ora10g/admin/ebiz/udump/ebiz1_ora_483454.trc
Immediate Kill Session#: 1610, Serial#: 43244
Immediate Kill Session: sess: 70000020ce70218  OS pid: 1905072
Fri Feb 24 15:13:23 2012
Process OS id : 1905072 alive after kill
Errors in file /oracle/ora10g/admin/ebiz/udump/ebiz1_ora_483454.trc
Fri Feb 24 16:13:31 2012
Shutting down instance: further logons disabled

节点2上alert没有相关可用信息

查看了matelink 上相关信息：AIX: 10g VIP Fails to Come Up with "Invalid Parameters, Or Failed To Bring Up VIP" [ID 959746.1]

还有roger的一篇博客：http://hi.baidu.com/xu521huan/blog/item/95b854548b4e76143a293587.html

不知道是否上上述问题，请版主帮忙确认一下，这样好及时与客户沟通，TKS。

分享0