双rac 节点 监听不停的重启

yobyin

rac 节点的监听 vip 在不停的重启

crs 的log 及监听的log 见附件

[ 本帖最后由 yobyin 于 2012-6-4 17:27 编辑 ]

Maclean Liu(刘相兵

11.1.0.7.0 +  linux

Listener 重启 你上传asmb进程的TRACE做什么？。。。。。。。。。。

上传 CRS日志  crsd.log 和该监听的日志 listener.log

Maclean Liu(刘相兵

ODM DATA:

CRS  11.1.0.7+

crsd.log

1. 2012-06-04 06:32:15.520: [  CRSRES][1969944336] Attempting to start `ora.db1.LISTENER_DB1.lsnr` on member `db1`
   
2. 2012-06-04 06:32:15.799: [  CRSRES][1969944336] Start of `ora.db1.LISTENER_DB1.lsnr` on member `db1` succeeded.
   
3. 2012-06-04 06:40:34.578: [  CRSAPP][1995134736] CheckResource error for ora.db1.vip error code = 1
   
4. 2012-06-04 06:40:34.581: [  CRSRES][1995134736] In stateChanged, ora.db1.vip target is ONLINE
   
5. 2012-06-04 06:40:34.581: [  CRSRES][1995134736] ora.db1.vip on db1 went OFFLINE unexpectedly
   
6. 2012-06-04 06:40:34.581: [  CRSRES][1995134736] StopResource: setting CLI values
   
7. 2012-06-04 06:40:34.585: [  CRSRES][1995134736] Attempting to stop `ora.db1.vip` on member `db1`
   
8. 2012-06-04 06:40:37.876: [  CRSRES][1995134736] Stop of `ora.db1.vip` on member `db1` succeeded.
   
9. 2012-06-04 06:40:37.877: [  CRSRES][1995134736] ora.db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
   
10. 2012-06-04 06:40:37.880: [  CRSRES][1995134736] ora.db1.vip failed on db1 relocating.
    
11. 2012-06-04 06:40:37.898: [  CRSRES][1995134736] StopResource: setting CLI values
    
12. 2012-06-04 06:40:37.902: [  CRSRES][1995134736] Attempting to stop `ora.db1.LISTENER_DB1.lsnr` on member `db1`
    
13. 2012-06-04 06:40:41.187: [  CRSRES][1995134736] Stop of `ora.db1.LISTENER_DB1.lsnr` on member `db1` succeeded.
    
14. 2012-06-04 06:40:41.199: [  CRSRES][1995134736] Attempting to start `ora.db1.vip` on member `db2`
    
15. 2012-06-04 06:40:47.502: [  CRSRES][1995134736] Start of `ora.db1.vip` on member `db2` succeeded.
    
16. 2012-06-04 06:40:47.783: [  CRSRES][1993033488] CRS-1002: Resource 'ora.db1.vip' is already running on member 'db2'
    
17. 
    
18. 2012-06-04 06:43:23.033: [    CRSD][2071979792] SM: rE2Ec: 4
    
19. 2012-06-04 06:43:23.038: [  CRSRES][1995134736] startRunnable: setting CLI values
    
20. 2012-06-04 06:43:31.135: [    CRSD][1995134736] SM:dE2Ec: all E2E cmds done. 0
    
21. 2012-06-04 06:43:31.198: [  CRSRES][1969944336] startRunnable: setting CLI values
    
22. 2012-06-04 06:43:31.202: [  CRSRES][1969944336] Attempting to start `ora.db1.LISTENER_DB1.lsnr` on member `db1`
    
23. 2012-06-04 06:43:31.480: [  CRSRES][1969944336] Start of `ora.db1.LISTENER_DB1.lsnr` on member `db1` succeeded.
    
24. 2012-06-04 06:47:34.460: [  CRSAPP][1969944336] CheckResource error for ora.db2.vip error code = 1
    
25. 2012-06-04 06:47:34.464: [  CRSRES][1969944336] In stateChanged, ora.db2.vip target is ONLINE
    
26. 2012-06-04 06:47:34.464: [  CRSRES][1969944336] ora.db2.vip on db1 went OFFLINE unexpectedly
    
27. 2012-06-04 06:47:34.464: [  CRSRES][1969944336] StopResource: setting CLI values
    
28. 2012-06-04 06:47:34.468: [  CRSRES][1969944336] Attempting to stop `ora.db2.vip` on member `db1`
    
29. 2012-06-04 06:47:37.751: [  CRSRES][1969944336] Stop of `ora.db2.vip` on member `db1` succeeded.
    
30. 2012-06-04 06:47:37.751: [  CRSRES][1969944336] ora.db2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    
31. 2012-06-04 06:47:37.753: [  CRSRES][1969944336] ora.db2.vip failed on db1 relocating.
    
32. 2012-06-04 06:47:37.774: [  CRSRES][1969944336] Attempting to start `ora.db2.vip` on member `db2`
    
33. 2012-06-04 06:47:47.074: [  CRSRES][1969944336] Start of `ora.db2.vip` on member `db2` succeeded.
    
34. 2012-06-04 06:48:11.990: [    CRSD][2071979792] SM: rE2Ec: 4
    
35. 2012-06-04 06:48:11.995: [  CRSRES][1995134736] startRunnable: setting CLI values
    
36. 2012-06-04 06:48:19.999: [    CRSD][1995134736] SM:dE2Ec: all E2E cmds done. 0
    
37. 2012-06-04 06:49:11.162: [ CRSCOMM][1969944336] CLEANUP: Searching for connections to failed node db2
    
38. 2012-06-04 06:49:11.162: [  CRSEVT][1969944336] Processing member leave for db2, incarnation: 234097512
    
39. 2012-06-04 06:49:11.163: [    CRSD][1969944336] SM: recovery in process: 8
    
40. 2012-06-04 06:49:11.163: [  CRSEVT][1969944336] Do failover for: db2
    
41. 2012-06-04 06:49:11.182: [  CRSRES][1969944336]  startup = 0
    
42. 2012-06-04 06:49:11.186: [  CRSRES][1969944336]  startup = 0
    
43. 2012-06-04 06:49:11.190: [  CRSRES][1969944336]  startup = 0
    
44. 2012-06-04 06:49:11.193: [  CRSRES][1969944336]  startup = 0
    
45. 2012-06-04 06:49:11.198: [  CRSRES][1969944336]  startup = 0
    
46. 2012-06-04 06:49:11.253: [  CRSEVT][1969944336] Post recovery done evmd event for: db2
    
47. 2012-06-04 06:49:11.254: [    CRSD][1969944336] SM: recoveryDone: 0
    
48. 2012-06-04 06:49:11.256: [  CRSEVT][1969944336] Processing RecoveryDone
    
49. 2012-06-04 06:54:43.467: [  CRSAPP][1969944336] CheckResource error for ora.db2.vip error code = 1
    
50. 2012-06-04 06:54:43.469: [  CRSRES][1969944336] In stateChanged, ora.db2.vip target is ONLINE
    
51. 2012-06-04 06:54:43.470: [  CRSRES][1969944336] ora.db2.vip on db1 went OFFLINE unexpectedly
    
52. 2012-06-04 06:54:43.470: [  CRSRES][1969944336] StopResource: setting CLI values
    
53. 2012-06-04 06:54:43.474: [  CRSRES][1969944336] Attempting to stop `ora.db2.vip` on member `db1`
    
54. 2012-06-04 06:54:46.761: [  CRSRES][1969944336] Stop of `ora.db2.vip` on member `db1` succeeded.
    
55. 2012-06-04 06:54:46.761: [  CRSRES][1969944336] ora.db2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    
56. 2012-06-04 06:54:46.763: [  CRSRES][1969944336] ora.db2.vip failed on db1 relocating.
    
57. 2012-06-04 06:54:46.775: [  CRSRES][1969944336] Cannot relocate ora.db2.vipStopping dependents
    
58. 2012-06-04 06:54:46.781: [  CRSRES][1969944336] StopResource: setting CLI values
    
59. 2012-06-04 06:54:46.784: [  CRSRES][1969944336] StopResource: setting CLI values

复制代码

ora.db1.vip on db1 went OFFLINE unexpectedly  由于 vip 意外OFFLINE 导致的LISTENER被stop

ora.db1.vip.log

1. Oracle Database 11g CRS Release 11.1.0.6.0 - Production Copyright 1996, 2007 Oracle. All rights reserved.
   
2. 2012-06-02 11:04:37.579: [    RACG][736835328] [16078][736835328][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
3. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
4. 
   
5. 2012-06-02 11:26:20.929: [    RACG][2685478656] [43649][2685478656][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
6. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
7. 
   
8. 2012-06-02 11:27:21.060: [    RACG][1302918912] [46566][1302918912][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
9. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
   
10. 
    
11. 2012-06-02 12:07:49.169: [    RACG][440960768] [49618][440960768][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
12. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
13. 
    
14. 
    
15. 2012-06-04 05:52:00.009: [    RACG][1394697984] [75618][1394697984][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
16. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
17. 
    
18. 2012-06-04 05:52:00.048: [ COMMCRS][1066178320]clsc_receive: (0x71a1a0) error 2
    
19. 
    
20. 2012-06-04 06:02:35.823: [    RACG][3631499008] [81706][3631499008][ora.db1.vip]: ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
21. ping to 10.218.6.1 via eth0 failed, rc = 1 (host=db1)
    
22. Interface eth0 checked failed (host=db1)
    
23. Invalid parameters, or failed to bring up VIP (host=db1)

复制代码

vip resource 尝试ping  10.218.6.1  这个网关但是失败，导致vip 意外终止。

RAC中必须要保证 vip所在网段的 gateway网关正常，否则vip会失败。