rac 一个节点cssd不能正常启动。

回到原点

[root@rac2 cssd]# ps -ef|grep cssd
root      5639     1  0 01:20 ?        00:00:00 /bin/sh /etc/init.d/init.cssd oclsomon
root      5968  5639  0 01:20 ?        00:00:00 /sbin/runuser -l oracle -c /bin/sh -c 'cd /home/crs/oracle/product/10/crs/log/rac2/cssd/oclsomon; ulimit -c unlimited; /home/crs/oracle/product/10/crs/bin/oclsomon  || exit $?'
oracle    5969  5968  0 01:20 ?        00:00:00 /bin/sh -c cd /home/crs/oracle/product/10/crs/log/rac2/cssd/oclsomon; ulimit -c unlimited; /home/crs/oracle/product/10/crs/bin/oclsomon  || exit $?
root      6214     1  0 01:21 ?        00:00:00 /bin/sh /etc/init.d/init.cssd fatal
root     12506  4402  0 01:38 pts/2    00:00:00 grep cssd

[root@rac2 cssd]# tail -f ocssd.log

[    CSSD]2012-05-03 01:20:58.942 [2971856] >TRACE:   clssscmain: local-only set to false
[    CSSD]2012-05-03 01:20:58.964 [2971856] >TRACE:   clssnmReadNodeInfo: added node 1 (rac2) to cluster
[    CSSD]2012-05-03 01:20:59.012 [2971856] >TRACE:   clssnmReadNodeInfo: added node 2 (rac1) to cluster
[    CSSD]2012-05-03 01:20:59.013 [2971856] >TRACE:   clssnmInitNMInfo: Initialized with unique 1336033258
[    CSSD]2012-05-03 01:20:59.025 [2971856] >TRACE:   clssNMInitialize: Initializing with OCR id (1736838471)
[    CSSD]2012-05-03 01:20:59.073 [67373968] >TRACE:   clssnm_skgxninit: Compatible vendor clusterware not in use
[    CSSD]2012-05-03 01:20:59.073 [67373968] >TRACE:   clssnm_skgxnmon: skgxn init failed
[    CSSD]2012-05-03 01:20:59.080 [2971856] >TRACE:   clssnmNMInitialize: misscount set to (60), impending reconfig threshold set to (56000)
[    CSSD]2012-05-03 01:20:59.083 [2971856] >TRACE:   clssnmNMInitialize: Network heartbeat thresholds are: impending reconfig 30000 ms, reconfig start (misscount) 60000 ms
[    CSSD]2012-05-03 01:20:59.094 [2971856] >TRACE:   clssnmDiskStateChange: state from 1 to 2 disk (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:20:59.094 [67373968] >TRACE:   clssnmvDPT: spawned for disk 0 (/dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.032 [67373968] >TRACE:   clssnmDiskStateChange: state from 2 to 4 disk (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.143 [2971856] >TRACE:   clssnmFatalInit: fatal mode enabled
[    CSSD]2012-05-03 01:21:02.143 [77863824] >TRACE:   clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw2) initial sleep interval (1000)ms
[    CSSD]2012-05-03 01:21:02.197 [122760080] >TRACE:   clssnmClusterListener: Spawned
[    CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR:   clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE:   clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE:   clssnmDiskPMT: disk offline (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable
[    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   ###################################
[    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   clssscExit: CSSD aborting
[    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   ###################################
[    CSSD]--- DUMP GROCK STATE DB ---
[    CSSD]2012-05-03 01:21:02.198 [122760080] >TRACE:   clssnmClusterListener: Listening on (ADDRESS=(PROTOCOL=tcp)(HOST=rac2-priv)(PORT=49895))

[    CSSD]--- END OF GROCK STATE DUMP ---
[    CSSD]2012-05-03 01:21:02.198 [122760080] >TRACE:   clssnmClusterListener: Probing node rac1 (2), probcon(0xb7c02598)
[    CSSD]2012-05-03 01:21:02.246 [122760080] >TRACE:   clssnmInitialMsg: node 2, rac1, con (0xb7c02598)
[    CSSD]2012-05-03 01:21:02.246 [133249936] >TRACE:   clssgmclientlsnr: Spawned
[    CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE:   clssnmConnComplete: MSGSRC 2, type 6, node 2, flags 0x0001, con 0xb7c02598, probe 0xb7c02598
[    CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE:   clssnmConnComplete: node 2, rac1, con(0xb7c02598), probcon(0xb7c02598), ninfcon((nil)), node unique 1336033117, prev unique 0, msg unique 1336033117 node state 0
[    CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE:   clssnmConnComplete: connected to node 2 (con 0xb7c02598), ninfcon (0xb7c02598), state (0), flag (1037)
[    CSSD]2012-05-03 01:21:02.264 [97811344] >TRACE:   clssscctx:  dump of 0x0x8b87318, len 4088
[    CSSD]2012-05-03 01:21:02.264 [97811344] >TRACE:   0x0x8b87318 80 76 c2 08 b8 8f bc 08 - 00 00 00 00 80 69 b8 08 .v...........i..
[    CSSD]2012-05-03 01:21:02.307 [97811344] >TRACE:   0x0x8b87328 70 ce b8 08 c8 6b b8 08 - 00 00 72 00 18 73 b8 08 p....k....r..s..
[    CSSD]2012-05-03 01:21:02.307 [97811344] >TRACE:   0x0x8b87338 00 00 00 00 00 00 00 00 - 00 00 00 00 4d 61

[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   0x0xb7c02328 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   0x0xb7c02338 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   0x0xb7c02348 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   0x0xb7c02358 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   0x0xb7c02368 00 00 00 00 00 00 00 00 - 00 00 00 00             ............
[    CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE:   clssscctx->nmctx->nmnode[002]->con->icon->uid:  dump of 0x(nil), len 0
[    CSSD]--- DUMP GROCK STATE DB ---
[    CSSD]--- END OF GROCK STATE DUMP ---
[    CSSD]------- End Dump -------

[oracle@rac1 ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....SM2.asm application    ONLINE    ONLINE    rac1        
ora....C1.lsnr application    ONLINE    ONLINE    rac1        
ora.rac1.gsd   application    ONLINE    ONLINE    rac1        
ora.rac1.ons   application    ONLINE    ONLINE    rac1        
ora.rac1.vip   application    ONLINE    ONLINE    rac1        
ora....SM1.asm application    ONLINE    OFFLINE               
ora....C2.lsnr application    OFFLINE   OFFLINE               
ora.rac2.gsd   application    ONLINE    OFFLINE               
ora.rac2.ons   application    ONLINE    OFFLINE               
ora.rac2.vip   application    ONLINE    ONLINE    rac1        
ora.test.db    application    OFFLINE   OFFLINE               
ora....t1.inst application    OFFLINE   OFFLINE

miloluo

应该是voting disk currupted.

1. [    CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR:   clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
   
2. [    CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE:   clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
   
3. [    CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE:   clssnmDiskPMT: disk offline (0//dev/raw/raw2)
   
4. [    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable
   
5. [    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   ###################################
   
6. [    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   clssscExit: CSSD aborting
   
7. [    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   ###################################

复制代码

Maclean Liu(刘相兵

CSSD]2012-05-03 01:21:02.143 [2971856] >TRACE:   clssnmFatalInit: fatal mode enabled
[    CSSD]2012-05-03 01:21:02.143 [77863824] >TRACE:   clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw2) initial sleep interval (1000)ms
[    CSSD]2012-05-03 01:21:02.197 [122760080] >TRACE:   clssnmClusterListener: Spawned
[    CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR:   clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE:   clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE:   clssnmDiskPMT: disk offline (0//dev/raw/raw2)
[    CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR:   clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable


请确认 /dev/raw/raw2 是 voting disk ， 且其绑定的分区 准确。