43 积分	0 好友	0 主题

发消息

rac 一个节点cssd不能正常启动。

1^#

发表于 2012-5-3 16:42:14 | 查看: 5774| 回复: 2

[root@rac2 cssd]# ps -ef|grep cssd
root    5639    1  0 01:20 ?       00:00:00 /bin/sh /etc/init.d/init.cssd oclsomon
root    5968  5639  0 01:20 ?       00:00:00 /sbin/runuser -l oracle -c /bin/sh -c 'cd /home/crs/oracle/product/10/crs/log/rac2/cssd/oclsomon; ulimit -c unlimited; /home/crs/oracle/product/10/crs/bin/oclsomon  || exit $?'
oracle 5969  5968  0 01:20 ?       00:00:00 /bin/sh -c cd /home/crs/oracle/product/10/crs/log/rac2/cssd/oclsomon; ulimit -c unlimited; /home/crs/oracle/product/10/crs/bin/oclsomon  || exit $?
root    6214    1  0 01:21 ?       00:00:00 /bin/sh /etc/init.d/init.cssd fatal
root    12506  4402  0 01:38 pts/2 00:00:00 grep cssd

[root@rac2 cssd]# tail -f ocssd.log

[ CSSD]2012-05-03 01:20:58.942 [2971856] >TRACE: clssscmain: local-only set to false
[ CSSD]2012-05-03 01:20:58.964 [2971856] >TRACE: clssnmReadNodeInfo: added node 1 (rac2) to cluster
[ CSSD]2012-05-03 01:20:59.012 [2971856] >TRACE: clssnmReadNodeInfo: added node 2 (rac1) to cluster
[ CSSD]2012-05-03 01:20:59.013 [2971856] >TRACE: clssnmInitNMInfo: Initialized with unique 1336033258
[ CSSD]2012-05-03 01:20:59.025 [2971856] >TRACE: clssNMInitialize: Initializing with OCR id (1736838471)
[ CSSD]2012-05-03 01:20:59.073 [67373968] >TRACE: clssnm_skgxninit: Compatible vendor clusterware not in use
[ CSSD]2012-05-03 01:20:59.073 [67373968] >TRACE: clssnm_skgxnmon: skgxn init failed
[ CSSD]2012-05-03 01:20:59.080 [2971856] >TRACE: clssnmNMInitialize: misscount set to (60), impending reconfig threshold set to (56000)
[ CSSD]2012-05-03 01:20:59.083 [2971856] >TRACE: clssnmNMInitialize: Network heartbeat thresholds are: impending reconfig 30000 ms, reconfig start (misscount) 60000 ms
[ CSSD]2012-05-03 01:20:59.094 [2971856] >TRACE: clssnmDiskStateChange: state from 1 to 2 disk (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:20:59.094 [67373968] >TRACE: clssnmvDPT: spawned for disk 0 (/dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.032 [67373968] >TRACE: clssnmDiskStateChange: state from 2 to 4 disk (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.143 [2971856] >TRACE: clssnmFatalInit: fatal mode enabled
[ CSSD]2012-05-03 01:21:02.143 [77863824] >TRACE: clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw2) initial sleep interval (1000)ms
[ CSSD]2012-05-03 01:21:02.197 [122760080] >TRACE: clssnmClusterListener: Spawned
[ CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR: clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE: clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE: clssnmDiskPMT: disk offline (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: ###################################
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: clssscExit: CSSD aborting
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: ###################################
[ CSSD]--- DUMP GROCK STATE DB ---
[ CSSD]2012-05-03 01:21:02.198 [122760080] >TRACE: clssnmClusterListener: Listening on (ADDRESS=(PROTOCOL=tcp)(HOST=rac2-priv)(PORT=49895))

[ CSSD]--- END OF GROCK STATE DUMP ---
[ CSSD]2012-05-03 01:21:02.198 [122760080] >TRACE: clssnmClusterListener: Probing node rac1 (2), probcon(0xb7c02598)
[ CSSD]2012-05-03 01:21:02.246 [122760080] >TRACE: clssnmInitialMsg: node 2, rac1, con (0xb7c02598)
[ CSSD]2012-05-03 01:21:02.246 [133249936] >TRACE: clssgmclientlsnr: Spawned
[ CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE: clssnmConnComplete: MSGSRC 2, type 6, node 2, flags 0x0001, con 0xb7c02598, probe 0xb7c02598
[ CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE: clssnmConnComplete: node 2, rac1, con(0xb7c02598), probcon(0xb7c02598), ninfcon((nil)), node unique 1336033117, prev unique 0, msg unique 1336033117 node state 0
[ CSSD]2012-05-03 01:21:02.247 [122760080] >TRACE: clssnmConnComplete: connected to node 2 (con 0xb7c02598), ninfcon (0xb7c02598), state (0), flag (1037)
[ CSSD]2012-05-03 01:21:02.264 [97811344] >TRACE: clssscctx:  dump of 0x0x8b87318, len 4088
[ CSSD]2012-05-03 01:21:02.264 [97811344] >TRACE: 0x0x8b87318 80 76 c2 08 b8 8f bc 08 - 00 00 00 00 80 69 b8 08 .v...........i..
[ CSSD]2012-05-03 01:21:02.307 [97811344] >TRACE: 0x0x8b87328 70 ce b8 08 c8 6b b8 08 - 00 00 72 00 18 73 b8 08 p....k....r..s..
[ CSSD]2012-05-03 01:21:02.307 [97811344] >TRACE: 0x0x8b87338 00 00 00 00 00 00 00 00 - 00 00 00 00 4d 61

[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: 0x0xb7c02328 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: 0x0xb7c02338 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: 0x0xb7c02348 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: 0x0xb7c02358 00 00 00 00 00 00 00 00 - 00 00 00 00 00 00 00 00 ................
[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: 0x0xb7c02368 00 00 00 00 00 00 00 00 - 00 00 00 00          ............
[ CSSD]2012-05-03 01:21:02.548 [97811344] >TRACE: clssscctx->nmctx->nmnode[002]->con->icon->uid:  dump of 0x(nil), len 0
[ CSSD]--- DUMP GROCK STATE DB ---
[ CSSD]--- END OF GROCK STATE DUMP ---
[ CSSD]------- End Dump -------

[oracle@rac1 ~]$ crs_stat -t
Name          Type          Target State    Host
------------------------------------------------------------
ora....SM2.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM1.asm application ONLINE OFFLINE
ora....C2.lsnr application OFFLINE OFFLINE
ora.rac2.gsd application ONLINE OFFLINE
ora.rac2.ons application ONLINE OFFLINE
ora.rac2.vip application ONLINE ONLINE rac1
ora.test.db application OFFLINE OFFLINE
ora....t1.inst application OFFLINE OFFLINE

分享0

收藏0 回复只看该作者道具举报

miloluo

2^#

发表于 2012-5-3 16:50:02

应该是voting disk currupted.

[ CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR: clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE: clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE: clssnmDiskPMT: disk offline (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: ###################################
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: clssscExit: CSSD aborting
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: ###################################

复制代码

回复只看该作者道具举报

Maclean Liu(刘相兵

3^#

发表于 2012-5-3 18:31:47

CSSD]2012-05-03 01:21:02.143 [2971856] >TRACE: clssnmFatalInit: fatal mode enabled
[ CSSD]2012-05-03 01:21:02.143 [77863824] >TRACE: clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw2) initial sleep interval (1000)ms
[ CSSD]2012-05-03 01:21:02.197 [122760080] >TRACE: clssnmClusterListener: Spawned
[ CSSD]2012-05-03 01:21:02.197 [77863824] >ERROR: clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.197 [77863824] >TRACE: clssnmDiskStateChange: state from 4 to 3 disk (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >TRACE: clssnmDiskPMT: disk offline (0//dev/raw/raw2)
[ CSSD]2012-05-03 01:21:02.198 [97811344] >ERROR: clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable

请确认 /dev/raw/raw2 是 voting disk ，且其绑定的分区准确。

回复只看该作者道具举报

返回列表

		自动登录	找回密码
密码			注册