grid升级后crs无法启动

ALLSTARS_ORACLE

grid从11.2.0.1升级到11.2.0.4后crs无法启动,请问大家如何处理


CRS-2769:Unable to failover resource 'ora.diskmon'.
CRS-10001:04-Mar-14 14:18 ACFS-9391: Checking for existing ADVM/ACFS installation.
CRS-10001:04-Mar-14 14:18 ACFS-9392: Validating ADVM/ACFS installation files for operating system.
CRS-10001:04-Mar-14 14:18 ACFS-9393: Verifying ASM Administrator setup.
CRS-10001:04-Mar-14 14:18 ACFS-9308: Loading installed ADVM/ACFS drivers.
CRS-10001:04-Mar-14 14:18 ACFS-9154: Loading 'oracleoks.ko' driver.
CRS-10001:04-Mar-14 14:18 ACFS-9154: Loading 'oracleadvm.ko' driver.
CRS-10001:04-Mar-14 14:18 ACFS-9154: Loading 'oracleacfs.ko' driver.
CRS-10001:04-Mar-14 14:18 ACFS-9327: Verifying ADVM/ACFS devices.
CRS-10001:04-Mar-14 14:18 ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
CRS-10001:04-Mar-14 14:18 ACFS-9156: Detecting control device '/dev/ofsctl'.
CRS-10001:04-Mar-14 14:18 ACFS-9322: completed
2014-03-04 14:18:46.462:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:18:46.724:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:18:51.973:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:18:57.175:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:02.479:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:07.714:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:07.942:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:13.222:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:18.437:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:23.717:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:28.992:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:29.220:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:34.463:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:39.662:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:44.921:
CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/gri
d/11.2.0.4/log/node1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-03-04 14:19:50.111:
CRS-2807:Resource 'ora.asm' failed to start automatically.
2014-03-04 14:19:50.111:
CRS-2807:Resource 'ora.crsd' failed to start automatically.




Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_GIPCD)) with status 9
2014-03-04 16:55:08.262: {0:9:101} Error = error 9 encountered when connecting to GIPCD
2014-03-04 16:55:08.264: [    AGFW]{0:9:101} ora.gipcd 1 1 state changed from: STOPPING to: OFFLINE
2014-03-04 16:55:08.265: [    AGFW]{0:9:101} Agent sending last reply for: RESOURCE_STOP ID 4099:1376
2014-03-04 16:55:08.283: [    AGFW]{0:9:102} Agent received the message: RESOURCE_STOP ID 4099:1420
2014-03-04 16:55:08.283: [    AGFW]{0:9:102} Preparing STOP command for: ora.gpnpd 1 1
2014-03-04 16:55:08.283: [    AGFW]{0:9:102} ora.gpnpd 1 1 state changed from: ONLINE to: STOPPING
2014-03-04 16:55:08.286: {0:9:102} (:CLSN00108:) clsn_agent::stop {
2014-03-04 16:55:08.286: {0:9:102} getOracleHomeAttrib: oracle_home = /u01/app/grid/11.2.0.4
2014-03-04 16:55:08.288: {0:9:102} PID 5966 from /u01/app/grid/11.2.0.4/gpnp/init/node1.pid
2014-03-04 16:55:08.289: {0:9:102} CLSDM Based stop action
2014-03-04 16:55:08.292: {0:9:102} Using Timeout value of 18000 for stop message
2014-03-04 16:55:08.300: {0:9:102} clsdmc_respget return: status=0, ecode=0
2014-03-04 16:55:08.915: [ USRTHRD]{0:9:14} Thread:Daemon Select Thread exiting
2014-03-04 16:55:08.916: [ USRTHRD]{0:9:14} Thread:Skipping Agent Initiated a check action
2014-03-04 16:55:08.916: [ USRTHRD]{0:9:14} Thread:isRunning is reset to false here
2014-03-04 16:55:09.305: {0:9:102} (:CLSN00108:) clsn_agent::stop }
2014-03-04 16:55:09.306: [    AGFW]{0:9:102} Command: stop for resource: ora.gpnpd 1 1 completed with status: SUCCESS
2014-03-04 16:55:09.307: [    AGFW]{0:9:102} Agent sending reply for: RESOURCE_STOP ID 4099:1420
2014-03-04 16:55:09.308: TM is changing desired thread # to 5. Current # is 4
2014-03-04 16:55:09.492: [ COMMCRS]clsc_connect: (0x7f00dc176b70) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_GP
NPD))

Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_GPNPD)) with status 9
2014-03-04 16:55:09.492: {0:9:102} Error = error 9 encountered when connecting to GPNPD
2014-03-04 16:55:09.493: {0:9:102} Calling PID check for daemon
2014-03-04 16:55:09.493: {0:9:102} Process id 5966 translated to
2014-03-04 16:55:09.701: [ COMMCRS]clsc_connect: (0x7f00dc1762a0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_GP
NPD))

Fail to connect (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_GPNPD)) with status 9
2014-03-04 16:55:09.701: {0:9:102} Error = error 9 encountered when connecting to GPNPD
2014-03-04 16:55:09.703: [    AGFW]{0:9:102} ora.gpnpd 1 1 state changed from: STOPPING to: OFFLINE
2014-03-04 16:55:09.703: [    AGFW]{0:9:102} Agent sending last reply for: RESOURCE_STOP ID 4099:1420
2014-03-04 16:55:09.703: [    AGFW]{0:9:102} Agent has no resources to be monitored, Shutting down ..
2014-03-04 16:55:09.704: [    AGFW]{0:9:102} Agent sending message to PE: AGENT_SHUTDOWN_REQUEST ID 20486:1265
2014-03-04 16:55:09.717: [    AGFW]{0:9:103} Agent is shutting down.
2014-03-04 16:55:09.717: [    AGFW]{0:9:103} Agent is exiting with exit code: 1