Oracle数据库数据恢复、性能优化

找回密码
注册
搜索
热搜: 活动 交友 discuz
Oracle数据库数据恢复、性能优化»论坛 › Oracle › Oracle数据库管理 › 生产系统的一个节点CRS无法启动！
发新帖
swgsw

70

积分

0

好友

22

主题

[Exadata常规管理] 生产系统的一个节点CRS无法启动！

 关闭
1#
发表于 2013-1-25 09:57:58 | 查看: 10226| 回复: 53
数据库版本：oracle RAC  10.2.0.4   



klrqrac01->crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.

klrqrac01->crsctl check boot
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format

klrqrac01->ocrcheck
PROT-601: Failed to initialize ocrcheck

klrqrac01->crsctl check crs
Failure 1 contacting CSS daemon
Cannot communicate with CRS
Cannot communicate with EVM

crsd.log最后几行2013-01-23 08:31:29.171: [  CRSRES][1099577664]0startRunnable: setting CLI values
2013-01-23 08:31:29.904: [  CRSRES][1501923648]0Start of `ora.klrqrac02.LISTENER_KLRQRAC02.lsnr` on member `klrqrac02` succeeded.
2013-01-23 08:31:34.879: [  CRSRES][1499822400]0Start of `ora.klrqrac.klrqrac1.inst` on member `klrqrac01` succeeded.
2013-01-23 08:31:34.880: [  CRSRES][1499822400]0Skip online resource: ora.klrqrac01.LISTENER_KLRQRAC01.lsnr
2013-01-23 08:31:34.881: [  CRSRES][1499822400]0Skip online resource: ora.klrqrac01.ons
2013-01-23 08:31:34.882: [  CRSRES][1537595712]0Skip online resource: ora.klrqrac02.ons
2013-01-23 08:31:34.882: [  CRSRES][1535494464]0Skip online resource: ora.klrqrac.db
2013-01-23 08:31:34.950: [  CRSRES][1501923648]0startRunnable: setting CLI values
2013-01-23 08:31:34.954: [  CRSRES][1501923648]0Attempting to start `ora.klrqrac01.gsd` on member `klrqrac01`
2013-01-23 08:31:35.011: [  CRSRES][1499822400]0Attempting to start `ora.klrqrac02.gsd` on member `klrqrac02`
2013-01-23 08:31:35.341: [  CRSRES][1501923648]0Start of `ora.klrqrac01.gsd` on member `klrqrac01` succeeded.
2013-01-23 08:31:35.447: [  CRSRES][1499822400]0Start of `ora.klrqrac02.gsd` on member `klrqrac02` succeeded.


从另一个节点看

klrqrac02->ping klrqrac01-vip
PING klrqrac01-vip.klrq.com (10.143.128.49) 56(84) bytes of data.
64 bytes from klrqrac01-vip.klrq.com (10.143.128.49): icmp_seq=1 ttl=64 time=0.038 ms
64 bytes from klrqrac01-vip.klrq.com (10.143.128.49): icmp_seq=2 ttl=64 time=0.039 ms
64 bytes from klrqrac01-vip.klrq.com (10.143.128.49): icmp_seq=3 ttl=64 time=0.032 ms

--- klrqrac01-vip.klrq.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2000ms
rtt min/avg/max/mdev = 0.032/0.036/0.039/0.005 ms
klrqrac02->ping klrqrac01
PING klrqrac01.klrq.com (10.143.128.47) 56(84) bytes of data.
64 bytes from klrqrac01.klrq.com (10.143.128.47): icmp_seq=1 ttl=64 time=0.113 ms
64 bytes from klrqrac01.klrq.com (10.143.128.47): icmp_seq=2 ttl=64 time=0.095 ms

--- klrqrac01.klrq.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.095/0.104/0.113/0.009 ms
klrqrac02->ping klrqrac01-priv
PING klrqrac01-priv.klrq.com (192.168.1.47) 56(84) bytes of data.
64 bytes from klrqrac01-priv.klrq.com (192.168.1.47): icmp_seq=1 ttl=64 time=1.10 ms
64 bytes from klrqrac01-priv.klrq.com (192.168.1.47): icmp_seq=2 ttl=64 time=0.115 ms
64 bytes from klrqrac01-priv.klrq.com (192.168.1.47): icmp_seq=3 ttl=64 time=0.103 ms

--- klrqrac01-priv.klrq.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 0.103/0.442/1.108/0.470 ms
klrqrac02->crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.klrqrac.db application    ONLINE    ONLINE    klrqrac02   
ora....c1.inst application    OFFLINE   OFFLINE               
ora....c2.inst application    ONLINE    ONLINE    klrqrac02   
ora....SM1.asm application    OFFLINE   OFFLINE               
ora....01.lsnr application    OFFLINE   OFFLINE               
ora....c01.gsd application    OFFLINE   OFFLINE               
ora....c01.ons application    OFFLINE   OFFLINE               
ora....c01.vip application    ONLINE    ONLINE    klrqrac02   
ora....SM2.asm application    ONLINE    ONLINE    klrqrac02   
ora....02.lsnr application    ONLINE    ONLINE    klrqrac02   
ora....c02.gsd application    ONLINE    ONLINE    klrqrac02   
ora....c02.ons application    ONLINE    ONLINE    klrqrac02   
ora....c02.vip application    ONLINE    ONLINE    klrqrac02   
klrqrac02->crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy
klrqrac02->crsctl check boot
klrqrac02->ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          2
         Total space (kbytes)     :    1048100
         Used space (kbytes)      :       3852
         Available space (kbytes) :    1044248
         ID                       :  478487397
         Device/File Name         : /dev/raw/raw1
                                    Device/File integrity check succeeded

                                    Device/File not configured

         Cluster registry integrity check succeeded


请问大家还需要从那个方向排查？
2#
发表于 2013-1-25 10:12:52
兄弟，你启动报什么错？什么系统？把启动的ocssd.log和crsd.log拿出来看看！

回复 只看该作者 道具 举报

3#
发表于 2013-1-25 10:14:57
tail -f /var/log/messages

回复 只看该作者 道具 举报

4#
发表于 2013-1-25 10:32:04
[root@klrqrac01 /]# ps -ef|grep crs
root      9885     1  0 09:02 ?        00:00:00 /bin/sh /etc/init.d/init.crsd run
root     19136 10617  0 10:29 pts/1    00:00:00 grep crs

[root@klrqrac01 /]# /etc/init.d/init.crs start
Startup will be queued to init within 30 seconds.
[root@klrqrac01 /]# find /u01 -name ocssd.log
/u01/oracle/product/10.2.0.1/crs/log/klrqrac01/cssd/ocssd.log
[root@klrqrac01 /]# tail -f /u01/oracle/product/10.2.0.1/crs/log/klrqrac01/cssd/ocssd.log
[    CSSD]     memberNo =2, seq 1
[    CSSD]     flags = 0x1000, granted 0
[    CSSD]     refCnt = 1
[    CSSD]     nodeNum = 2, nodeBirth 2
[    CSSD]     privateDataSize = 0
[    CSSD]     publicDataSize = 0
[    CSSD]----------
[    CSSD]--- END OF GROCK STATE DUMP ---
[    CSSD]------- End Dump -------

回复 只看该作者 道具 举报

5#
发表于 2013-1-25 10:33:31
上传Node 1 crsd和ocssd日志文件。

回复 只看该作者 道具 举报

6#
发表于 2013-1-25 10:35:18
[root@klrqrac01 tmp]# pwd
/tmp
[root@klrqrac01 tmp]# ll
total 64
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.10101
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.10105
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.10123
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.10127
-rw-r--r-- 1 oracle oinstall    0 Jan 23 04:30 crsctl.606
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.8890
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.9017
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.9061
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.9949
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.9956
drwxr-xr-x 2 oracle oinstall 4096 Jan 25 09:40 hsperfdata_oracle
drwx------ 2 root   root     4096 Aug  6  2009 keyring-EImeKp
drwx------ 2 root   root     4096 Aug  6  2009 keyring-fWZXTJ
drwx------ 2 root   root     4096 Aug 26  2009 keyring-LSRKV5
drwx------ 2 root   root     4096 Jul  4  2009 keyring-N5Mm76
drwx------ 2 root   root     4096 Oct  7  2009 keyring-zhnFNN
srwxr-xr-x 1 oracle oinstall    0 Sep 19  2009 mapping-oracle
srwxr-xr-x 1 root   root        0 Oct  7  2009 mapping-root
-rw-r--r-- 1 root   root      243 Jan 25 09:01 modprobe.conf.pp
-rw------- 1 oracle oinstall    0 Jan 23 16:14 opAhSblrcj


[root@klrqrac01 tmp]# pwd
/tmp
[root@klrqrac01 tmp]# ll
total 64
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.10101
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.10105
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.10123
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.10127
-rw-r--r-- 1 oracle oinstall    0 Jan 23 04:30 crsctl.606
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.8890
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.9017
-rw-r--r-- 1 oracle oinstall  155 Jan 25 08:42 crsctl.9061
-rw-r--r-- 1 oracle oinstall   94 Jan 25 10:31 crsctl.9949
-rw-r--r-- 1 oracle oinstall   94 Jan 25 08:56 crsctl.9956
drwxr-xr-x 2 oracle oinstall 4096 Jan 25 09:40 hsperfdata_oracle
drwx------ 2 root   root     4096 Aug  6  2009 keyring-EImeKp
drwx------ 2 root   root     4096 Aug  6  2009 keyring-fWZXTJ
drwx------ 2 root   root     4096 Aug 26  2009 keyring-LSRKV5
drwx------ 2 root   root     4096 Jul  4  2009 keyring-N5Mm76
drwx------ 2 root   root     4096 Oct  7  2009 keyring-zhnFNN
srwxr-xr-x 1 oracle oinstall    0 Sep 19  2009 mapping-oracle
srwxr-xr-x 1 root   root        0 Oct  7  2009 mapping-root
-rw-r--r-- 1 root   root      243 Jan 25 09:01 modprobe.conf.pp
-rw------- 1 oracle oinstall    0 Jan 23 16:14 opAhSblrcj
[root@klrqrac01 tmp]# more crsctl.10127
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format
[root@klrqrac01 tmp]# more crsctl.10123
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format
[root@klrqrac01 tmp]# more crsctl.10105
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format
[root@klrqrac01 tmp]# more crsctl.10101
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format
[root@klrqrac01 tmp]# more crsctl.8890
OCR initialization failed accessing OCR device: PROC-26: Error while accessing the physical storage Operating System error [No such file or di
rectory] [2]

回复 只看该作者 道具 举报

7#
发表于 2013-1-25 10:41:15
本帖最后由 swgsw 于 2013-1-25 11:53 编辑

从时间上来看 crsctl.8890是 存储出现问题时候 报出的错。

但存储在10：00左右就恢复了！而且  从节点2上 ocrcheck 看ocr 也是正常的.

为什么？

现在节点一上的 /tmp 下的最新的 crsctl.10101 仍然报错
[root@klrqrac01 tmp]# more crsctl.10101
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format

回复 只看该作者 道具 举报

8#
发表于 2013-1-25 10:47:09
ocr的权限呢？另外，你dd下raw1看能读不能！

回复 只看该作者 道具 举报

9#
发表于 2013-1-25 10:48:15
从设备路径判断也都是一致的！

节点一

Pseudo name=emcpowerh
CLARiiON ID=CK200090900722 [RAC01]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
   3 qla2xxx                   sdb       SP B3     active  alive      0      0
   3 qla2xxx                   sdj       SP A2     active  alive      0      0
   4 qla2xxx                   sdr       SP B2     active  alive      0      0
   4 qla2xxx                   sdz       SP A3     active  alive      0      0


节点二

Pseudo name=emcpowera
CLARiiON ID=CK200090900722 [RAC02]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
   3 qla2xxx                   sdb       SP B3     active  alive      0      0
   3 qla2xxx                   sdj       SP A2     active  alive      0      0
   4 qla2xxx                   sdr       SP B2     active  alive      0      0
   4 qla2xxx                   sdz       SP A3     active  alive      0      0

回复 只看该作者 道具 举报

10#
发表于 2013-1-25 10:49:24
[root@klrqrac01 tmp]# tail -f /var/log/messages
Jan 25 10:44:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10101.
Jan 25 10:45:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10123.
Jan 25 10:45:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10101.
Jan 25 10:45:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.9949.
Jan 25 10:46:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10123.
Jan 25 10:46:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10101.
Jan 25 10:46:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.9949.
Jan 25 10:47:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10123.
Jan 25 10:47:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10101.
Jan 25 10:47:21 klrqrac01 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.9949.

回复 只看该作者 道具 举报

11#
发表于 2013-1-25 10:54:48
本帖最后由 swgsw 于 2013-1-25 11:52 编辑

节点一

crsd.log 日志
ocssd.log 日志

crsd.rar

91.31 KB, 下载次数: 1858

ocssd.rar

54.59 KB, 下载次数: 1869

回复 只看该作者 道具 举报

12#
发表于 2013-1-25 15:32:39
ocssd.log:
clssnmDiskPMT: stale disk (144500 ms) (0//dev/raw/raw2)
[    CSSD]2013-01-25 06:19:10.673 [1143953728] >ERROR:   clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable



你看看/dev/raw/raw2的权限和这个lun的是否可以dd??

回复 只看该作者 道具 举报

13#
发表于 2013-1-25 16:26:45
crsctl.9949
/etc/oracle

crsctl9949.rar

160 Bytes, 下载次数: 1901

crsctl.9949

oracle.rar

5.39 KB, 下载次数: 1877

/etc/oracle

回复 只看该作者 道具 举报

14#
发表于 2013-1-25 16:35:07
klrqrac01->dd if=/dev/raw/raw1 of=/tmp/123.log
38425+0 records in
38424+0 records out
19673088 bytes (20 MB) copied, 5.81868 seconds, 3.4 MB/s

klrqrac01->dd if=/dev/raw/raw2 of=/tmp/123.log
15503+0 records in
15503+0 records out
7937536 bytes (7.9 MB) copied, 2.34985 seconds, 3.4 MB/s

回复 只看该作者 道具 举报

15#
发表于 2013-1-25 16:38:18
OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format


上传 $CRS_HOME/log/<nodename>/client/cssNNN.log

回复 只看该作者 道具 举报

16#
发表于 2013-1-25 16:46:58
主机的盘是否发生过变化？加过盘？

回复 只看该作者 道具 举报

17#
发表于 2013-1-25 16:47:00
client目录 1月25日的cssnnn.log

client.rar

5.26 KB, 下载次数: 1849

回复 只看该作者 道具 举报

18#
发表于 2013-1-25 16:49:44
css571.log
  1. Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle.  All rights reserved.
  2. 2013-01-25 15:06:41.302: [  OCRRAW][2270210656]propriogid:1: INVALID FORMAT
  3. 2013-01-25 15:06:41.303: [  OCRRAW][2270210656]ibctx:1:ERROR: INVALID FORMAT
  4. 2013-01-25 15:06:41.303: [  OCRRAW][2270210656]proprinit:problem reading the bootblock or superbloc 22

  6. 2013-01-25 15:06:41.303: [ default][2270210656]a_init:7!: Backend init unsuccessful : [22]
  7. 2013-01-25 15:06:41.303: [ CSSCLNT][2270210656]clsssinit: error(22 PROC-22: The OCR backend has an invalid format) in OCR initialization
复制代码

回复 只看该作者 道具 举报

19#
发表于 2013-1-25 16:55:01
TRY:

su - root
ocrconfig –repair ocr /dev/raw/raw1

crsctl start crs

monitor   $CRS_HOME/log/<nodename>/client/cssNNN.log

回复 只看该作者 道具 举报

20#
发表于 2013-1-25 16:56:03
请问操作 会对  另外一个节点 造成影响吗？

回复 只看该作者 道具 举报

21#
发表于 2013-1-25 16:59:19
本帖最后由 Fixed 于 2013-1-25 17:02 编辑

klrqrac01->dd if=/dev/raw/raw1 of=/tmp/123.log
38425+0 records in
38424+0 records out
19673088 bytes (20 MB) copied, 5.81868 seconds, 3.4 MB/s

klrqrac02->ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          2
         Total space (kbytes)     :    1048100
         Used space (kbytes)      :       3852
         Available space (kbytes) :    1044248
         ID                       :  478487397
         Device/File Name         : /dev/raw/raw1

主机1与主机2对应的/dev/raw/raw1盘大小都不一样啊，一个1G，一个20M，肯定不是一块盘啊。

回复 只看该作者 道具 举报

22#
发表于 2013-1-25 17:02:50
vi ocrconfig_22033.log

Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle.  All rights reserved.
2013-01-25 16:58:20.649: [ OCRCONF][1500071104]ocrconfig starts...
2013-01-25 16:58:22.298: [ OCRCONF][1500071104]Successfully repair local OCR configuration
2013-01-25 16:58:22.298: [ OCRCONF][1500071104]Exiting [status=success]...

回复 只看该作者 道具 举报

23#
发表于 2013-1-25 17:06:23
把fdisk -l与raw1跟盘对应关系贴出来

回复 只看该作者 道具 举报

24#
发表于 2013-1-25 17:07:11
crsctl start crs

monitor   $CRS_HOME/log/<nodename>/client/cssNNN.log 、crsd.log、cssd.log

回复 只看该作者 道具 举报

25#
发表于 2013-1-25 17:09:42
中间动过存储，是不是lun分配给几个节点，导致盘符不一致？应该再查查存储。

回复 只看该作者 道具 举报

26#
发表于 2013-1-25 17:39:34
本帖最后由 swgsw 于 2013-1-25 17:43 编辑

[root@klrqrac01 bin]# ./crsctl start crs
Attempting to start CRS stack
The CRS stack will be started shortly

crsd.log 没有跟新  日期还是  1.23日


klrqrac01->ll -t|more
total 2400
-rw-r--r-- 1 oracle oinstall   385 Jan 25 17:02 clsc16.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 17:02 css572.log
-rw-r----- 1 root   root       338 Jan 25 16:58 ocrconfig_22033.log


klrqrac01->vi css572.log
Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle.  All rights reserved.
2013-01-25 17:02:28.116: [  OCRRAW][1343068768]propriogid:1: INVALID FORMAT
2013-01-25 17:02:28.121: [  OCRRAW][1343068768]ibctx:1:ERROR: INVALID FORMAT
2013-01-25 17:02:28.121: [  OCRRAW][1343068768]proprinit:problem reading the bootblock or superbloc 22

2013-01-25 17:02:28.121: [ default][1343068768]a_init:7!: Backend init unsuccessful : [22]
2013-01-25 17:02:28.122: [ CSSCLNT][1343068768]clsssinit: error(22 PROC-22: The OCR backend has an invalid format) in OCR initialization

回复 只看该作者 道具 举报

27#
发表于 2013-1-25 17:55:18

在2个节点上运行

cat /etc/sysconfig/rawdevices

回复 只看该作者 道具 举报

28#
发表于 2013-1-25 18:23:03
节点一

[root@klrqrac01 rules.d]# vi 60-raw.rules
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
#
# Enter raw device bindings here.
#
# An example would be:
#   ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"
# to bind /dev/raw/raw1 to /dev/sda, or
#   ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"
# to bind /dev/raw/raw2 to the device with major 8, minor 1.


ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", KERNEL=="emcpowerd1",RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="emcpowere1",RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="emcpowerf1",RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="emcpowerg1",RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", KERNEL=="emcpowerh1",RUN+="/bin/raw /dev/raw/raw7 %N"

KERNEL=="raw[1-7]", OWNER="oracle", GROUP="dba", MODE="660"
~


节点二

[root@klrqrac02 ~]# vi /etc/udev/rules.d/60-raw.rules
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
#
# Enter raw device bindings here.
#
# An example would be:
#   ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"
# to bind /dev/raw/raw1 to /dev/sda, or
#   ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"
# to bind /dev/raw/raw2 to the device with major 8, minor 1.

ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", KERNEL=="emcpowerd1",RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="emcpowere1",RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="emcpowerf1",RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="emcpowerg1",RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", KERNEL=="emcpowerh1",RUN+="/bin/raw /dev/raw/raw7 %N"

KERNEL=="raw[1-7]", OWNER="oracle", GROUP="dba", MODE="660"

回复 只看该作者 道具 举报

29#
发表于 2013-1-25 18:53:31
EMC powerpath  路径信息附件

emc_powerpath.txt

13.95 KB, 下载次数: 1605

回复 只看该作者 道具 举报

30#
发表于 2013-1-25 19:10:50
fdisk -l 两个节点的信息

fdisk .TXT

22.56 KB, 下载次数: 1599

回复 只看该作者 道具 举报

31#
发表于 2013-1-25 19:14:52
在2个节点上：

blkid  /dev/emcpowera1

1节点
dd if=/dev/raw/raw1   of=/tmp/ocr1.tmp  bs=1024k count=10

2节点
dd if=/dev/raw/raw1   of=/tmp/ocr2.tmp  bs=1024k count=10


比较这2个文件

diff /tmp/ocr2.tmp /tmp/ocr1.tmp

回复 只看该作者 道具 举报

32#
发表于 2013-1-25 19:27:37

[root@klrqrac01 client]# blkid /dev/emcpowera1
/dev/emcpowera1: LABEL="VOL5" TYPE="oracleasm"

[root@klrqrac02 dev]# blkid  /dev/emcpowera1
You have new mail in /var/spool/mail/root

[root@klrqrac01 tmp]# diff /tmp/ocr2.tmp /tmp/ocr1.tmp
Binary files /tmp/ocr2.tmp and /tmp/ocr1.tmp differ

回复 只看该作者 道具 举报

33#
发表于 2013-1-25 19:40:29
[root@klrqrac01 client]# blkid /dev/emcpowera1
/dev/emcpowera1: LABEL="VOL5" TYPE="oracleasm"

就这个结果看 1节点上的 /dev/emcpowera1 是 ASM ，应当是用ASMLIB lable的VOL5

如果是ocr 那么不应该LABEL="VOL5" TYPE="oracleasm"

回复 只看该作者 道具 举报

34#
发表于 2013-1-25 19:47:06
[root@klrqrac01 tmp]# blkid
/dev/sda6: LABEL="SWAP-sda6" TYPE="swap"
/dev/sda5: LABEL="/arc_des" UUID="e9467702-77c8-4a59-b340-9a658eef5d50" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda3: LABEL="/u01" UUID="0717eec2-5b70-41a8-9811-79b1267efb2d" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda2: LABEL="/backup" UUID="c96dbed1-4261-430a-bfb0-b9e8aa549793" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda1: LABEL="/" UUID="fac92198-39cb-4cb3-8cbe-8e2a74d6c0d4" SEC_TYPE="ext2" TYPE="ext3"
/dev/emcpowera1: LABEL="VOL5" TYPE="oracleasm"
/dev/sde1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdf1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdg1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdh1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdi1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdm1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdn1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdo1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdp1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdq1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdu1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdv1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdw1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdx1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdy1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdac1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdad1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdae1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdaf1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdag1: LABEL="VOL5" TYPE="oracleasm"
/dev/emcpowere1: LABEL="VOL1" TYPE="oracleasm"
/dev/emcpowerd1: LABEL="VOL2" TYPE="oracleasm"
/dev/emcpowerc1: LABEL="VOL3" TYPE="oracleasm"
/dev/emcpowerb1: LABEL="VOL4" TYPE="oracleasm"
You have new mail in /var/spool/mail/root

[root@klrqrac02 tmp]# blkid
/dev/sda6: LABEL="/backup" UUID="79545bba-6941-4327-9684-fdc6395ba05d" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda5: LABEL="SWAP-sda5" TYPE="swap"
/dev/sda3: LABEL="/arc_des" UUID="05e691b6-0ef7-4d4a-af2a-43354fe32b10" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda2: LABEL="/u01" UUID="ee9710a9-836d-4f8c-b7d9-6dced3cb96a0" SEC_TYPE="ext2" TYPE="ext3"
/dev/sda1: LABEL="/" UUID="9cc2c7ed-730c-4ebf-9457-8fadccd7af52" SEC_TYPE="ext2" TYPE="ext3"
/dev/sde1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdf1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdg1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdh1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdi1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdm1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdn1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdo1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdp1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdq1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdu1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdv1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdw1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdx1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdy1: LABEL="VOL5" TYPE="oracleasm"
/dev/sdac1: LABEL="VOL1" TYPE="oracleasm"
/dev/sdad1: LABEL="VOL2" TYPE="oracleasm"
/dev/sdae1: LABEL="VOL3" TYPE="oracleasm"
/dev/sdaf1: LABEL="VOL4" TYPE="oracleasm"
/dev/sdag1: LABEL="VOL5" TYPE="oracleasm"
/dev/emcpowerd1: LABEL="VOL1" TYPE="oracleasm"
/dev/emcpowere1: LABEL="VOL2" TYPE="oracleasm"
/dev/emcpowerf1: LABEL="VOL3" TYPE="oracleasm"
/dev/emcpowerg1: LABEL="VOL4" TYPE="oracleasm"
/dev/emcpowerh1: LABEL="VOL5" TYPE="oracleasm"
You have new mail in /var/spool/mail/root

回复 只看该作者 道具 举报

35#
发表于 2013-1-25 19:49:14
1节点 /dev/emcpowere1: LABEL="VOL1" TYPE="oracleasm"
2 节点  /dev/emcpowere1: LABEL="VOL2" TYPE="oracleasm"

可见LUN 名字是乱掉了

回复 只看该作者 道具 举报

36#
发表于 2013-1-25 20:03:54
在2个节点上

ls -l /dev/emc*


回复 只看该作者 道具 举报

37#
发表于 2013-1-25 20:04:45
我有个疑问： ocr 直接用的是 /dev/raw/raw1  与raw 绑定有关系吗？

回复 只看该作者 道具 举报

38#
发表于 2013-1-25 20:05:35
[root@klrqrac01 tmp]# ls -l /dev/emc*
crw-r--r-- 1 root root  10,  62 Jan 25 09:01 /dev/emcpower
brw-r----- 1 root disk 120,   0 Jan 25 09:01 /dev/emcpowera
brw-r----- 1 root disk 120,   1 Jan 25 09:01 /dev/emcpowera1
brw-r----- 1 root disk 120,  16 Jan 25 09:01 /dev/emcpowerb
brw-r----- 1 root disk 120,  17 Jan 25 09:01 /dev/emcpowerb1
brw-r----- 1 root disk 120,  32 Jan 25 09:01 /dev/emcpowerc
brw-r----- 1 root disk 120,  33 Jan 25 09:01 /dev/emcpowerc1
brw-r----- 1 root disk 120,  48 Jan 25 09:01 /dev/emcpowerd
brw-r----- 1 root disk 120,  49 Jan 25 09:01 /dev/emcpowerd1
brw-r----- 1 root disk 120,  64 Jan 25 09:01 /dev/emcpowere
brw-r----- 1 root disk 120,  65 Jan 25 09:01 /dev/emcpowere1
brw-r----- 1 root disk 120,  80 Jan 25 09:01 /dev/emcpowerf
brw-r----- 1 root disk 120,  81 Jan 25 09:01 /dev/emcpowerf1
brw-r----- 1 root disk 120,  96 Jan 25 09:01 /dev/emcpowerg
brw-r----- 1 root disk 120,  97 Jan 25 09:01 /dev/emcpowerg1
brw-r----- 1 root disk 120, 112 Jan 25 09:01 /dev/emcpowerh
brw-r----- 1 root disk 120, 113 Jan 25 09:01 /dev/emcpowerh1

klrqrac02->ls -l /dev/emc*
crw-r--r-- 1 root root  10,  62 Jan 25 09:03 /dev/emcpower
brw-r----- 1 root disk 120,   0 Jan 25 09:03 /dev/emcpowera
brw-r----- 1 root disk 120,   1 Jan 25 09:03 /dev/emcpowera1
brw-r----- 1 root disk 120,  16 Jan 25 09:03 /dev/emcpowerb
brw-r----- 1 root disk 120,  17 Jan 25 09:03 /dev/emcpowerb1
brw-r----- 1 root disk 120,  32 Jan 25 09:03 /dev/emcpowerc
brw-r----- 1 root disk 120,  33 Jan 25 09:03 /dev/emcpowerc1
brw-r----- 1 root disk 120,  48 Jan 25 09:03 /dev/emcpowerd
brw-r----- 1 root disk 120,  49 Jan 25 09:03 /dev/emcpowerd1
brw-r----- 1 root disk 120,  64 Jan 25 09:03 /dev/emcpowere
brw-r----- 1 root disk 120,  65 Jan 25 09:03 /dev/emcpowere1
brw-r----- 1 root disk 120,  80 Jan 25 09:03 /dev/emcpowerf
brw-r----- 1 root disk 120,  81 Jan 25 09:03 /dev/emcpowerf1
brw-r----- 1 root disk 120,  96 Jan 25 09:03 /dev/emcpowerg
brw-r----- 1 root disk 120,  97 Jan 25 09:03 /dev/emcpowerg1
brw-r----- 1 root disk 120, 112 Jan 25 09:03 /dev/emcpowerh
brw-r----- 1 root disk 120, 113 Jan 25 09:03 /dev/emcpowerh1

回复 只看该作者 道具 举报

39#
发表于 2013-1-25 20:07:40
在2个节点上运行
  1. for i in a b c d e f g h i j ;
  2. do
  3. echo "emcpower$i" "`scsi_id -g -u -s /block/emcpower$i` ";
  4. done
复制代码

回复 只看该作者 道具 举报

40#
发表于 2013-1-25 20:09:29
[root@klrqrac01 tmp]# for i in a b c d e f g h i j ;
> do
> echo "emcpower$i" "`scsi_id -g -u -s /block/emcpower$i` ";
> done
emcpowera  
emcpowerb  
emcpowerc  
emcpowerd  
emcpowere  
emcpowerf  
emcpowerg  
emcpowerh  
emcpoweri  
emcpowerj  

[root@klrqrac02 tmp]# for i in a b c d e f g h i j ;
> do
> echo "emcpower$i" "`scsi_id -g -u -s /block/emcpower$i` ";
> done
emcpowera  
emcpowerb  
emcpowerc  
emcpowerd  
emcpowere  
emcpowerf  
emcpowerg  
emcpowerh  
emcpoweri  
emcpowerj

回复 只看该作者 道具 举报

41#
发表于 2013-1-25 20:11:14
scsi_id -g -u -s /block/emcpowera

没有结果吗？

回复 只看该作者 道具 举报

42#
发表于 2013-1-25 20:11:24
本帖最后由 lhl1212 于 2013-1-25 20:13 编辑

Pseudo name=emcpowerh
CLARiiON ID=CK200090900722 [RAC01]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]



Pseudo name=emcpowera
CLARiiON ID=CK200090900722 [RAC02]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]


两个节点磁盘不一致。

回复 只看该作者 道具 举报

43#
发表于 2013-1-25 20:15:36
试试

1节点

raw /dev/raw/raw1 /dev/emcpowerh

回复 只看该作者 道具 举报

44#
发表于 2013-1-25 20:22:09
Pseudo name=emcpowerh
CLARiiON ID=CK200090900722 [RAC01]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
   3 qla2xxx                   sdb       SP B3     active  alive      0      0
   3 qla2xxx                   sdj       SP A2     active  alive      0      0
   4 qla2xxx                   sdr       SP B2     active  alive      0      0
   4 qla2xxx                   sdz       SP A3     active  alive      0      0

Pseudo name=emcpowerg
CLARiiON ID=CK200090900722 [RAC01]
Logical device ID=6006016002602400CBD3BB6CC77DDE11 [LUN 1 (Voting)]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP A       Array failover mode: 1
==============================================================================
---------------- Host ---------------   - Stor -   -- I/O Path -  -- Stats ---
###  HW Path                I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
   4 qla2xxx                   sdaa      SP A3     active  alive      0      0
   3 qla2xxx                   sdc       SP B3     active  alive      0      0
   3 qla2xxx                   sdk       SP A2     active  alive      0      0
   4 qla2xxx                   sds       SP B2     active  alive      0      0

是不是 在节点一 修改 vi /etc/udev/rules.d/60-raw.rules

原始为：



ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", KERNEL=="emcpowerd1",RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="emcpowere1",RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="emcpowerf1",RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="emcpowerg1",RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", KERNEL=="emcpowerh1",RUN+="/bin/raw /dev/raw/raw7 %N"

KERNEL=="raw[1-7]", OWNER="oracle", GROUP="dba", MODE="660"

修改为：

ACTION=="add", KERNEL=="emcpowerh1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerg1",RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", KERNEL=="emcpowerd1",RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="emcpowere1",RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="emcpowerf1",RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw7 %N"

不知是否正确，听取版主意见？

回复 只看该作者 道具 举报

45#
发表于 2013-1-25 20:25:23
[root@klrqrac01 tmp]# raw /dev/raw/raw1 /dev/emcpowerh
/dev/raw/raw1:  bound to major 120, minor 112

回复 只看该作者 道具 举报

46#
发表于 2013-1-25 20:37:58
[root@klrqrac01 crsd]# ll
total 89212
-rw------- 1 root root 566378496 Jan 23 04:30 core.10763
-rw------- 1 root root 494215168 Jan 23 08:25 core.31213
-rw-r--r-- 1 root root   5457117 Jan 23 08:31 crsd.log

[root@klrqrac01 client]# ll -t|more
total 2400
-rw-r--r-- 1 oracle oinstall   385 Jan 25 17:02 clsc16.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 17:02 css572.log
-rw-r----- 1 root   root       338 Jan 25 16:58 ocrconfig_22033.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 15:06 clsc15.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 15:06 css571.log
-rw-r--r-- 1 oracle oinstall   381 Jan 25 11:31 clsc14.log
-rw-r--r-- 1 oracle oinstall   586 Jan 25 11:31 css570.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 10:24 clsc13.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 10:24 css569.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 09:41 clsc12.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 09:41 css568.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 09:33 clsc11.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 09:33 css567.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 09:31 css566.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 09:31 clsc10.log
-rw-r--r-- 1 oracle oinstall   586 Jan 25 09:31 css565.log
-rw-r--r-- 1 oracle oinstall   385 Jan 25 09:18 clsc9.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 09:18 css564.log
-rw-r--r-- 1 oracle oinstall   186 Jan 23 16:14 css562.log

回复 只看该作者 道具 举报

47#
发表于 2013-1-25 20:55:58
[root@klrqrac01 client]# ll -t|more
total 2404
-rw-r--r-- 1 oracle oinstall   277 Jan 25 20:51 clsc17.log
-rw-r--r-- 1 oracle oinstall   385 Jan 25 17:02 clsc16.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 17:02 css572.log
-rw-r----- 1 root   root       338 Jan 25 16:58 ocrconfig_22033.log
-rw-r--r-- 1 oracle oinstall   383 Jan 25 15:06 clsc15.log
-rw-r--r-- 1 oracle oinstall   591 Jan 25 15:06 css571.log

[root@klrqrac01 client]# vi clsc17.log

Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle.  All rights reserved.
2013-01-25 20:51:16.914: [ CSSCLNT][1637156080]clsssInitNative: connect failed, rc 9

2013-01-25 20:51:19.577: [ CSSCLNT][1637156080]clsssInitNative: connect failed, rc 9




[root@klrqrac01 crsd]# tail -f crsd.log
2013-01-25 20:51:26.382: [  CRSRES][1490684224]0Attempting to stop `ora.klrqrac01.vip` on member `klrqrac02`
2013-01-25 20:51:26.814: [  CRSRES][1490684224]0Stop of `ora.klrqrac01.vip` on member `klrqrac02` succeeded.
2013-01-25 20:51:26.902: [  CRSRES][1490684224]0startRunnable: setting CLI values
2013-01-25 20:51:26.902: [  CRSRES][1490684224]0Attempting to start `ora.klrqrac01.vip` on member `klrqrac01`
2013-01-25 20:51:30.862: [  CRSRES][1490684224]0Start of `ora.klrqrac01.vip` on member `klrqrac01` succeeded.
2013-01-25 20:51:31.091: [  CRSRES][1490684224]0startRunnable: setting CLI values
2013-01-25 20:51:31.107: [  CRSRES][1490684224]0Attempting to start `ora.klrqrac01.ASM1.asm` on member `klrqrac01`
2013-01-25 20:51:31.400: [  CRSRES][1524255040]0startRunnable: setting CLI values
2013-01-25 20:51:31.739: [  CRSRES][1524255040]0Attempting to start `ora.klrqrac01.LISTENER_KLRQRAC01.lsnr` on member `klrqrac01`
2013-01-25 20:51:35.477: [  CRSRES][1524255040]0Start of `ora.klrqrac01.LISTENER_KLRQRAC01.lsnr` on member `klrqrac01` succeeded.
2013-01-25 20:51:41.711: [  CRSRES][1524255040]0startRunnable: setting CLI values
2013-01-25 20:51:42.061: [  CRSRES][1524255040]0Attempting to start `ora.klrqrac01.ons` on member `klrqrac01`
2013-01-25 20:51:43.773: [  CRSRES][1524255040]0Start of `ora.klrqrac01.ons` on member `klrqrac01` succeeded.
2013-01-25 20:51:43.923: [  CRSRES][1490684224]0Start of `ora.klrqrac01.ASM1.asm` on member `klrqrac01` succeeded.
2013-01-25 20:51:44.300: [  CRSRES][1490684224]0startRunnable: setting CLI values
2013-01-25 20:51:44.308: [  CRSRES][1490684224]0Attempting to start `ora.klrqrac.klrqrac1.inst` on member `klrqrac01`
2013-01-25 20:51:55.087: [  CRSAPP][1490684224]0StartResource error for ora.klrqrac.klrqrac1.inst error code = 1
2013-01-25 20:51:57.850: [  CRSRES][1490684224]0Start of `ora.klrqrac.klrqrac1.inst` on member `klrqrac01` failed.
2013-01-25 20:51:57.884: [  CRSRES][1490684224]0Skip online resource: ora.klrqrac01.LISTENER_KLRQRAC01.lsnr
2013-01-25 20:51:57.884: [  CRSRES][1091582272]0Skip online resource: ora.klrqrac01.ons
2013-01-25 20:51:58.060: [  CRSRES][1490684224]0startRunnable: setting CLI values
2013-01-25 20:51:58.068: [  CRSRES][1490684224]0Attempting to start `ora.klrqrac01.gsd` on member `klrqrac01`
2013-01-25 20:51:58.583: [  CRSRES][1490684224]0Start of `ora.klrqrac01.gsd` on member `klrqrac01` succeeded.


回复 只看该作者 道具 举报

48#
发表于 2013-1-25 20:59:43
Good,虽然有些波折 但还是解决了， 让emc的人建议下 绑定设备的方案吧，避免再次发生！！！

回复 只看该作者 道具 举报

49#
发表于 2013-1-25 20:59:46
Good,虽然有些波折 但还是解决了， 让emc的人建议下 绑定设备的方案吧，避免再次发生！！！

回复 只看该作者 道具 举报

50#
发表于 2013-1-25 21:32:49
故障解决

故障原因： 由于两个节点的OCR powerpath  对应的路径名称不一致造成的故障。

在节点一下的
/etc/udev/rules.d/60-raw.rules
ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw2 %N"
是emcpowera1 对应 /dev/raw/raw1 是问题的故障点所在。


与
EMC powerpath
对应的设备名称不一致

Pseudo name=emcpowerh
CLARiiON ID=CK200090900722 [RAC01]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]

Pseudo name=emcpowera
CLARiiON ID=CK200090900722 [RAC02]
Logical device ID=6006016002602400CAD3BB6CC77DDE11 [LUN 0 (OCR REG)]

故障修复操作如下：


1、   raw /dev/raw/raw1 /dev/emcpowerh1
2、   crsctl start crs

观察
monitor   $CRS_HOME/log/<nodename>/client/cssNNN.log 、crsd.log、cssd.log

最后修改节点一
/etc/udev/rules.d/60-raw.rules


ACTION=="add", KERNEL=="emcpowera1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerb1",RUN+="/bin/raw /dev/raw/raw2 %N"


为


ACTION=="add", KERNEL=="emcpowerh1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="emcpowerg1",RUN+="/bin/raw /dev/raw/raw2 %N"

ok了

回复 只看该作者 道具 举报

下一页 »
12下一页
返回列表
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

QQ|手机版|Archiver|Oracle数据库数据恢复、性能优化

GMT+8, 2024-12-27 00:11 , Processed in 0.065793 second(s), 23 queries .

Powered by Discuz! X2.5

© 2001-2012 Comsenz Inc.

回顶部
TEL/電話+86 13764045638
Email service@parnassusdata.com
QQ 47079569