vmware 安装rac失败

gtlions

环境是red hat5.4+oracle10gr2，虚拟机是vmware workstation，在dbca的时候在节点2一直无法mount diskgroup，请看下面信息：
1、启动结果：
节点1启动
SQL> startup
ASM instance started

Total System Global Area   92274688 bytes
Fixed Size            1217884 bytes
Variable Size           65890980 bytes
ASM Cache           25165824 bytes
ASM diskgroups mounted

SQL> show parameter asm

NAME                     TYPE     VALUE
------------------------------------ -------- ------------------------------
asm_diskgroups                 string   DG1, DG2
asm_diskstring                 string   /dev/raw/raw3, /dev/raw/raw4,
                          /dev/raw/raw5, /dev/raw/raw6
asm_power_limit              integer  1

节点2启动
SQL> startup
ASM instance started

Total System Global Area   92274688 bytes
Fixed Size            1217884 bytes
Variable Size           65890980 bytes
ASM Cache           25165824 bytes
ORA-15032: not all alterations performed
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DG2"
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DG1"

SQL> show parameter asm

NAME                     TYPE     VALUE
------------------------------------ -------- ------------------------------
asm_diskgroups                 string   DG1, DG2
asm_diskstring                 string   /dev/raw/raw3, /dev/raw/raw4,
                          /dev/raw/raw5, /dev/raw/raw6
asm_power_limit              integer  1

2、裸设备信息
节点1信息
[root@R1 bdump]# ll /dev/raw
总计 0
crw-rw---- 1 oracle oinstall 162, 1 11-28 15:00 raw1
crw-rw---- 1 oracle oinstall 162, 2 11-28 16:55 raw2
crw-rw---- 1 oracle oinstall 162, 3 11-28 16:55 raw3
crw-rw---- 1 oracle oinstall 162, 4 11-28 16:55 raw4
crw-rw---- 1 oracle oinstall 162, 5 11-28 16:11 raw5
crw-rw---- 1 oracle oinstall 162, 6 11-28 16:11 raw6
节点2信息
[root@R2 bdump]# ll /dev/raw
总计 0
crw-rw---- 1 oracle oinstall 162, 1 11-28 16:54 raw1
crw-rw---- 1 oracle oinstall 162, 2 11-28 16:55 raw2
crw-rw---- 1 oracle oinstall 162, 3 11-28 16:24 raw3
crw-rw---- 1 oracle oinstall 162, 4 11-28 16:11 raw4
crw-rw---- 1 oracle oinstall 162, 5 11-28 16:11 raw5
crw-rw---- 1 oracle oinstall 162, 6 11-28 16:11 raw6

3、后台日志
节点1日志
Mon Nov 28 16:50:37 2011
Starting ORACLE instance (normal)
Cannot determine all dependent dynamic libraries for /proc/self/exe
Unable to find dynamic library libocr10.so in search paths
RPATH = /ade/aime1_build2101/oracle/has/lib/:/ade/aime1_build2101/oracle/lib/:/ade/aime1_build2101/oracle/has/lib/:
LD_LIBRARY_PATH = /opt/app/product/10.2.0/db_1/bin:/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin/
The default library directories are /lib and /usr/lib
Unable to find dynamic library libocrb10.so in search paths
Unable to find dynamic library libocrutl10.so in search paths
Unable to find dynamic library libocrutl10.so in search paths
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.145.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 192.168.2.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_1 parameter default value as /opt/app/product/10.2.0/db_1/dbs/arch
Autotune of undo retention is turned off.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.1.0.
System parameters with non-default values:
  large_pool_size          = 12582912
  instance_type            = asm
  cluster_database         = TRUE
  instance_number          = 1
  remote_login_passwordfile= EXCLUSIVE
  background_dump_dest     = /opt/app/admin/+ASM/bdump
  user_dump_dest           = /opt/app/admin/+ASM/udump
  core_dump_dest           = /opt/app/admin/+ASM/cdump
  asm_diskstring           = /dev/raw/raw3, /dev/raw/raw4, /dev/raw/raw5, /dev/raw/raw6
  asm_diskgroups           = DG1, DG2
Cluster communication is configured to use the following interface(s) for this instance
  192.168.145.204
Mon Nov 28 16:50:37 2011
cluster interconnect IPC version:Oracle UDP/IP
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=12528
DIAG started with pid=3, OS id=12530
PSP0 started with pid=4, OS id=12534
LMON started with pid=5, OS id=12536
LMD0 started with pid=6, OS id=12538
LMS0 started with pid=7, OS id=12551
MMAN started with pid=8, OS id=12561
DBW0 started with pid=9, OS id=12563
LGWR started with pid=10, OS id=12565
CKPT started with pid=11, OS id=12567
SMON started with pid=12, OS id=12569
RBAL started with pid=13, OS id=12571
GMON started with pid=14, OS id=12573
Mon Nov 28 16:50:37 2011
lmon registered with NM - instance id 1 (internal mem no 0)
Mon Nov 28 16:50:38 2011
Reconfiguration started (old inc 0, new inc 1)
ASM instance
List of nodes:
0 1
Global Resource Directory frozen
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Mon Nov 28 16:50:39 2011
LMS 0: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Post SMON to start 1st pass IR
Mon Nov 28 16:50:39 2011
LMS 0: 0 GCS shadows traversed, 0 replayed
Mon Nov 28 16:50:39 2011
Submitted all GCS remote-cache requests
Post SMON to start 1st pass IR
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=15, OS id=12600
Mon Nov 28 16:50:40 2011
SQL> ALTER DISKGROUP ALL MOUNT
Mon Nov 28 16:50:40 2011
NOTE: cache registered group DG1 number=1 incarn=0x271dc177
NOTE: cache registered group DG2 number=2 incarn=0x272dc178
Mon Nov 28 16:50:40 2011
Loaded ASM Library - Generic Linux, version 2.0.4 (KABI_V2) library for asmlib interface
Mon Nov 28 16:50:40 2011
NOTE: Hbeat: instance first (grp 1)
Mon Nov 28 16:50:40 2011
NOTE: Hbeat: instance first (grp 2)
Mon Nov 28 16:50:44 2011
NOTE: start heartbeating (grp 1)
NOTE: cache opening disk 0 of grp 1: DG1_0000 path:/dev/raw/raw3
Mon Nov 28 16:50:44 2011
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache mounting (first) group 1/0x271DC177 (DG1)
* allocate domain 1, invalid = TRUE
kjbdomatt send to node 1
Mon Nov 28 16:50:44 2011
NOTE: attached to recovery domain 1
Mon Nov 28 16:50:44 2011
NOTE: cache recovered group 1 to fcn 0.8
Mon Nov 28 16:50:44 2011
NOTE: opening chunk 1 at fcn 0.8 ABA
NOTE: seq=4 blk=4
Mon Nov 28 16:50:44 2011
NOTE: cache mounting group 1/0x271DC177 (DG1) succeeded
SUCCESS: diskgroup DG1 was mounted
Mon Nov 28 16:50:44 2011
NOTE: start heartbeating (grp 2)
NOTE: cache opening disk 0 of grp 2: DG2_0000 path:/dev/raw/raw4
Mon Nov 28 16:50:44 2011
NOTE: F1X0 found on disk 0 fcn 0.0
NOTE: cache mounting (first) group 2/0x272DC178 (DG2)
* allocate domain 2, invalid = TRUE
kjbdomatt send to node 1
Mon Nov 28 16:50:45 2011
NOTE: attached to recovery domain 2
Mon Nov 28 16:50:45 2011
NOTE: cache recovered group 2 to fcn 0.4
Mon Nov 28 16:50:45 2011
NOTE: opening chunk 1 at fcn 0.4 ABA
NOTE: seq=3 blk=2
Mon Nov 28 16:50:45 2011
NOTE: cache mounting group 2/0x272DC178 (DG2) succeeded
SUCCESS: diskgroup DG2 was mounted
Mon Nov 28 16:50:46 2011
NOTE: recovering COD for group 1/0x271dc177 (DG1)
SUCCESS: completed COD recovery for group 1/0x271dc177 (DG1)
NOTE: recovering COD for group 2/0x272dc178 (DG2)
SUCCESS: completed COD recovery for group 2/0x272dc178 (DG2)

节点2日志
[root@R2 bdump]# cat alert_+ASM2.log
Mon Nov 28 16:50:36 2011
Starting ORACLE instance (normal)
Cannot determine all dependent dynamic libraries for /proc/self/exe
Unable to find dynamic library libocr10.so in search paths
RPATH = /ade/aime1_build2101/oracle/has/lib/:/ade/aime1_build2101/oracle/lib/:/ade/aime1_build2101/oracle/has/lib/:
LD_LIBRARY_PATH = /opt/app/product/10.2.0/db_1/bin:/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin/
The default library directories are /lib and /usr/lib
Unable to find dynamic library libocrb10.so in search paths
Unable to find dynamic library libocrutl10.so in search paths
Unable to find dynamic library libocrutl10.so in search paths
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 192.168.145.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 192.168.2.0 configured from OCR for use as  a public interface
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_1 parameter default value as /opt/app/product/10.2.0/db_1/dbs/arch
Autotune of undo retention is turned off.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.1.0.
System parameters with non-default values:
  large_pool_size          = 12582912
  instance_type            = asm
  cluster_database         = TRUE
  instance_number          = 2
  remote_login_passwordfile= EXCLUSIVE
  background_dump_dest     = /opt/app/admin/+ASM/bdump
  user_dump_dest           = /opt/app/admin/+ASM/udump
  core_dump_dest           = /opt/app/admin/+ASM/cdump
  asm_diskstring           = /dev/raw/raw3, /dev/raw/raw4, /dev/raw/raw5, /dev/raw/raw6
  asm_diskgroups           = DG1, DG2
Cluster communication is configured to use the following interface(s) for this instance
  192.168.145.205
Mon Nov 28 16:50:36 2011
cluster interconnect IPC version:Oracle UDP/IP
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=9496
DIAG started with pid=3, OS id=9498
PSP0 started with pid=4, OS id=9521
LMON started with pid=5, OS id=9523
LMD0 started with pid=6, OS id=9525
LMS0 started with pid=7, OS id=9530
MMAN started with pid=8, OS id=9552
DBW0 started with pid=9, OS id=9556
LGWR started with pid=10, OS id=9558
CKPT started with pid=11, OS id=9560
SMON started with pid=12, OS id=9562
RBAL started with pid=13, OS id=9564
GMON started with pid=14, OS id=9566
Mon Nov 28 16:50:36 2011
lmon registered with NM - instance id 2 (internal mem no 1)
Mon Nov 28 16:50:36 2011
Reconfiguration started (old inc 0, new inc 1)
ASM instance
List of nodes:
0 1
Global Resource Directory frozen
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Mon Nov 28 16:50:38 2011
LMS 0: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Mon Nov 28 16:50:38 2011
LMS 0: 0 GCS shadows traversed, 0 replayed
Mon Nov 28 16:50:38 2011
Submitted all GCS remote-cache requests
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=15, OS id=9593
Mon Nov 28 16:50:38 2011
SQL> ALTER DISKGROUP ALL MOUNT
Mon Nov 28 16:50:38 2011
NOTE: cache registered group DG1 number=1 incarn=0x271dc314
* allocate domain 1, invalid = TRUE
Mon Nov 28 16:50:44 2011
NOTE: cache registered group DG2 number=2 incarn=0x272dc315
* allocate domain 2, invalid = TRUE
Mon Nov 28 16:50:44 2011
Loaded ASM Library - Generic Linux, version 2.0.4 (KABI_V2) library for asmlib interface
Mon Nov 28 16:50:44 2011
ERROR: no PST quorum in group 1: required 1, found 0
Mon Nov 28 16:50:44 2011
NOTE: cache dismounting group 1/0x271DC314 (DG1)
NOTE: dbwr not being msg'd to dismount
ERROR: diskgroup DG1 was not mounted
Mon Nov 28 16:50:44 2011
ERROR: no PST quorum in group 2: required 1, found 0
Mon Nov 28 16:50:44 2011
NOTE: cache dismounting group 2/0x272DC315 (DG2)
NOTE: dbwr not being msg'd to dismount
ERROR: diskgroup DG2 was not mounted

gtlions

我做的方式和你的区别是？

Maclean Liu(刘相兵

不建议使用裸设备作为共享存储设备的解决方案。

使用udev更方便， 见利用UDEV服务解决RAC ASM存储设备名 http://www.oracledatabase12g.com ... sm-device-name.html

gtlions

以前成功做过的版本是宿主机win7 x64+vmware workstation 7+red hat5.6+oracle10gr1
现在失败的版本是宿主机xp sp3+vmware workstation 7+red hat5.4+oracle10gr1
使用的是同一个操作文档按步骤操作的

gtlions

酱油兄说的权限问题，我的定义方法如下：
vi /etc/udev/rules.d/60-raw.rules
注意，如果写入这个文件之后还是无法正常使用裸设备，那么可以直接写入到/etc/rc.d/rc.local启动自动加载，而不使用udev来管理裸设备设置。
增加如下内容：
ACTION=="add", KERNEL=="/dev/sdb1",RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="17",RUN+="/bin/raw /dev/raw/raw1 %M %m"
ACTION=="add", KERNEL=="/dev/sdc1",RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="33",RUN+="/bin/raw /dev/raw/raw2 %M %m"
ACTION=="add", KERNEL=="/dev/sdd1",RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="49",RUN+="/bin/raw /dev/raw/raw3 %M %m"
ACTION=="add", KERNEL=="/dev/sde1",RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="65",RUN+="/bin/raw /dev/raw/raw4 %M %m"
ACTION=="add", KERNEL=="/dev/sddf",RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="81",RUN+="/bin/raw /dev/raw/raw5 %M %m"
ACTION=="add", KERNEL=="/dev/sdg1",RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", ENV{MAJOR}=="8",ENV{MINOR}=="97",RUN+="/bin/raw /dev/raw/raw5 %M %m"
KERNEL=="raw[1-6]", OWNER="oracle", GROUP="oinstall", MODE="640"

MODE后来改成660了

gtlions

帮忙look下，看看还需要什么信息。
搭建用的虚拟机版本我在我本机win7下是成功做过的，我本机的环境是vmware workstation 7+red hat5.6.
这次用的是red hat5.4，数据库是同一个版本。