10g rac private 的疑问

2^#

发表于 2012-4-13 13:29:56

action plan:

贴出以下命令的输出

cat /etc/hosts

oifcfg getif -global

sqlplus / as sysdba

show parameter cluster

select * from v$version;
select * from V$CLUSTER_INTERCONNECTS;

3^#

发表于 2012-4-13 13:33:43

回复 2# 的帖子

cat /etc/hosts
1.1.1.1    pjdb1_priv1
1.1.2.1    pjdb1_priv2
1.1.3.1    pjdb1_priv3

192.168.100.1 pjdb1_vip
192.168.100.3 pjdb1

1.1.1.2    pjdb2_priv1
1.1.2.2    pjdb2_priv2
1.1.3.2    pjdb2_priv3

192.168.100.2 pjdb2_vip
192.168.100.4 pjdb2

192.168.123.90  pjsb
192.168.101.14  bakboneserver
192.168.100.201 rongzaidb

oifcfg getif -global
没有信息

show parameter cluster

SQL> show parameter cluster

NAME                               TYPE       VALUE
------------------------------------ ----------- ------------------------------
cluster_database                   boolean    TRUE
cluster_database_instances          integer    2
cluster_interconnects             string

SQL> select * from  V$CLUSTER_INTERCONNECTS;

NAME          IP_ADDRESS    IS_ SOURCE
--------------- ---------------- --- -------------------------------
en2          192.168.100.3 NO  OS dependent software

4^#

发表于 2012-4-13 13:44:45

OS dependent software ==> RAC目前使用 192.168.100.3  这个public ip 作为 interconnect private network ，且这个network是 OS自行找出的

即 RAC private network 没有使用 pjdb1_priv(1.1.1.0)的网段，

1.1.1.1    pjdb1_priv1
1.1.2.1    pjdb1_priv2
1.1.3.1    pjdb1_priv3

这里三个private ip 位于三个网段中，同样不建议这样做

可能是Clusterware安装过程中配置存在问题导致了 CRS使用 public ip作为 interconnect

建议

FOLLOW  <为Oracle Clusterware修改公用及私有网络接口>  http://www.oracledatabase12g.com ... 8E%A5%E5%8F%A3.html

重新配置 private network

5^#

发表于 2012-4-13 13:59:27

Verifying the Interconnect Settings for Oracle Real Application Clusters

The interconnect and internode communication protocols can affect Cache Fusion performance. In addition, the interconnect bandwidth, its latency, and the efficiency of the IPC protocol determine the speed with which Cache Fusion processes block transfers.

To verify the interconnect settings, query the V$CLUSTER_INTERCONNECTS and the V$CONFIGURED_INTERCONNECTS. For example:

Example 12-1 Verify Interconnect Settings with V$CLUSTER_INTERCONNECTS

SQL> SELECT * FROM V$CLUSTER_INTERCONNECTS;

NAME       IP_ADDRESS IS_ SOURCE
--------------- ---------------- --- -------------------------------
eth2       10.137.20.181  NO  Oracle Cluster Repository

Example 12-2 Verify Interconnect Settings with V$CONFIGURED_INTERCONNECTS

SQL> SELECT * FROM V$CONFIGURED_INTERCONNECTS;

NAME       IP_ADDRESS IS_  SOURCE
--------------- ---------------- ---  -------------------------------
eth2       10.137.20.181  NO Oracle Cluster Repository
eth0       10.137.8.225 YES  Oracle Cluster Repository

SQL> DESC V$CONFIGURED_INTERCONNECTS
Name                   Null? Type
----------------------------------------- -------- ----------------------------
NAME                         VARCHAR2(15)
IP_ADDRESS                      VARCHAR2(16)
IS_PUBLIC                      VARCHAR2(3)
SOURCE                         VARCHAR2(31)

V$CLUSTER_INTERCONNECTS

V$CLUSTER_INTERCONNECTS displays one or more interconnects that are being used for cluster communication.
Column Datatype Description
NAME VARCHAR2(15) Name of the interconnect (such as eth0)
IP_ADDRESS VARCHAR2(16) IP address of the interconnect
IS_PUBLIC VARCHAR2(4) If the value is YES, the interface is known to the public.

If the value is NO, the interface is known to be private. Note that if the CLUSTER_INTERCONNETS initialization parameter is also specified, then it is expected that the interconnect is private. Oracle expects cluster traffic to be run on private interconnects only.

f the value is empty, it is unknown whether the interface is public or private.

Oracle Corporation recommends that you set the interface for Real Application Clusters (RAC) communication in the Oracle Cluster Repository (OCR).
SOURCE VARCHAR2(31) Indicates where this interface was picked up from:

Oracle Cluster Repository - Interface was configured in the OCR and Oracle Database found the interface in the OCR

Operating-system dependent software - Oracle Database automatically detects this

CLUSTER_INTERCONNECTS parameter - This initialization parameter was set

6^#

发表于 2012-4-13 14:04:26

回复 5# 的帖子

但是为什么olsnodes 与ocrdump里面看到的privatenames都是pjdb1_priv1、pjdb2_priv1呢？

7^#

发表于 2012-4-13 14:05:25

回复 4# 的帖子

[SYSTEM.css.privatenames]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.privatenames.pjdb1_priv1]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.privatenames.pjdb1_priv1.nodenum]
UB4 (10) : 1
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.privatenames.pjdb2_priv1]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.privatenames.pjdb2_priv1.nodenum]
UB4 (10) : 2

[ 本帖最后由 lixz_2008 于 2012-4-13 14:22 编辑 ]

ocr.txt

35.22 KB, 下载次数: 828

8^#

发表于 2012-4-13 14:12:03

尝试上传完整的ocrdump 文件

9^#

发表于 2012-4-13 14:23:02

回复 8# 的帖子

ocrdump已经上传

10^#

发表于 2012-4-13 14:26:00

[SYSTEM.css.interfaces]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_CREATE_SUB_KEY, OTHER_PERMISSION : PROCR_READ, USER_NAME : oracle, GROUP_NAME : oinstall}

SYSTEM.css.interfaces 中没有关于Network Interface 的信息

[SYSTEM.css.node_names]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_names.pjdb1]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_names.pjdb1.nodenum]
UB4 (10) : 1
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_names.pjdb2]
UNDEF :
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_names.pjdb2.nodenum]
UB4 (10) : 2
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_numbers.node1.privatename]
ORATEXT : pjdb1_priv1
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}

[SYSTEM.css.node_numbers.node2.privatename]
ORATEXT : pjdb2_priv1
SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : system}
但是存在 SYSTEM.css.node_names的相关信息

olsnodes 通过解析css.node_names和 privatename获得信息

11^#

发表于 2012-4-13 14:38:16

回复 10# 的帖子

这个系统运行了一年多了。为什么会这样呢？

dai_xuej

12^#

发表于 2012-4-13 14:54:58

我也正关顾老大们讨论的进展

dai_xuej

13^#

发表于 2012-4-13 14:57:05

这是我的一套rhel 5.5+oracle 11g 的rac配置

[root@racnode1 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1    localhost.localdomain localhost
#public ip
172.30.0.4    racnode1
172.30.0.5    racnode2
#vip ip
172.30.0.25    racnode2_vip
172.30.0.24    racnode1_vip
#priv ip
10.10.100.211 racnode1_priv
10.10.100.212 racnode2_priv
#scan ip
172.30.0.15    racscan.rgszcg.com    racscan

[root@racnode1 /]# cd /oracle/app/grid/product/11.2.0/bin/
[root@racnode1 bin]# ./oifcfg getif -global
eth0  172.30.0.0  global  public

eth1  10.10.100.0  global  cluster_interconnect
[root@racnode1 bin]# su - oracle
[oracle@racnode1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.1.0 Production on Fri Apr 13 15:17:45 2012

Copyright (c) 1982, 2009, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> show parameter cluster

NAME                               TYPE       VALUE
------------------------------------ ----------- ------------------------------
cluster_database                   boolean    TRUE
cluster_database_instances          integer    2
cluster_interconnects             string
SQL> select * from  V$CLUSTER_INTERCONNECTS;

NAME          IP_ADDRESS    IS_ SOURCE
--------------- ---------------- --- -------------------------------
eth1          10.10.100.211 NO  Oracle Cluster Repository

SQL> select * from v$version;

BANNER
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
PL/SQL Release 11.2.0.1.0 - Production
CORE 11.2.0.1.0    Production
TNS for Linux: Version 11.2.0.1.0 - Production
NLSRTL Version 11.2.0.1.0 - Production

SQL>

14^#

发表于 2012-4-13 15:02:16

回复 13# 的帖子

我想起来，这套RAC曾经因为存储多路径的问题重建过OCR，可能在重建ocr时，未做网络接口配置，直接手工执行了VIPCA导致。oifcfg getif没有任何输出