AIX上OUI发现有HACMP，进行LINK的是CRS？还是DB

武汉-SSH

问一个问题  AIX 进行安装的时候，OUI发现有HACMP存在会自动进行LINK，那么进行LINK的是CRS？还是DB
有没有在11GR2 RAC 上用POWERHA的？看到POWERHA7.1被11.2.0.3认证了，不知道被用在哪个位置？

哎，现在烦透了AIX+RAW，一年接不到几个CASE，部署时要查一堆文档，维护部门坚持要保留RAW。。。。

APP对SCAN有兴趣，要用；维护部门要RAW，我提出用11G GRID + 10G DB+HACMP RAW，在安装GRID的时候，先不装HACMP，只用GRID的功能，HACMP 只用来做CLVM，但是想想 不对，没法确定这种方案可行。

要满足，只有先 11G ASM 后，手工替换所有成 RAW，这方案，自己想想都他妈觉得坑爹啊！

查了一堆文档，看到POWERHA7.1居然被11.2.0.3认证了，真不知道它存活的价值，对RAC而言。

Maclean Liu(刘相兵

1.   10g 以前 即 8i 9i 是 db binary  发现hacmp 后自动link

2 .10g 以后$ORA_CRS_HOME/lib/libskgxn2.so 这个库文件会 link到 vender clusterware中

if vendor clusterware should be used, check to make sure that $ORA_CRS_HOME/lib/libskgxn2.so is linked properly to the vendor clusterware library on all nodes.

For Veritas clusterware:
$ORA_CRS_HOME/lib/libskgxn2.so -> /opt/ORCLcluster/lib/libskgsn2.so

For HP MC ServiceGuard (on HP UX):
$ORA_CRS_HOME/lib/libskgxn2.so -> /opt/nmapi/nmapi2/lib/hpux64/libnmapi2.so   

For SUN Solaris clusterware:
$ORA_CRS_HOME/lib/libskgxn2.so -> /opt/ORCLcluster/lib/libskgsn2.so

For AIX HACMP:
$ORA_CRS_HOME/lib/libskgxn2.so -> /opt/ORCLcluster/lib/libskgsn2.so

link libskgxn2.so 这个 库文件实现以下CSS thread  , 功能是监控  vendor clusterware的skgxn事件。

clssnm_skgxnmon thread – This thread monitors skgxn events (from the vendor clusterware if it exists).  It is also responsible for disconnecting Node Monitor connections if it sees an skgxn reconfiguration.  This allows us to break up a send to an evicted node so that other processes can continue on the new cluster.  A stack trace of an idle clssnm_skgxnmon thread on a running CSS would look like this (Example on Sun with Sun Cluster installed):

-----------------  lwp# 3 / thread# 5  --------------------
ffffffff7cfa5a68 poll     (0, 0, c8)
ffffffff7c41e16c poll (c8, 0, 61, 0, ffffffff7be46f30, ff9) + 58
ffffffff7bd21a70 lk_wait_ast (876c550, 8, ffffffff7a209470, 8000000, 0, 801bb00) + 110
ffffffff7bd156f8 lk_sync_convert (0, 876c550, 801bb00, 61, 0, 1002c53ce) + 198
ffffffff7e902484 skgxnlcnv (ffffffff7a2099f4, 1002554a0, 876c550, 0, 2, 0) + e4
ffffffff7e903c0c skgxn_membermap (ffffffff7a2099f4, 1002c5260, 2, 1002c53be, 0, 1) + 6c
ffffffff7e905c3c skgxnpstat (1, 1002c53e0, 100251720, 1, ffffffff7a2099f4, ffffffff7ea09650) + 43c
000000010003a994 clssnm_skgxnmon (1003d9330, 4, ffffffff7a2099ec, 0, 0, 1000) + 72c
ffffffff7c41ebc8 _thread_start (100542400, 0, 0, 0, 0, 0) + 40

武汉-SSH

那 AIX 的 /opt/ORCLcluster/lib/libskgsn2.so 又是从何而来的呢？

在安装GRID的时候，先不装HACMP 就不会 LINK？CRS 会失去那些HACMP可以提供的信息呢？

然后装HACMP ，再装DB，这会有问题吗？

Maclean Liu(刘相兵

正确的顺序是  hacmp -> GI/CRS -> DB

安装GI/CRS的时候会将$ORA_CRS_HOME/lib/libskgxn2.so link 到/opt/ORCLcluster/lib/libskgsn2.so

你可以尝试 安装完hacmp后去手动 ln -s 做一个soft link

没有测试过 无法给出否有问题的结论

武汉-SSH

正确的顺序我清楚，我只是不清楚在CRS没有与HACMP集成的情况下会缺乏哪些信息。

[oracle@node1 ~]$ll /opt/ORCLcluster/lib
total 784
lrwxrwxrwx   1 root     system           32 Apr 12 2009  libskgxn2.a -> /opt/ORCLcluster/lib/skgxnr.a
lrwxrwxrwx   1 root     system           33 Apr 12 2009  libskgxn2.so -> /opt/ORCLcluster/lib/skgxnr.so
-rw-r--r--   1 root     system       204765 Apr 12 2009  libskgxnr.a
-rwxr-xr-x   1 root     system       194536 Apr 12 2009  libskgxnr.so

我的意思是 libskgxnr.a 和  libskgxnr.so 是HACMP提供的吗？

因为在SFRAC 5.0的文档里可以看到有手工COPY VERITAS 提供的 libskgxnr.a 和 libskgxnr.so 之类的信息

Maclean Liu(刘相兵

ODM finding:

1. RAC/CRS Installation guides depending on the version & platform do have vendor specific instructions for integrating RAC & or CRS with the Operating System Clusterware. This implementation is done by the cluster membership monitor library libskgxn2.so.
   
2. 
   
3. If vendor cluster is present we will wait for the node membership bitmap to be
   
4. provided to CSSD, we do this via the init.cssd script.
   
5. The setup of the vendor clusterware API is imperative since we rely on the libskgxn library to be correctly linked in to avoid situations of the clusterware stack being independent from the vendor stack.
   
6. 
   
7. We can also see the linked API reference for both ocssd.bin & the oracle
   
8. binary by doing an 'ldd' on the binary. E.g.
   
9. $ ldd /u01/oracle/product/10.2.0/crs/bin/ocssd.bin |grep skgx  
   
10. libskgxn2.so => /opt/ORCLcluster/lib//libskgxn2.so  
    
11. 
    
12. $ strings /opt/ORCLcluster/lib/libskgxn2.so |grep -i sun  
    
13. <comes back with below>  
    
14. Sun Cluster
    
15. 
    
16. Issuing ls -l "/opt01/app/oracle/pocrdb/CRS.1020/lib/libskgxn2*" showed
    
17. lrwxrwxrwx 1 orapocr system 33 Jul 12 16:02 libskgxn2.so ->
    
18. /opt/ORCLcluster/lib/libskgxn2.so
    
19. lrwxrwxrwx 1 orapocr system 32 Jul 12 16:02 libskgxn2.a ->
    
20. /opt/ORCLcluster/lib/libskgxn2.a

复制代码

由HACMP 提供 ，提供vendor clusterware 的API ，作用是 cluster membership monitor 集群成员监控

武汉-SSH

绕了一圈路，终于找到答案了！

Q:我的意思是 libskgxnr.a 和  libskgxnr.so 是HACMP提供的吗？
A:libskgxnr.a 和  libskgxnr.so 文件是来自于CRS 安装文件的，在rootpre目录下面，还真是亲密无间的合作啊！这应该要从早期的8i/9i 开始追溯历史原因了。

10.2.0.1 CRS 范例：
# pwd
/orainst/crs/Disk1/rootpre
# ll -R
total 168
drwxr-xr-x   5 oracle   dba             256 Apr 09 2009  ORCLcluster
-rwxr-xr-x   1 oracle   dba           15850 Aug 20 2005  loadext
-rwxr-xr-x   1 oracle   dba           12632 Aug 20 2005  pw-syscall
-rwxr-xr-x   1 oracle   dba           13285 Aug 20 2005  pw-syscall32
-rwxr-xr-x   1 oracle   dba           13821 Aug 20 2005  pw-syscall64
-rwxr-xr-x   1 oracle   dba           20461 Aug 20 2005  rootpre.sh
./ORCLcluster:
total 0
drwxr-xr-x   2 oracle   dba             256 Apr 09 2009  bin
drwxr-xr-x   2 oracle   dba             256 Apr 09 2009  lib
drwxr-xr-x   2 oracle   dba             256 Apr 09 2009  lib32

./ORCLcluster/bin:
total 0

./ORCLcluster/lib:
total 784
-rwxr-xr-x   1 oracle   dba          204765 Aug 20 2005  libskgxnr.a
-rwxr-xr-x   1 oracle   dba          194536 Aug 20 2005  libskgxnr.so

./ORCLcluster/lib32:
total 728
-rwxr-xr-x   1 oracle   dba          189609 Aug 20 2005  libskgxnr.a
-rwxr-xr-x   1 oracle   dba          179363 Aug 20 2005  libskgxnr.so

#csum ./ORCLcluster/lib/*
f9c49b7492d46b223bcf3817c68f5672  ./ORCLcluster/lib/libskgxnr.a
7d3ba65068ff1192d8fd83de78a09a76  ./ORCLcluster/lib/libskgxnr.so

#ll /opt/ORCLcluster/lib/*
lrwxrwxrwx   1 root     system           32 Apr 12 2009  /opt/ORCLcluster/lib/libskgxn2.a -> /opt/ORCLcluster/lib/libskgxnr.a
lrwxrwxrwx   1 root     system           33 Apr 12 2009  /opt/ORCLcluster/lib/libskgxn2.so -> /opt/ORCLcluster/lib/libskgxnr.so
-rw-r--r--   1 root     system       204765 Apr 12 2009  /opt/ORCLcluster/lib/libskgxnr.a
-rwxr-xr-x   1 root     system       194536 Apr 12 2009  /opt/ORCLcluster/lib/libskgxnr.so

#csum /opt/ORCLcluster/lib/*
f9c49b7492d46b223bcf3817c68f5672  /opt/ORCLcluster/lib/libskgxn2.a
7d3ba65068ff1192d8fd83de78a09a76  /opt/ORCLcluster/lib/libskgxn2.so
f9c49b7492d46b223bcf3817c68f5672  /opt/ORCLcluster/lib/libskgxnr.a
7d3ba65068ff1192d8fd83de78a09a76  /opt/ORCLcluster/lib/libskgxnr.so

截取rootpre.sh  最后一段：
if [ ! ${isHACMP} -eq 0 ]; then

   CMDDIR=`dirname $0`

   if [ "$CMDDIR" = "." ];then
      CMDDIR=`pwd`;
   fi
   # Replace relative path with fully qualified path.
   if [ ! "`echo $CMDDIR|grep '^/'`" ];then
      CMDDIR=`pwd`/$CMDDIR;
   fi

   #Create the /opt/ORCLcluster directory
   if [ ! -d $ORACLUSTER_DIR/lib ]; then
       $MKDIR -p $ORACLUSTER_DIR/lib
   fi

   if [ ! -d $ORACLUSTER_DIR/lib32 ]; then
       $MKDIR -p $ORACLUSTER_DIR/lib32
   fi

   if [ ! -d $ORACLUSTER_DIR/bin ]; then
       $MKDIR -p $ORACLUSTER_DIR/bin
   fi

   #Copy the SKGXN libraries from the CRSHOME
   $CP $CMDDIR/ORCLcluster/lib/libskgxnr.a $ORACLUSTER_DIR/lib/libskgxnr.a
   $CP $CMDDIR/ORCLcluster/lib/libskgxnr.so $ORACLUSTER_DIR/lib/libskgxnr.so
   $CP $CMDDIR/ORCLcluster/lib32/libskgxnr.a $ORACLUSTER_DIR/lib32/libskgxnr.a
   $CP $CMDDIR/ORCLcluster/lib32/libskgxnr.so $ORACLUSTER_DIR/lib32/libskgxnr.so
   $LNSF $ORACLUSTER_DIR/lib/libskgxnr.a $ORACLUSTER_DIR/lib/libskgxn2.a
   $LNSF $ORACLUSTER_DIR/lib/libskgxnr.so $ORACLUSTER_DIR/lib/libskgxn2.so
   $LNSF $ORACLUSTER_DIR/lib32/libskgxnr.a $ORACLUSTER_DIR/lib32/libskgxn2.a
   $LNSF $ORACLUSTER_DIR/lib32/libskgxnr.so $ORACLUSTER_DIR/lib32/libskgxn2.so

   $CHMOD 644 $ORACLUSTER_DIR/lib/libskgxn2.a
   $CHMOD 644 $ORACLUSTER_DIR/lib32/libskgxn2.a
fi

[ 本帖最后由 武汉-SSH 于 2012-2-10 11:46 编辑 ]