avantar

90 积分	0 好友	0 主题

发消息

ons不时的重启，CRS_HOME/bin下生成无数的core文件

1^#

发表于 2012-6-15 16:38:06 | 查看: 6399| 回复: 8

ons不时的重启，/oracle/app/11gR1/crs/bin/目录下生成无数的core文件
我不停的ps -ef发现进程号总是在变化，说明ons在不停的重启，如下：
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21513 19663 12 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21527 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21542 19663 12 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21548 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21570 19663 13 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21579 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21650 19663 32 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21704 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21828 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21834 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21864 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21873 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21887 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21893 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21902 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 21908 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22127 19663  2 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22165 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22274 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22276 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22366 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22375 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22389 19663  0 15:12 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 22398 19278  0 15:12 pts/2 00:00:00 grep ons
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 8133 19278  0 15:20 pts/2 00:00:00 grep ons
oracle 8155 19663  0 15:20 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
[oracle@JOADB02 ~]$ ps -ef| grep ons
oracle 8351 19663 10 15:20 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d
oracle 8377 19278  0 15:20 pts/2 00:00:00 grep ons
oracle 19663    1  0 15:10 ?       00:00:00 /oracle/app/11gR1/crs/opmn/bin/ons -d

根目录很快就满了，
[oracle@JOADB02 ~]$ df -h
Filesystem          Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
                  253G  240G    0 100% /
/dev/sda1             99M 13M 82M  14% /boot
tmpfs                7.9G  4.0G  4.0G  51% /dev/shm

[oracle@JOADB02 ~]$
[oracle@JOADB02 ~]$ df -h
Filesystem          Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
                  253G  240G    0 100% /
/dev/sda1             99M 13M 82M  14% /boot
tmpfs                7.9G  4.0G  4.0G  51% /dev/shm
[oracle@JOADB02 ~]$ du -sh /oracle/app/11gR1/crs/bin
225G /oracle/app/11gR1/crs/bin
[oracle@JOADB02 ~]$ ls /oracle/app/11gR1/crs/bin/core.* |wc -l
5907
[oracle@JOADB02 ~]$
[oracle@JOADB02 ~]$

[oracle@JOADB02 ~]$ ls -ltrh /oracle/app/11gR1/crs/bin/core.* |less
-rw------- 1 oracle oinstall 110M Jun 15 15:10 /oracle/app/11gR1/crs/bin/core.19664
-rw------- 1 oracle oinstall 110M Jun 15 15:10 /oracle/app/11gR1/crs/bin/core.19681
-rw------- 1 oracle oinstall 110M Jun 15 15:10 /oracle/app/11gR1/crs/bin/core.19673
-rw------- 1 oracle oinstall 110M Jun 15 15:10 /oracle/app/11gR1/crs/bin/core.19695
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19716
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19749
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19729
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19790
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19929
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.19955
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20419
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20448
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20440
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20432
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20487
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20495
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20530
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20522
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20508
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20551
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20543
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20580
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20564
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20609
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20593
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20638
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20630
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20667
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20659
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20651
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20748
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20731
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20690
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20682
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20777
-rw------- 1 oracle oinstall 110M Jun 15 15:11 /oracle/app/11gR1/crs/bin/core.20769
。。。。。。。。。。。。。。。
。。。。。。。。。。。。。。。。
[oracle@JOADB02 ~]$ less /etc/redhat-
/etc/redhat-: No such file or directory
[oracle@JOADB02 ~]$ less /etc/redhat-release
Red Hat Enterprise Linux Server release 5.5 (Tikanga)
[oracle@JOADB02 ~]$ uname -r
2.6.18-194.el5
[oracle@JOADB02 ~]$ sqlplus
SQL*Plus: Release 11.1.0.6.0 - Production on Fri Jun 15 16:36:30 2012
Copyright (c) 1982, 2007, Oracle.  All rights reserved.
Enter user-name:
请ML及各位大侠帮忙看看，谢谢，
如果需要提供别的日志信息，请留言。

分享0

收藏0 回复只看该作者道具举报

avantar

2^#

发表于 2012-6-15 17:13:55

11GR2是有个相关的BUG，但我的版本是11GR1 Bug 9181300: ONS CORE DUMPING REGULARLY

Bug 属性

类型	B - Defect	已在产品版本中修复	-
严重性	2 - Severe Loss of Service	产品版本	11.2.0.1
状态	85 - Fix Superseded, Code fix issue	平台	226 - Linux x86-64
创建时间	03-Dec-2009	平台版本	NO DATA
更新时间	31-Aug-2010	基本 Bug	-
数据库版本	11.2.0.1
影响平台	Generic
产品源	Oracle

相关产品

产品线	Middleware	系列	Application Servers
区域	Oracle Application Server	产品	1032 - Oracle Fusion Middleware

Hdr: 9181300 11.2.0.1 ONS 11.2.0.1 PRODID-1032 PORTID-226
Abstract: ONS CORE DUMPING REGULARLY

*** 12/03/09 08:52 pm ***
*** 12/03/09 08:54 pm ***
*** 12/05/09 05:16 pm ***
*** 12/05/09 05:17 pm ***
*** 12/08/09 09:44 pm ***
*** 12/09/09 09:09 am ***
*** 12/09/09 09:49 am *** (CHG: Sta->10)
*** 12/09/09 09:49 am ***
*** 12/10/09 09:58 am *** (CHG: Sta->16)
*** 12/10/09 09:58 am ***
*** 12/10/09 10:30 am ***
*** 12/10/09 12:12 pm *** (CHG: Sta->11 Asg->NEW OWNER)
*** 12/10/09 12:12 pm ***
*** 12/31/09 04:22 pm ***
*** 01/03/10 12:22 pm ***
*** 01/12/10 02:31 pm *** ESCALATED
*** 01/12/10 02:31 pm ***
*** 01/12/10 04:39 pm ***
*** 01/12/10 04:47 pm ***
*** 01/12/10 04:47 pm *** (CHG: Sta->30)
*** 01/13/10 08:15 am ***
*** 01/13/10 10:11 am ***
*** 01/13/10 10:21 am ***
*** 01/13/10 10:21 am ***
*** 01/13/10 10:21 am *** (CHG: Sta->80)
*** 01/13/10 10:21 am ***
Rediscovery Information:
Core dumps from the ONS server or excessive memory or cpu usage.
Inability of the client to connect to older (v3) ONS servers.
Workaround: None
Release Notes:
Use this bug to create the BLR for 11.2.0.1, the only label to
which this can be back ported -- the fixes already exist in
11.2.0.2.
]]
*** 01/13/10 01:07 pm ***
*** 01/14/10 07:42 am ***
*** 01/15/10 02:30 pm ***
*** 01/15/10 02:30 pm ***
*** 02/02/10 03:36 pm ***
*** 02/16/10 03:06 am ***
*** 05/05/10 05:44 pm *** (CHG: Sta->11)
*** 05/05/10 05:44 pm ***
*** 05/06/10 08:49 am ***
*** 05/06/10 08:59 am ***
*** 05/06/10 08:59 am ***
*** 05/06/10 01:26 pm ***
*** 05/13/10 09:16 am ***
*** 05/14/10 04:14 am ***
*** 05/19/10 12:06 am ***
*** 05/19/10 12:06 am ***
*** 05/19/10 06:40 pm ***
*** 05/19/10 07:27 pm *** (CHG: Sta->30)
*** 05/19/10 08:00 pm *** (CHG: Sta->11)
*** 05/19/10 08:00 pm ***
*** 05/19/10 11:50 pm ***
*** 05/20/10 12:00 am ***
*** 05/20/10 09:30 am ***
*** 05/20/10 09:30 am *** (CHG: Sta->30)
*** 05/20/10 09:31 am ***
*** 05/21/10 10:17 am *** (CHG: Sta->11)
*** 05/21/10 10:17 am ***
*** 05/24/10 10:03 am ***
*** 05/24/10 10:03 am *** (CHG: Sta->30)
*** 06/08/10 02:10 pm ***
*** 06/08/10 06:44 pm *** (CHG: Sta->11)
*** 06/08/10 06:44 pm ***
*** 06/09/10 10:08 am ***
*** 06/09/10 10:08 am *** (CHG: Sta->30)
*** 06/09/10 10:21 am *** (CHG: Sta->11)
*** 06/09/10 10:21 am ***
*** 06/09/10 11:04 am ***
*** 06/09/10 11:04 am *** (CHG: Sta->30)
*** 06/09/10 11:54 am *** (CHG: Sta->11)
*** 06/09/10 11:54 am ***
*** 06/09/10 01:48 pm *** (CHG: Sta->85)
*** 06/09/10 01:48 pm ***
*** 08/31/10 12:01 pm ***

回复只看该作者道具举报

Maclean Liu(刘相兵

3^#

发表于 2012-6-15 19:51:47

ons core dump的bug 有不少，主要分布在10.2 上

建议你升级 DB 到 11.1.0.7 latest PSU 或者干脆禁用ONS 服务

回复只看该作者道具举报

avantar

4^#

发表于 2012-6-15 22:19:01

先谢谢ML，如果禁用ONS有什么不良影响没？

回复只看该作者道具举报

Maclean Liu(刘相兵

5^#

发表于 2012-6-17 21:00:38

回复 4# 的帖子

除非你使用的 ONS相关的FCF特性但是据我所知国内几乎没人用，否则ONS服务一般都是可以禁用的

回复只看该作者道具举报

avantar

6^#

发表于 2012-6-17 23:56:43

请教下ML是使用什么关键词查询的，我的查询结果如下图：
这是否是账号权限导致的呢？

fffffff.jpg (58.83 KB, 下载次数: 420)

回复只看该作者道具举报

avantar

7^#

发表于 2012-6-18 10:56:27

再请教下ML如何禁用ONS服务，我试过了用srvctl disable services -s ora.joadb02.ons提示服务不存在，
貌似11GR2有srvctl disable ons的语法，但11GR1没有，
网上搜寻了下未果。

回复只看该作者道具举报

avantar

8^#

发表于 2012-6-18 21:58:14

ML，惭愧，我没找到11GR2中禁用ONS服务的方法，
直接将ONS的母进程KILL掉了，
今天观察了一天没有什么问题，
不知道ML对此有何建议？

回复只看该作者道具举报

Maclean Liu(刘相兵

9^#

发表于 2012-6-18 22:05:04

3. configuration of the ons daemon

The configuration files stands in $ORA_CRS_HOME/opmn/conf/ons.config file on all nodes. The different parameters are:

a. the tcp listening port parameters, e.g.

localport=6101
remoteport=6200

The localport is used to communicate with local clients, e.g. the listeners on the server itself. The remoteport is used to communicate with remote ONS daemons, e.g. the ONS daemons running on the other node(s) of the cluster, or with ons clients (e.g. application or listeners).

b. the "useocr" parameter, i.e. useocr=on

When the useocr=on is set, then the ons configuration in the ocr is read to define the servers that will be contacted by the ons daemon to receive ons events from it.
It is set via the ONS configuration assistant launched during the initial
clusterware installation, via root command, e.g.

racgons add_config hostname1:6200 hostname2:6200

The hostname to use need to match the name retrieved from the OS command "hostname"
(see note:744849.1). The port need to match the remoteport setup of point a.
The remote ONS daemons are normally the unique Oracle RAC ons daemons running on all nodes of the cluster,
together with any servers with ons daemons running on them (e.g. a iAS remote installation).

The command "onsctl debug" permit to view the ocr configuration, e.g.
Number of onsconfiguration retrieved, numcfg = 2
onscfg[0]
{node = hostname1, port = 6200}
Adding remote host hostname1:6200
onscfg[1]
{node = hostname2, port = 6200}
Adding remote host hostname2:6200

"racgons remove_config hostname1" permits to delete the ocr configuration (or replace it
together with the "racgons add_config hostname1:port1" command)

All remote server connections are viewable via the server connection part of the 'onsctl debug'
output, e.g. on a two node rac cluster, the remote node will appear:

尝试

racgons remove_config $HOSTNAME

回复只看该作者道具举报

返回列表

		自动登录	找回密码
密码			注册