oracle 11.2.0.3 RAC alert日志报错ORA-27300

linusfay

环境描述
SYSTEM AIX 6.1
DB 11.2.0.3 RAC
主机内存 16G

alert 日志如下
2014-02-26 16:28:06.463000 +08:00
Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_psp0_14549080.trc:
ORA-27300: OS system dependent operation:fork failed with status: 2
ORA-27301: OS failure message: No such file or directory
ORA-27302: failure occurred at: skgpspawn5

此错误在一段时间内联系出现

orcl1_psp0_14549080.trc:

Trace file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_psp0_14549080.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1
System name:        AIX
Node name:        p740a
Release:        1
Version:        6
Machine:        00F6876E4C00
Instance name: orcl1
Redo thread mounted by this instance: 1
Oracle process number: 3
Unix process pid: 14549080, image: oracle@p740a (PSP0)


*** 2014-02-24 16:06:28.345
*** SESSION ID:(76.1) 2014-02-24 16:06:28.345
*** CLIENT ID:() 2014-02-24 16:06:28.345
*** SERVICE NAME:(SYS$BACKGROUND) 2014-02-24 16:06:28.345
*** MODULE NAME:() 2014-02-24 16:06:28.345
*** ACTION NAME:() 2014-02-24 16:06:28.345

Process startup failed, error stack:
ORA-27300: OS system dependent operation:fork failed with status: 2
ORA-27301: OS failure message: No such file or directory
ORA-27302: failure occurred at: skgpspawn5

psp0进程启动不起来，是由于主机或者数据库资源限制到时用户无法新增连接？该冲那些方面入手查证此故障

Maclean Liu(刘相兵

需要AWR 最好有RDA报告

linusfay

awrrpt_1_16711_16712.html (762.89 KB, 下载次数: 748)

2014-3-5 17:31 上传

点击文件名下载附件

awrrpt_2_16711_16712.html (723.74 KB, 下载次数: 763)

2014-3-5 17:31 上传

点击文件名下载附件

24号报告无法采集了，这两个是26号AWR16-17点AWR报告。在26号16-17点也出现了相同的错误。
发现alert.log里面每出现opidcl aborting process unknown ospid (19136634) as a result of ORA-604
就伴随着
Wed Feb 26 16:25:15 2014
Process startup failed, error stack:
Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_psp0_14549080.trc:
ORA-27300: OS system dependent operation:fork failed with status: 2
ORA-27301: OS failure message: No such file or directory
ORA-27302: failure occurred at: skgpspawn5

后从操作系统层查，AIX系统层对用户进程限制太低 maxuproc        128 增加其值，待观察效果。