Maclean Liu(刘相兵 发表于 2012-6-1 23:26:26

Process J000 died, kkjcre1p: unable to spawn jobq slave process引起宕机

Process J000 died, kkjcre1p: unable to spawn jobq slave process引起的oracle数据库宕机
网友提问 Question:


刘大,经常看您的技术博客,佩服您对oralce的深入研究。



我遇到一个问题,造成oracle宕机。虽然经过努力,让oracle重新启动,但是目前找不到宕机的真正原因。刘大帮我这个菜鸟分析一下真正原因吧,多谢!大量如下信息

alert:

May 30 04:32:54 2012
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /var/u01/app/oracle/diag/rdbms/qc010/down/trace/down_cjq0_29326.trc:

trace:
*** 2012-05-30 04:32:53.689

*** 2012-05-30 04:32:54.393
Process J000 is dead (pid=8448 req_ver=1204 cur_ver=1204 state=3).

*** 2012-05-30 04:33:00.857
Process J000 is dead (pid=8524 req_ver=1205 cur_ver=1205 state=3).

*** 2012-05-30 04:33:11.862
Process J000 is dead (pid=8651 req_ver=1206 cur_ver=1206 state=3).

*** 2012-05-30 04:35:18.338
Process J000 is dead (pid=9105 req_ver=1207 cur_ver=1207 state=3).






Oracle数据库基本信息:
Version:  11.1.0.6.0
memory_target:18G
memory_max_target:18G

OS信息:
Version:CentOS release 5.6 (Final)
内存:24G
/dev/shm:20G



具体情况:
收到报警后,登录sqlplus,发现数据库已经宕机了。试着启动oracle,
SQL> startup
ORA-00845: MEMORY_TARGET not supported on this system

MEMORY_TARGET设置的是18G,而/dev/shm设置的是20G,不应该起不来啊,查看/dev/shm具体情况
$ df -Th /dev/shm
文件系统    类型      容量  已用  可用 已用%% 挂载点
tmpfs        tmpfs     20G   13G  6.6G  67% /dev/shm


/dev/shm剩余空间不足18G。重新remount  /dev/shm后,oracle顺利启动。

这就是我的第一个问题:oracle数据库宕机后,oracle占用/dev/shm的空间为什么不释放呢?



第二个问题:memory_max_target和memory_target设置多大合适,一般占内存的多少?还有就是/dev/shm和memory_max_target之间有没有比例关系。



最重要的问题,就是我不到宕机原因,根据您的文章http://www.oracledatabase12g.com/archives/ksvcreate-process-creation-failed%E6%95%85%E9%9A%9C%E4%B8%80%E4%BE%8B.html
我排除了Oracle实例资源不足的情况,我猜测的是内存不足造成的宕机,但是没有依据。

麻烦您帮忙分析一下,看看到底是什么原因,万分感谢!

附上alert log和trace。



Maclean Liu(刘相兵 发表于 2012-6-1 23:49:05

ODM DATA:

11.1.0.6.0 - 64bit Production+ Linux


May 30 04:32:54 2012
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /var/u01/app/oracle/diag/rdbms/qc010/down/trace/down_cjq0_29326.trc:

Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /var/u01/app/oracle/diag/rdbms/qc010/down/trace/down_cjq0_29326.trc:

Wed May 30 04:33:11 2012
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /var/u01/app/oracle/diag/rdbms/qc010/down/trace/down_cjq0_29326.trc:


Wed May 30 04:56:22 2012
Process W000 died, see its trace file
Process W000 died, see its trace file
Process W000 died, see its trace file

*** 2012-05-29 22:00:00.130
Setting Resource Manager plan DEFAULT_MAINTENANCE_PLAN via parameter

*** 2012-05-30 04:32:53.689

*** 2012-05-30 04:32:54.393
Process J000 is dead (pid=8448 req_ver=1204 cur_ver=1204 state=3).


Wed May 30 05:05:14 2012
Starting ORACLE instance (normal)
WARNING: You are trying to use the MEMORY_TARGET feature. This feature requires the /dev/shm file system to be mounted for at least 19327352832 bytes. /dev/shm is either not mounted or is mounted with available space less than this size. Please fix this so that MEMORY_TARGET can work as expected. Current available is 7029190656 and used is 13942329344 bytes.
memory_target needs larger /dev/shm



不断出现 background process died ,进程的TRACE没有包含过多的内容


ODM FINDING 相似案例:

Hdr: 11694168 11.2.0.2 RDBMS 11.2.0.2 MEMORY MGMT PRODID-5 PORTID-226 ORA-472
Abstract: MMON  PROCESS TERMINATED THE INSTANCE DUE TO ERROR 472

*** 01/28/11 06:48 am ***
----

PROBLEM:
--------
1. Clear description of the problem encountered:

- Exadata 11.2.0.2 with exadata BP#1

- alert.log reported these errors starting Jan 27 16:12
- instance then terminated at Jan 27 20:11 due to ORA-472 ( 00472, 00000,
"PMON process terminated with error")

Thu Jan 27 16:12:24 2011
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file
/u01/app/oracle/admin/diag/rdbms/bgc0tta/BGC0TT1/trace/BGC0TT1_cjq0_14973.trc:

Process J000 died, see its trace file
...
Thu Jan 27 16:19:16 2011
Errors in file
/u01/app/oracle/admin/diag/rdbms/bgc0tta/BGC0TT1/trace/BGC0TT1_ora_31211.trc:
...
Thu Jan 27 17:15:13 2011
Process PZ98 died, see its trace file
Thu Jan 27 17:15:14 2011
Process GCR0 died, see its trace file
Process PZ97 died, see its trace file
Thu Jan 27 17:15:23 2011
Process m000 died, see its trace file
...
Thu Jan 27 20:11:51 2011
System state dump requested by (instance=1, osid=14557 (MMON)),
summary=.
System State dumped to trace file
/u01/app/oracle/admin/diag/rdbms/bgc0tta/BGC0TT1/trace/BGC0TT1_diag_14451.trc
Thu Jan 27 20:11:51 2011
MMON (ospid: 14557): terminating the instance due to error 472

- Then on instance restart :

Thu Jan 27 20:12:04 2011
Starting ORACLE instance (normal)
WARNING: You are trying to use the MEMORY_TARGET feature. This feature
requires the /dev/shm file system to be mounted for at least 60129542144
bytes. /dev/shm is either not mounted or is mounted with available space less
than this size. Please fix this so that MEMORY_TARGET can work as expected.
Current available is 26556633088 and used is 37990559744 bytes. Ensure that
the mount point is /dev/shm for this directory.
memory_target needs larger /dev/shm

- The last error was transient, the next restart worked OK.

DIAGNOSTIC ANALYSIS:
--------------------
- recent changes to memory parameters, now:
sga_target               = 40G
memory_max_target        = 56G

- was:
sga_target               = 16G
memory_max_target        = 28G


- /dev/shm:

tmpfs     /dev/shm     tmpfs   defaults,size=61557


- possibly memory was over-commited, OSW not uploaded yet though.









建议:

1. 继续观察是否出现该问题
2. 建议升级到 11.1.0.7 + latest PSU  或11.2.0.3
3. 避免使用memory_target的AMM 绕过该问题, 采用10g的ASMM AUTO SGA

Maclean Liu(刘相兵 发表于 2012-6-1 23:58:34

我的第一个问题:oracle数据库宕机后,oracle占用/dev/shm的空间为什么不释放呢?

Answer: 11g中使用AMM的情况下 因为instance 意外crash导致 /dev/shm下 的memory chunk不被正常清理 属于 常见的故障



第二个问题:memory_max_target和memory_target设置多大合适,一般占内存的多少?还有就是/dev/shm和memory_max_target之间有没有比例关系。



Answer:
On Linux systems, if the operating system /dev/shm mount size is too small for the Oracle system global area (SGA) and program global area (PGA), then you encounter the following error:

    ORA-00845: MEMORY_TARGET not supported on this system.


The cause of this error is an insufficient /dev/shm allocation. The total memory size of the SGA and PGA, which sets the initialization parameter MEMORY_TARGET or MEMORY_MAX_TARGET, cannot be greater than the shared memory file system (/dev/shm) on your operating system.


memory_target 可以考虑设置为物理内存的 60-75%大小 ,MEMORY_MAX_TARGET 或MEMORY_TARGET  不能大于 /dev/shm的空间大小

HOU 发表于 2012-6-4 21:50:16

非常感谢你的回复。

hi maclean liu:

非常感谢你的回复。
原来数据库的processes和sessions都是默认值150和170。
通过加大processes后sessions,经过3天观察,数据库没有宕机。
但是现在通过select * from v$resource_limit;查询,发现实际利用的processes和sessions并没有超过150和170。
有些诡异。不知道到底是不是processes或者sessions的使用数量达到最大值造成的宕机。

select * from v$resource_limit;

RESOURCE_NAME                  CURRENT_UTILIZATION MAX_UTILIZATION INITIAL_ALLOCATION   LIMIT_VALUE
------------------------------ ------------------- --------------- -------------------- --------------------
processes                                       49              77        400                  400
sessions                                        59             111        445                  445
enqueue_locks                                   50             231       5550                 5550
enqueue_resources                               35             147       2176            UNLIMITED
ges_procs                                        0               0          0                    0
ges_ress                                         0               0          0            UNLIMITED
ges_locks                                        0               0          0            UNLIMITED
ges_cache_ress                                   0               0          0            UNLIMITED
ges_reg_msgs                                     0               0          0            UNLIMITED
ges_big_msgs                                     0               0          0            UNLIMITED
ges_rsv_msgs                                     0               0          0                    0
gcs_resources                                    0               0          0                    0
gcs_shadows                                      0               0          0                    0
dml_locks                                        4               4       1956            UNLIMITED
temporary_table_locks                            0               3  UNLIMITED            UNLIMITED
transactions                                     3              44        489            UNLIMITED
branches                                         0              20        489            UNLIMITED
cmtcallbk                                        0              24        489            UNLIMITED
max_rollback_segments                           24              24        489                65535
sort_segment_locks                               0               7  UNLIMITED            UNLIMITED
k2q_locks                                        0               0        890            UNLIMITED
max_shared_servers                               1               1  UNLIMITED            UNLIMITED
parallel_max_servers                             0               0         40                 3600

Maclean Liu(刘相兵 发表于 2012-6-4 22:05:53

没有信息表明存在 ORA-00018或者ORA-00020 错误, 所以和  sessions或者processes数无关

WWJD_DBA 发表于 2014-1-15 15:17:46

老师,我的问题和上面问题差不多,我的问题http://t.askmaclean.com/forum.php?mod=viewthread&tid=3828&page=1#pid21317
我的这个问题是,实例进程是在的,但是连接实例时显示是空闲实例。
两个节点内存分别8CPU,10G,RAC参数如下:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
SQL> create pfile='/u01/oracle/initrac.ora' from spfile;
$ more initrac.ora
rac1.__db_cache_size=1392508928
rac2.__db_cache_size=1476395008
rac1.__java_pool_size=16777216
rac2.__java_pool_size=16777216
rac1.__large_pool_size=16777216
rac2.__large_pool_size=16777216
rac1.__oracle_base='/u01/oracle'#ORACLE_BASE set from environment
rac2.__oracle_base='/u01/oracle'#ORACLE_BASE set from environment
rac1.__pga_aggregate_target=1459617792
rac2.__pga_aggregate_target=1459617792
rac1.__sga_target=2751463424
rac2.__sga_target=2751463424
rac1.__shared_io_pool_size=0
rac2.__shared_io_pool_size=0
rac1.__shared_pool_size=1258291200
rac2.__shared_pool_size=1207959552
rac1.__streams_pool_size=33554432
rac2.__streams_pool_size=0
*._gc_policy_time=0
*._gc_undo_affinity=FALSE
*.audit_file_dest='/u01/oracle/admin/rac/adump'
*.audit_trail='db'
*.cluster_database=TRUE
*.compatible='11.2.0.0.0'
*.control_file_record_keep_time=21
*.control_files='+DATA/rac/controlfile/current.260.829153621','+FRA/rac/controlfile/current.256.829153621'
*.db_block_size=8192
*.db_create_file_dest='+DATA'
*.db_domain=''
*.db_name='rac'
*.db_recovery_file_dest='+FRA'
*.db_recovery_file_dest_size=4558159872
*.diagnostic_dest='/u01/oracle'
*.dispatchers='(PROTOCOL=TCP) (SERVICE=racXDB)'
rac2.instance_number=2
rac1.instance_number=1
rac1.local_listener='NODE1_LOCAL'
rac2.local_listener='node2_local'
*.log_archive_dest_1='LOCATION=+fra/rac/arc'
rac1.log_archive_dest_1='LOCATION=/u01/oracle/arch1'
rac2.log_archive_dest_1='LOCATION=/u01/oracle/arch2'
rac1.log_archive_dest_2='service=rac2'
rac2.log_archive_dest_2='SERVICE=rac1'
*.log_archive_dest_state_2='ENABLE'
*.log_archive_format='%t_%s_%r.arc'
*.memory_target=4202692608
*.open_cursors=300
*.processes=150
*.remote_listener='RAC_REMOTE'
*.remote_login_passwordfile='exclusive'
rac1.standby_archive_dest='/u01/oracle/arch2'
rac2.standby_archive_dest='/u01/oracle/arch1'
rac2.thread=2
rac1.thread=1
rac2.undo_tablespace='UNDOTBS2'
rac1.undo_tablespace='UNDOTBS1'
$
日志请看附件,感谢!

Liu Maclean(刘相兵 发表于 2014-1-15 15:29:20

ps -ef|grep LOCAL=NO |wc -l

su - oracle
cat /etc/sysctl.conf
ulimit -a

看下

WWJD_DBA 发表于 2014-1-15 15:37:18

Liu Maclean(刘相兵 发表于 2014-1-15 15:29 static/image/common/back.gif
ps -ef|grep LOCAL=NO |wc -l

su - oracle


# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
                       45G  5.7G   37G  14% /
tmpfs                 4.9G  2.8G  2.2G  57% /dev/shm
/dev/sda1             485M   55M  405M  12% /boot
/dev/mapper/vg01-lv01
                       49G   38G  8.1G  83% /u01
# free -m
             total       used       free     shared    buffers     cached
Mem:         10021       7396       2625          0        247       4794
-/+ buffers/cache:       2354       7666
Swap:         3967        152       3815

# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
                       45G  5.7G   37G  14% /
tmpfs                 4.9G  2.8G  2.2G  57% /dev/shm
/dev/sda1             485M   55M  405M  12% /boot
/dev/mapper/vg01-lv01
                       49G   17G   29G  38% /u01
# free -m
             total       used       free     shared    buffers     cached
Mem:         10021       9281        740          0         54       1452
-/+ buffers/cache:       7773       2247
Swap:         3967       2729       1238

正常的RAC1:
# ps -ef|grep LOCAL=NO |wc -l
5
# su - oracle
$ cat /etc/sysctl.conf
# Kernel sysctl configuration file for Red Hat Linux
#
# For binary values, 0 is disabled, 1 is enabled.  See sysctl(8) and
# sysctl.conf(5) for more details.

# Controls IP packet forwarding
net.ipv4.ip_forward = 0

# Controls source route verification
net.ipv4.conf.default.rp_filter = 1

# Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0

# Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0

# Controls whether core dumps will append the PID to the core filename.
# Useful for debugging multi-threaded applications.
kernel.core_uses_pid = 1

# Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1

# Disable netfilter on bridges.
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0

# Controls the default maxmimum size of a mesage queue
kernel.msgmnb = 65536

# Controls the maximum size of a message, in bytes
kernel.msgmax = 65536

# Controls the maximum shared segment size, in bytes

# Controls the maximum number of shared memory segments, in pages

# oracle-rdbms-server-11gR2-preinstall setting for fs.file-max is 6815744
fs.file-max = 6815744

# oracle-rdbms-server-11gR2-preinstall setting for kernel.sem is '250 32000 100 128'
kernel.sem = 250 32000 100 128

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmni is 4096
kernel.shmmni = 4096

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 1073741824 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 2097152 on i386
kernel.shmall = 1073741824

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4398046511104 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4294967295 on i386
kernel.shmmax = 4398046511104

# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_default is 262144
net.core.rmem_default = 262144

# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_max is 4194304
net.core.rmem_max = 4194304

# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_default is 262144
net.core.wmem_default = 262144

# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_max is 1048576
net.core.wmem_max = 1048576

# oracle-rdbms-server-11gR2-preinstall setting for fs.aio-max-nr is 1048576
fs.aio-max-nr = 1048576

# oracle-rdbms-server-11gR2-preinstall setting for net.ipv4.ip_local_port_range is 9000 65500
net.ipv4.ip_local_port_range = 9000 65500

$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 80036
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 10240
cpu time               (seconds, -t) unlimited
max user processes              (-u) 2047
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
$

异常的RAC2:
# ps -ef|grep LOCAL=NO |wc -l
2
# ps -ef|grep LOCAL=NO
oracle    5361     1  0 Jan04 ?        00:00:00 oraclerac2 (LOCAL=NO)
root     30319 31898  0 15:33 pts/2    00:00:00 grep LOCAL=NO
# su - oracle
$ cat /etc/sysctl.conf
# Kernel sysctl configuration file for Red Hat Linux
#
# For binary values, 0 is disabled, 1 is enabled.  See sysctl(8) and
# sysctl.conf(5) for more details.

# Controls IP packet forwarding
net.ipv4.ip_forward = 0

# Controls source route verification
net.ipv4.conf.default.rp_filter = 1

# Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0

# Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0

# Controls whether core dumps will append the PID to the core filename.
# Useful for debugging multi-threaded applications.
kernel.core_uses_pid = 1

# Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1

# Disable netfilter on bridges.
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0

# Controls the default maxmimum size of a mesage queue
kernel.msgmnb = 65536

# Controls the maximum size of a message, in bytes
kernel.msgmax = 65536

# Controls the maximum shared segment size, in bytes

# Controls the maximum number of shared memory segments, in pages

# oracle-rdbms-server-11gR2-preinstall setting for fs.file-max is 6815744
fs.file-max = 6815744

# oracle-rdbms-server-11gR2-preinstall setting for kernel.sem is '250 32000 100 128'
kernel.sem = 250 32000 100 128

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmni is 4096
kernel.shmmni = 4096

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 1073741824 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 2097152 on i386
kernel.shmall = 1073741824

# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4398046511104 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4294967295 on i386
kernel.shmmax = 4398046511104

# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_default is 262144
net.core.rmem_default = 262144

# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_max is 4194304
net.core.rmem_max = 4194304

# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_default is 262144
net.core.wmem_default = 262144

# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_max is 1048576
net.core.wmem_max = 1048576

# oracle-rdbms-server-11gR2-preinstall setting for fs.aio-max-nr is 1048576
fs.aio-max-nr = 1048576

# oracle-rdbms-server-11gR2-preinstall setting for net.ipv4.ip_local_port_range is 9000 65500
net.ipv4.ip_local_port_range = 9000 65500

$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 80036
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 10240
cpu time               (seconds, -t) unlimited
max user processes              (-u) 2047
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
$

Liu Maclean(刘相兵 发表于 2014-1-16 13:30:22

$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 128292
max locked memory       (kbytes, -l) 50000000
max memory size         (kbytes, -m) unlimited
open files                      (-n) 131072
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 131072
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited



你的 max locked memory       (kbytes, -l) 64   open files                      (-n) 1024 都太小了

WWJD_DBA 发表于 2014-1-16 15:05:12

Liu Maclean(刘相兵 发表于 2014-1-16 13:30 static/image/common/back.gif
$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes,  ...

好的,谢谢老师。
那从我系统的情况上看,是因为这些参数设置太小导致数据库连续报错,如:
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
Process W000 died, see its trace file
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /u01/oracle/diag/rdbms/rac/rac2/trace/rac2_cjq0_13557.trc:
后续的话,如何重启节点2(sqlplus进入显示空闲实例,但实例2进程都在)?直接在内存里面杀掉吗?谢谢老师。

Liu Maclean(刘相兵 发表于 2014-1-16 16:18:31

常规OS关 ORACLE实例方法都可以

WWJD_DBA 发表于 2014-1-16 16:42:49

Liu Maclean(刘相兵 发表于 2014-1-16 16:18 static/image/common/back.gif
常规OS关 ORACLE实例方法都可以

刘老师,实在不好意思。
我不太明白您说的常规OS关指的是什么意思。还有就是Oracle实例关的话显示是空实例,关闭掉。
我想到的是kill数据库进程、在内存里面杀掉数据库。
希望老师能再指导一下,感谢。
页: [1]
查看完整版本: Process J000 died, kkjcre1p: unable to spawn jobq slave process引起宕机