Oracle数据库数据恢复、性能优化

找回密码
注册
搜索
热搜: 活动 交友 discuz
Oracle数据库数据恢复、性能优化»论坛 › Oracle › Oracle数据库管理 › 数据库实例异常终止
发新帖
lsz_qh

0

积分

1

好友

21

主题

[升级] 数据库实例异常终止

1#
发表于 2013-10-11 11:48:43 | 查看: 4321| 回复: 5
本帖最后由 lsz_qh 于 2013-10-11 12:13 编辑

OS:AIX 5L3
RDBMS:9.2.0.7

问题：
实例终止，检查日志文件发现以下错误：
Fri Oct 11 07:08:39 2013
KCF: write/open error block=0xbdcce online=1
     file=56 /dev/r10g_data10
     error=27063 txt: 'IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked
Additional information: -1
Additional information: 8192'
Fri Oct 11 07:08:39 2013
Errors in file /oracle/app/admin/xjhb/bdump/xjhb1_dbw0_626906.trc:
ORA-01242: data file suffered media failure: database in NOARCHIVELOG mode
ORA-01114: IO error writing block to file 56 (block # 777422)
ORA-01110: data file 56: '/dev/r10g_data10'
ORA-27063: skgfospo: number of bytes read/written is incorrect
IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked
Additional information: -1
Additional information: 8192
DBW0: terminating instance due to error 1242
Fri Oct 11 07:08:40 2013
System state dump is made for local instance

/oracle/app/admin/xjhb/bdump/xjhb1_dbw0_626906.trc 文件内容为：
[db180]:/oracle/app/admin/xjhb/bdump$more /oracle/app/admin/xjhb/bdump/xjhb1_dbw0_626906.trc
/oracle/app/admin/xjhb/bdump/xjhb1_dbw0_626906.trc
Oracle9i Enterprise Edition Release 9.2.0.7.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP and Oracle Data Mining options
JServer Release 9.2.0.7.0 - Production
ORACLE_HOME = /oracle/app/product/9.2
System name:    AIX
Node name:      db180
Release:        3
Version:        5
Machine:        00C50A1E4C00
Instance name: xjhb1
Redo thread mounted by this instance: 1
Oracle process number: 8
Unix process pid: 626906, image: oracle@db180 (DBW0)

*** 2013-10-11 07:08:39.959
*** SESSION ID:(9.1) 2013-10-11 07:08:39.943
KCF: write/open error block=0xbdcce online=1
     file=56 /dev/r10g_data10
     error=27063 txt: 'IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked
Additional information: -1
Additional information: 8192'
error 1242 detected in background process
ORA-01242: data file suffered media failure: database in NOARCHIVELOG mode
ORA-01114: IO error writing block to file 56 (block # 777422)
ORA-01110: data file 56: '/dev/r10g_data10'
ORA-27063: skgfospo: number of bytes read/written is incorrect
IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked
Additional information: -1
Additional information: 8192
ksuitm: waiting for [5] seconds before killing DIAG
sskgxn_slave_subscriber_cb: aborting -- since primary member is somehow dead

怀疑有坏块，使用dbv检查，发现无坏块出现：
[db180]:/home/oracle$dbv file='/dev/r10g_data10' blocksize=8192

DBVERIFY: Release 9.2.0.7.0 - Production on ??|′ 10? 11 11:20:15 2013

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.

DBVERIFY - Verification starting : FILE = /dev/r10g_data10

DBVERIFY - Verification complete

Total Pages Examined         : 1305600
Total Pages Processed (Data) : 1228876
Total Pages Failing   (Data) : 0
Total Pages Processed (Index): 76700
Total Pages Failing   (Index): 0
Total Pages Processed (Other): 24
Total Pages Processed (Seg)  : 0
Total Pages Failing   (Seg)  : 0
Total Pages Empty            : 0
Total Pages Marked Corrupt   : 0
Total Pages Influx           : 0
Highest block SCN            : 19061177405 (4.1881308221)
[db180]:/home/oracle$

startup时出现以下提示：
ORA-01081: cannot start already-running ORACLE - shut it down first
说明数据库停止过程中出现了异常，
shutdown immediate 无法停止：
ORA-24324: service handle not initialized
ORA-24323: value not allowed
ORA-01092: ORACLE instance terminated. Disconnection forced
shutdown abort停止后，startup启动数据库，能正常启动。

麻烦大家帮忙分析一下alert日志中的错误，谢谢！
2#
发表于 2013-10-11 11:50:18
KCF: write/open error block=0xbdcce online=1
     file=56 /dev/r10g_data10
     error=27063 txt: 'IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked
Additional information: -1
Additional information: 8192'
error 1242 detected in background process
ORA-01242: data file suffered media failure: database in NOARCHIVELOG mode
ORA-01114: IO error writing block to file 56 (block # 777422)
ORA-01110: data file 56: '/dev/r10g_data10'
ORA-27063: skgfospo: number of bytes read/written is incorrect
IBM AIX RISC System/6000 Error: 45: Deadlock condition if locked


这是IO  写不进去


errpt -a 看下

回复 只看该作者 道具 举报

3#
发表于 2013-10-11 12:09:00
[db180]:/oracle/app/product/9.2/network/admin$errpt -a
---------------------------------------------------------------------------
LABEL:          LVM_IO_FAIL
IDENTIFIER:     613E5F38

Date/Time:       Fri Oct 11 07:08:34 BEIST 2013
Sequence Number: 11007
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           H
Type:            PERM
Resource Name:   LVDD            
Resource Class:  NONE
Resource Type:   NONE
Location:        

Description
I/O ERROR DETECTED BY LVM

Probable Causes
POWER, DRIVE, ADAPTER, OR CABLE FAILURE

        Recommended Actions
        RUN DIAGNOSTICS AGAINST THE FAILING DEVICE

Detail Data
PHYSICAL VOLUME DEVICE MAJOR/MINOR
8000 0019 0000 0004
ERROR CODE AS DEFINED IN sys/errno.h
          45
BLOCK NUMBER
             246275560
LOGICAL VOLUME DEVICE MAJOR/MINOR
8000 0037 0000 0050
PHYSICAL BUFFER TRANSACTION TIME
                     2
SENSE DATA
0000 0000 0001 D5BB 00C5 0A1E 0000 4C00 0000 0119 B9C8 01DF 00C5 092E 829A 7FA5
0000 0000 0000 0000
---------------------------------------------------------------------------
LABEL:          FCP_ARRAY_ERR4
IDENTIFIER:     D5385D18

Date/Time:       Fri Oct 11 07:08:34 BEIST 2013
Sequence Number: 11006
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           H
Type:            TEMP
Resource Name:   hdisk3         
Resource Class:  disk
Resource Type:   array
Location:        U787A.001.DPM0AV4-P1-C4-T1-W200700A0B8178CC2-L4000000000000

Description
ARRAY OPERATION ERROR

Probable Causes
ARRAY DASD MEDIA
ARRAY DASD DEVICE

Failure Causes
DASD MEDIA
DISK DRIVE

        Recommended Actions
        PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data
SENSE DATA
0A00 2A00 0EAD DDE8 0000 1004 0000 0000 0000 0000 0000 0000 0400 00AA 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 29ED 8000 F705 3207 0000 0000 FE00 0000 0000 0000 0000 0000 0000 0000
0200 0300
---------------------------------------------------------------------------
LABEL:          FCP_ARRAY_ERR3
IDENTIFIER:     D9770360

Date/Time:       Fri Oct 11 07:08:34 BEIST 2013
Sequence Number: 11005
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           H
Type:            PERM
Resource Name:   hdisk3         
Resource Class:  disk
Resource Type:   array
Location:        U787A.001.DPM0AV4-P1-C4-T1-W200700A0B8178CC2-L4000000000000

Description
ARRAY OPERATION ERROR

Probable Causes
ARRAY DASD DEVICE
STORAGE DEVICE CABLE
EB4F

Failure Causes
DISK DRIVE
DISK DRIVE ELECTRONICS
STORAGE DEVICE CABLE
ARRAY CONTROLLER

        Recommended Actions
        PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data
SENSE DATA
0600 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0400 0BAA 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 29ED 8000 F705 3207 0000 0000 1300 0000 0000 0800 0000 0000 0000 0000
0100 0300
---------------------------------------------------------------------------
LABEL:          LVM_IO_FAIL
IDENTIFIER:     613E5F38

Date/Time:       Fri Oct 11 07:08:34 BEIST 2013
Sequence Number: 11004
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           H
Type:            PERM
Resource Name:   LVDD            
Resource Class:  NONE
Resource Type:   NONE
Location:        

Description
I/O ERROR DETECTED BY LVM

Probable Causes
POWER, DRIVE, ADAPTER, OR CABLE FAILURE

        Recommended Actions
        RUN DIAGNOSTICS AGAINST THE FAILING DEVICE

Detail Data
PHYSICAL VOLUME DEVICE MAJOR/MINOR
8000 0019 0000 0004
ERROR CODE AS DEFINED IN sys/errno.h
          45
BLOCK NUMBER
             246275528
LOGICAL VOLUME DEVICE MAJOR/MINOR
8000 0037 0000 0050
PHYSICAL BUFFER TRANSACTION TIME
                     2
SENSE DATA
0000 0000 0001 D5BB 00C5 0A1E 0000 4C00 0000 0119 B9C8 01DF 00C5 092E 829A 7FA5
0000 0000 0000 0000
---------------------------------------------------------------------------
LABEL:          FCP_ARRAY_ERR4
IDENTIFIER:     D5385D18

Date/Time:       Fri Oct 11 07:08:34 BEIST 2013
Sequence Number: 11003
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           H
Type:            TEMP
Resource Name:   hdisk3         
Resource Class:  disk
Resource Type:   array
Location:        U787A.001.DPM0AV4-P1-C4-T1-W200700A0B8178CC2-L4000000000000

Description
ARRAY OPERATION ERROR

Probable Causes
ARRAY DASD MEDIA
ARRAY DASD DEVICE

Failure Causes
DASD MEDIA
DISK DRIVE

        Recommended Actions
        PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data
SENSE DATA
0A00 2A00 0EAD DDC8 0000 1004 0000 0000 0000 0000 0000 0000 0400 00AA 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0000 29ED 8000 F705 3207 0000 0000 FE00 0000 0000 0000 0000 0000 0000 0000
0909 0000
---------------------------------------------------------------------------
LABEL:          TS_MISCFG_ER
IDENTIFIER:     A29426DA

Date/Time:       Wed May 30 22:10:34 BEIST 2012
Sequence Number: 10936
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           U
Type:            PERM
Resource Name:   topsvcs         
Resource Class:  NONE
Resource Type:   NONE
Location:        
VPD:            

Description
Local adapter misconfiguration detected

Probable Causes
Local adapter assigned incorrect IP address

Install Causes
Local adapter assigned incorrect IP address

        Recommended Actions
        Correct adapter IP address
        If the problem persists, restart Topology Services daemon.

Detail Data
DETECTING MODULE
rsct,nim_control.C,1.39.1.1,4831              
ERROR ID
6OP0ZW0OdWlD/wSJ0t4E.8....................
REFERENCE CODE
                                          
Adapter interface name
en0
Adapter offset
           0
Adapter expected IP address
10.1.1.186
---------------------------------------------------------------------------
LABEL:          TS_MISCFG_ER
IDENTIFIER:     A29426DA

Date/Time:       Wed May 30 21:47:03 BEIST 2012
Sequence Number: 10921
Machine Id:      00C50A1E4C00
Node Id:         db180
Class:           U
Type:            PERM
Resource Name:   topsvcs         
Resource Class:  NONE
Resource Type:   NONE
Location:        
VPD:            

Description
Local adapter misconfiguration detected

Probable Causes
Local adapter assigned incorrect IP address

Install Causes
Local adapter assigned incorrect IP address

        Recommended Actions
        Correct adapter IP address
        If the problem persists, restart Topology Services daemon.

Detail Data
DETECTING MODULE
rsct,nim_control.C,1.39.1.1,4831              
ERROR ID
6OP0ZW0LHWlD/lfo.t4E.8....................
REFERENCE CODE
                                          
Adapter interface name
en0
Adapter offset
           0
Adapter expected IP address
10.1.1.186
[db180]:/oracle/app/product/9.2/network/admin$

回复 只看该作者 道具 举报

4#
发表于 2013-10-11 12:14:04
Description
I/O ERROR DETECTED BY LVM

比较明确吧？　找IBM厂商

回复 只看该作者 道具 举报

5#
发表于 2013-10-11 12:21:35
看到了，谢谢ml，没用过errpt这个命令，学习了！

回复 只看该作者 道具 举报

6#
发表于 2013-10-11 13:36:59
学习了。

回复 只看该作者 道具 举报

返回列表
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

QQ|手机版|Archiver|Oracle数据库数据恢复、性能优化

GMT+8, 2024-6-1 22:22 , Processed in 0.053620 second(s), 21 queries .

Powered by Discuz! X2.5

© 2001-2012 Comsenz Inc.

回顶部
TEL/電話+86 13764045638
Email service@parnassusdata.com
QQ 47079569