RMAN备份报错：ORA-271192; ORA-19511

Caleon

OS : AIX  7.1.0.2
高可用 : HACMP 6.1
ORACLE : 11.2.0.3
备份软件： TSM 6.3 for Oracle

问题描述：

      系统运行了接近一年，之前使用TSM备份oracle都好好的，最近一个月，总会出现这个报错，在 support.oracle.com 上面也没有找到解决办法，求助论坛的各位大神，大家遇到过这个情况吗？ 应该怎么解决呢？

RMAN备份命令如下：

RMAN> run{
2> allocate channel t1 type 'SBT_TAPE' parms 'ENV=(TDPO_OPTFILE=/usr/tivoli/tsm/client/oracle/bin64/tdpo.opt)';
3> allocate channel t2 type 'SBT_TAPE' parms 'ENV=(TDPO_OPTFILE=/usr/tivoli/tsm/client/oracle/bin64/tdpo.opt)';
4> backup incremental level 0 format '_L0_%d_%T_%u' database include current controlfile;
5> backup spfile format '_spfile_%U';
6> sql 'alter system archive log current';
7> backup format 'e_arch_%d_%T_%u' archivelog all;
8> release channel t1;
9> release channel t2;
10> crosscheck backup;
11> crosscheck archivelog all;
12> delete noprompt expired backup;
13> delete noprompt obsolete;  
14> delete noprompt expired archivelog all;
15> delete noprompt archivelog all completed before 'sysdate-30';
16> }


RMAN 报错如下：

using target database control file instead of recovery catalog
allocated channel: t1
channel t1: SID=394 device type=SBT_TAPE
channel t1: Data Protection for Oracle: version 6.3.0.0

allocated channel: t2
channel t2: SID=483 device type=SBT_TAPE
channel t2: Data Protection for Oracle: version 6.3.0.0

Starting backup at 24-NOV-13
channel t1: starting incremental level 0 datafile backup set
channel t1: specifying datafile(s) in backup set
input datafile file number=00004 name=/oracle/MEP/sapdata4/sr3db_1/sr3db.data1
input datafile file number=00002 name=/oracle/MEP/sapdata1/sysaux_1/sysaux.data1
channel t1: starting piece 1 at 24-NOV-13
channel t2: starting incremental level 0 datafile backup set
channel t2: specifying datafile(s) in backup set
input datafile file number=00003 name=/oracle/MEP/sapdata2/undo_1/undo.data1
input datafile file number=00001 name=/oracle/MEP/sapdata1/system_1/system.data1
channel t2: starting piece 1 at 24-NOV-13
channel t2: finished piece 1 at 24-NOV-13
piece handle=_L0_MEP_20131124_btopo06l tag=TAG20131124T043013 comment=API Version 2.0,MMS Version 6.3.0.0
channel t2: backup set complete, elapsed time: 00:05:25
channel t2: starting incremental level 0 datafile backup set
channel t2: specifying datafile(s) in backup set
including current control file in backup set
channel t2: starting piece 1 at 24-NOV-13
channel t2: finished piece 1 at 24-NOV-13
piece handle=_L0_MEP_20131124_buopo0gq tag=TAG20131124T043013 comment=API Version 2.0,MMS Version 6.3.0.0
channel t2: backup set complete, elapsed time: 00:00:45
channel t2: starting incremental level 0 datafile backup set
channel t2: specifying datafile(s) in backup set
including current SPFILE in backup set
channel t2: starting piece 1 at 24-NOV-13
channel t2: finished piece 1 at 24-NOV-13
piece handle=_L0_MEP_20131124_bvopo0i9 tag=TAG20131124T043013 comment=API Version 2.0,MMS Version 6.3.0.0
channel t2: backup set complete, elapsed time: 00:00:45
released channel: t1
released channel: t2
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on t1 channel at 11/24/2013 04:45:50
ORA-27192: skgfcls: sbtclose2 returned error - failed to close file
ORA-19511: Error received from media manager layer, error text:
   ANS1301E (RC1)    Server detected system error

Recovery Manager complete.
Sun Nov 24 04:45:52 CST 2013


TSM中的 dsmerror.log 在相应时间的报错如下：

11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS4994S TDP Oracle AIX ANU0599 TDP for Oracle: (21692442): => (mesdb_ora) ANS1301E (RC1)    Server detected system error

11/24/13   04:45:45 ANS4992W TDP Oracle AIX ANU0599 TDP for Oracle: (21692442): =>(mesdb_ora) ANU2604W The object /mesdb_fs/ /_L0_MEP_20131124_bsopo06l was not found on the TSM Server


我单独执行了

crosscheck backup;
crosscheck archivelog all;
delete noprompt expired backup;
delete noprompt obsolete;  
delete noprompt expired archivelog all;

我也按照 文档 ：Doc ID 304480.1
执行了：
RMAN> configure controlfile autobackup off;

RMAN> backup current controlfile;

NOTE : An AUTOBACKUP is also making an backup of the controlfile when the database
       structure changes. This is now skipped and has to be done manually.


但是备份的报错还是这样，请问这是什么原因引起的？应该怎么修复呢？

xifenfei

11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS1301E Server detected system error
11/24/13   04:45:35 ANS4994S TDP Oracle AIX ANU0599 TDP for Oracle: (21692442): => (mesdb_ora) ANS1301E (RC1)    Server detected system error

TSM的问题，请求相关工程师介入，超出了db的范畴