TSM全量备份报错，求帮忙分析数据库问题还是磁带库的问题

lanfeng356

alter日志报错如下：

Tue Aug 21 04:49:57 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9255.trc:                                                                          
ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []
ORA-19624: operation failed, retry possible                                                                                         
ORA-19502: write error on file "bk_21773_1_791867289", blockno 1281 (blocksize=1024)                                                
ORA-27030: skgfwrt: sbtwrite2 returned error                                                                                       
ORA-19511: Error received from media manager layer, error text:                                                                     
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.                                            
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1078                                                                                 
Tue Aug 21 04:49:58 EAT 2012                                                                                                        
Trace dumping is performing id=[cdmp_20120821044958]                                                                                
Tue Aug 21 04:49:58 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9295.trc:                                                                          
ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []
ORA-19624: operation failed, retry possible                                                                                         
ORA-19502: write error on file "bk_21774_1_791867290", blockno 1281 (blocksize=1024)                                                
ORA-27030: skgfwrt: sbtwrite2 returned error                                                                                       
ORA-19511: Error received from media manager layer, error text:                                                                     
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.                                            
ORA-06512: at "SYS.DBMS_BACKUP_RESTORE", line 1078                                                                                 
Tue Aug 21 04:50:00 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9295.trc:                                                                          
ORA-00600: internal error code, arguments: [504], [0xC000000D7F832CB0], [32], [1], [session idle bit], [14], [0], [0x000000000]     
Tue Aug 21 04:50:00 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9295.trc:                                                                          
ORA-00600: internal error code, arguments: [17099], [], [], [], [], [], [], []                                                      
ORA-00600: internal error code, arguments: [504], [0xC000000D7F832CB0], [32], [1], [session idle bit], [14], [0], [0x000000000]     
Tue Aug 21 04:50:13 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9243.trc:                                                                          
ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []
Tue Aug 21 04:50:19 EAT 2012                                                                                                        
Errors in file /oraclelog/bildb/udump/bildb1_ora_9304.trc:                                                                          
ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []
Tue Aug 21 05:00:21 EAT 2012                                                                                                        
ALTER SYSTEM ARCHIVE LOG                                                                                                            
Tue Aug 21 05:00:21 EAT 2012

lanfeng356

=======================TSM报错======================
bildb1:/oracle/scripts/log> tail -100 bkup_full-12-8.log
input datafile fno=00216 name=/bildata_30/TBS_BIL15_003.dat
input datafile fno=00352 name=/bildata_30/TBS_BIL27_008.dat
input datafile fno=00487 name=/bildata_32/TBS_BIL41_003.dat
input datafile fno=00622 name=/bildata_33/TBS_BIL54_008.dat
input datafile fno=00757 name=/bildata_36/TBS_BIL_IBJ19_001.dat
input datafile fno=00892 name=/bildata_33/TBS_BIL_IBJ52_004.dat
input datafile fno=01029 name=/bildata_05/bil_droam_010.dat
input datafile fno=01164 name=/bildata_06/TBS_BIL_BJ43_13.dbf
input datafile fno=01298 name=/bildata_11/TBS_BIL_DROAM_16.dbf
channel ch02: starting piece 1 at 20120821030810
channel ch04: finished piece 1 at 20120821030810
piece handle=bk_21767_1_791866616 tag=HOT_DB_BK_LEVEL0 comment=API Version 2.0,MMS Version 5.5.1.0
channel ch04: backup set complete, elapsed time: 00:11:14
channel ch04: starting incremental level 0 datafile backupset
channel ch04: specifying datafile(s) in backupset
input datafile fno=00082 name=/bildata_30/TBS_BIL03_005.dat
input datafile fno=00217 name=/bildata_30/TBS_BIL15_004.dat
input datafile fno=00353 name=/bildata_30/TBS_BIL27_009.dat
input datafile fno=00488 name=/bildata_32/TBS_BIL41_004.dat
input datafile fno=00623 name=/bildata_33/TBS_BIL54_009.dat
input datafile fno=00758 name=/bildata_36/TBS_BIL_IBJ19_002.dat
input datafile fno=00893 name=/bildata_34/TBS_BIL_IBJ53_001.dat
input datafile fno=01030 name=/bildata_05/bil_droam_011.dat
input datafile fno=01165 name=/bildata_14/TBS_BIL_BJ44_11.dbf
input datafile fno=01299 name=/bildata_11/TBS_BIL_DROAM_17.dbf
channel ch04: starting piece 1 at 20120821030811
channel ch01: finished piece 1 at 20120821030826
piece handle=bk_21769_1_791866648 tag=HOT_DB_BK_LEVEL0 comment=API Version 2.0,MMS Version 5.5.1.0
channel ch01: backup set complete, elapsed time: 00:10:58
channel ch01: starting incremental level 0 datafile backupset
channel ch01: specifying datafile(s) in backupset
input datafile fno=00083 name=/bildata_30/TBS_BIL03_006.dat
input datafile fno=00218 name=/bildata_30/TBS_BIL15_005.dat
input datafile fno=00354 name=/bildata_30/TBS_BIL27_010.dat
input datafile fno=00489 name=/bildata_32/TBS_BIL41_005.dat
input datafile fno=00624 name=/bildata_33/TBS_BIL54_010.dat
input datafile fno=00759 name=/bildata_36/TBS_BIL_IBJ19_003.dat
input datafile fno=00894 name=/bildata_35/TBS_BIL_IBJ54_001.dat
input datafile fno=01031 name=/bildata_05/bil_droam_012.dat
input datafile fno=01166 name=/bildata_14/TBS_BIL_BJ44_12.dbf
input datafile fno=01300 name=/bildata_11/TBS_BIL_DROAM_18.dbf
channel ch01: starting piece 1 at 20120821030827
channel ch03: finished piece 1 at 20120821031142
piece handle=bk_21770_1_791866649 tag=HOT_DB_BK_LEVEL0 comment=API Version 2.0,MMS Version 5.5.1.0
channel ch03: backup set complete, elapsed time: 00:14:13
channel ch03: starting incremental level 0 datafile backupset
channel ch03: specifying datafile(s) in backupset
input datafile fno=00084 name=/bildata_30/TBS_BIL03_007.dat
input datafile fno=00219 name=/bildata_30/TBS_BIL15_006.dat
input datafile fno=00355 name=/bildata_31/TBS_BIL28_001.dat
input datafile fno=00490 name=/bildata_32/TBS_BIL41_006.dat
input datafile fno=00625 name=/bildata_34/TBS_BIL55_001.dat
input datafile fno=00760 name=/bildata_36/TBS_BIL_IBJ19_004.dat
input datafile fno=00895 name=/bildata_35/TBS_BIL_IBJ54_002.dat
input datafile fno=01032 name=/bildata_05/bil_droam_013.dat
input datafile fno=01167 name=/bildata_12/TBS_BIL_BJ45_11.dbf
input datafile fno=01301 name=/bildata_11/TBS_BIL_DROAM_19.dbf
channel ch03: starting piece 1 at 20120821031142
RMAN-03009: failure of backup command on ch06 channel at 08/21/2012 04:49:26
ORA-19502: write error on file "bk_21772_1_791867251", blockno 1025 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.
channel ch06 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch01 channel at 08/21/2012 04:50:00
ORA-19502: write error on file "bk_21775_1_791867306", blockno 1281 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.
channel ch01 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch02 channel at 08/21/2012 04:50:00
ORA-03114: not connected to ORACLE
ORA-12152: TNS:unable to send break message
channel ch02 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch04 channel at 08/21/2012 04:50:01
ORA-03113: end-of-file on communication channel

ORA-07445: exception encountered: core dump [0000000000000000] [SIGSEGV] [Invalid permissions for mapped object] [0x000000000] [] []
ORA-19502: write error on file "bk_21774_1_791867290", blockno 1281 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.
channel ch04 disabled, job failed on it will be run on another channel
RMAN-03009: failure of backup command on ch05 channel at 08/21/2012 04:50:01
ORA-19502: write error on file "bk_21771_1_791867115", blockno 1281 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.
channel ch05 disabled, job failed on it will be run on another channel
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on ch03 channel at 08/21/2012 05:03:44
ORA-19502: write error on file "bk_21776_1_791867502", blockno 1281 (blocksize=1024)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.

Recovery Manager complete.
12-8-21.5:3:46

Maclean Liu(刘相兵

ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.


比较明显是TSM的额问题，   把 ANS1235E (RC-72) 这个代码信息给TSM的供应商

Maclean Liu(刘相兵

可以参考文档

RMAN BACKUP FAILS WITH ORA-19511 ANS1235E (RC-72) [ID 1342161.1]

IBM solved the problem. The issue occurs with any Lanfree version + TSM Server 6.2.2.2. When it attempts to mount a tape and there was no scratch tape available, TSM Server abruptly terminates.

TSM Server was upgraded to 6.2.2.30 to solve the issue.

lanfeng356

原帖由 maclean 于 2012-8-21 11:05 发表
ORA-19511: Error received from media manager layer, error text:
   ANS1235E (RC-72)  An unknown system error has occurred from which TSM cannot recover.


比较明显是TSM的额问题，   把 ANS1235E (RC-72)  ...

因为在报错中，有
ORA-03114: not connected to ORACLE
ORA-12152: TNS:unable to send break message

这两个报错提示，所以不确定是不是数据库的问题。我和TSM的人讨论一下，看看升级到 6.2.2.30版本之后效果。

非常感谢版主

[ 本帖最后由 lanfeng356 于 2012-8-21 11:17 编辑 ]

lanfeng356

感谢版主，将版主提到的文档，打包附件

xinxin415415

遇到过类似的问题，问题点出现TSM服务器上