RAC 备份恢复到同版本单实例（ASM）报错！！

xieyihn

11.2.0.3 —64bit RAC + OEL 5.7
一直都没有验证过RAC备份 今天新装了一台单实例(ASM) ， 想将其备份恢复过去 ，但是发现恢复目的地是ASM的文件在执行时总是报错！
步骤如下：
1. 在单机环境下使用Grid用户安装Grid Infrastructure (Configure Oracle Grid Infrastrure for a Standalone Server)
2.Oracle用户安装Database软件 (Install database software only)
3.将备份拷贝至目的主机准备还原
4.恢完成pfile，并去掉和RAC相关的参数
5.恢复control file的时候报错如下：（pfile中参数：*.control_files='+DATA/e1db/controlfile/current.261.775585531'）

RMAN> restore controlfile from '/mnt/backup/1lneq1sp_1_1';
Starting restore at 11-JUL-2012 12:31:17
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=774 device type=DISK
channel ORA_DISK_1: restoring control file
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-00601: fatal error in recovery manager
RMAN-03004: fatal error during execution of command
ORA-01092: ORACLE instance terminated. Disconnection forced
RMAN-03002: failure of restore command at 07/11/2012 12:31:29
ORA-03113: end-of-file on communication channel

[oracle@huifu ~]$ tail  /u01/app/oracle/diag/rdbms/e1db/e1db/trace/alert_e1db.log
Wed Jul 11 12:31:27 2012
MARK started with pid=24, OS id=15285
NOTE: MARK has subscribed
Errors in file /u01/app/oracle/diag/rdbms/e1db/e1db/trace/e1db_rbal_15281.trc  (incident=185):
ORA-00600: internal error code, arguments: [kfdskAlloc0], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/e1db/e1db/incident/incdir_185/e1db_rbal_15281_i185.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Errors in file /u01/app/oracle/diag/rdbms/e1db/e1db/trace/e1db_rbal_15281.trc:
ORA-00600: internal error code, arguments: [kfdskAlloc0], [], [], [], [], [], [], [], [], [], [], []
RBAL (ospid: 15281): terminating the instance due to error 488
Wed Jul 11 12:31:29 2012
opiodr aborting process unknown ospid (15266) as a result of ORA-1092
Wed Jul 11 12:31:29 2012
ORA-1092 : opitsk aborting process
Wed Jul 11 12:31:29 2012
ORA-1092 : opitsk aborting process
Wed Jul 11 12:31:29 2012
System state dump requested by (instance=1, osid=15281 (RBAL)), summary=[abnormal instance termination].
System State dumped to trace file /u01/app/oracle/diag/rdbms/e1db/e1db/trace/e1db_diag_5797.trc
Dumping diagnostic data in directory=[cdmp_20120711123129], requested by (instance=1, osid=15281 (RBAL)), summary=[abnormal instance termination].
Instance terminated by RBAL, pid = 15281

oracle@huifu ~]$ tail  /u01/app/grid/diag/asm/+asm/+ASM/trace/alert_+ASM.log
Wed Jul 11 11:55:05 2012
NOTE: client e1db:e1db registered, osid 6072, mbr 0x0
Wed Jul 11 11:56:01 2012
Time drift detected. Please check VKTM trace file for more details.
Wed Jul 11 11:59:22 2012
NOTE: client e1db:e1db deregistered
Wed Jul 11 12:31:24 2012
NOTE: client e1db:e1db registered, osid 15277, mbr 0x0
NOTE: ASM client e1db:e1db disconnected unexpectedly.
NOTE: check client alert log.
NOTE: Trace records dumped in trace file /u01/app/grid/diag/asm/+asm/+ASM/trace/+ASM_ora_15277.trcNOTE: Trace records dumped in trace file /u01/app/grid/diag/asm/+asm/+ASM/trace/+ASM_ora_15277.trc


[root@huifu ~]# tail -35 /u01/app/grid/diag/asm/+asm/+ASM/trace/+ASM_ora_15277.trc
2012-07-11 11:59:22.908195 :8000ECD9:KFNC:kfn.c@4092:kfnclDelete(): clearing child state objects
2012-07-11 11:59:22.908215 :8000ECDA:KFNU:kfn.c@4103:kfnclDelete(): removing client 2012-07-11 11:59:22.908447 :8000ECDB:KFNS:kfn.c@738:kfnDispatch(): completed KFNOP=2 callcnt=118
2012-07-11 11:59:22.910264 :8000ECDC:db_trace:kss.c@1414:kssdch(): [10809:18:0] kssdch(0x70fc9840 = process, 2) 2 0 exit
2012-07-11 11:59:22.910361 :8000ECDD:db_trace:kst.c@700:kstpsodel(): [10280:18:0] kst: process state object about to be deleted
2012-07-11 12:31:24.740838 :80015D1F:db_trace:kst.c@675:kstipg(): [10280:18:0] kst: process state object created on 07-11 12:31:24.740
2012-07-11 12:31:24.740839 :80015D20:db_trace:kst.c@681:kstipg(): [10280:18:0] kst: process info: ospid=15277 pso_num=18 pso_serial#=7
2012-07-11 12:31:24.740935 :80015D21:db_trace:kso.c@4268:ksonfy(): [10420:18:0] kso: new process: pid=15277 (legacy spawn)
2012-07-11 12:31:24.744549 :80015D22:KFNS:kfn.c@708:kfnDispatch(): calling server stub for KFNOP=1
2012-07-11 12:31:24.744570 :80015D23:KFNS:kfns.c@661:kfnsInstanceReg(): kfnsInstanceReg: e1db:e1db
2012-07-11 12:31:24.744571 :80015D24:KFNS:kfns.c@663:kfnsInstanceReg(): [client PID: 15273]
2012-07-11 12:31:24.744587 :80015D25:KFNU:kfn.c@1110:kfnclLookupPriv(): kfnclLookup e1db:e1db keep=1 at kfns.c:704
2012-07-11 12:31:24.744601 :80015D26:KFNS:kfns.c@809:kfnsInstanceReg(): kfnsInstanceReg: client version=11020003 compat=11020000 flags=0x0
2012-07-11 12:31:24.744601 :80015D27:KFNS:kfns.c@820:kfnsInstanceReg(): kfnsInstanceReg: rcvd client type=0x101
2012-07-11 12:31:24.751980 :80015D28:KFNS:kfn.c@738:kfnDispatch(): completed KFNOP=1 callcnt=136
2012-07-11 12:31:28.167557 :80015D59:KFNS:kfn.c@708:kfnDispatch(): calling server stub for KFNOP=5
2012-07-11 12:31:28.229819 :80015D6C:KFNU:kfn.c@5266:kfnmsg_Dump(): kfnsBg (kfnmsg) op=10 (KFNMS_GROUPUSE) (gnum) [1.2444871737]
2012-07-11 12:31:28.229824 :80015D6D:KFNU:kfns.c@1784:kfnsBackground(): kfnsBackground got targeted message
2012-07-11 12:31:28.229887 :80015D6E:KFNU:kfns.c@1937:kfnsBackground(): kfnsBackground completed in 0 seconds (KFNPM=0)
2012-07-11 12:31:28.229889 :80015D6F:KFNS:kfn.c@738:kfnDispatch(): completed KFNOP=5 callcnt=138
2012-07-11 12:31:28.230065 :80015D70:KFNS:kfn.c@708:kfnDispatch(): calling server stub for KFNOP=5
2012-07-11 12:31:28.230069 :80015D71:KFNU:kfns.c@1720:kfnsBackground(): kfnsBackground consuming in-progress message typ=10 unread=1 status=0xfffffff1
2012-07-11 12:31:28.230070 :80015D72:KFNU:kfns.c@1962:kfnsConsume(): kfnsConsume message 0x6fee5a38 status=0xfffffff1 flags=0x0
2012-07-11 12:31:33.219119 :80015DD3:KFNU:kfns.c@1937:kfnsBackground(): kfnsBackground completed in 5 seconds (KFNPM=12)
2012-07-11 12:31:33.219125 :80015DD4:KFNS:kfn.c@738:kfnDispatch(): completed KFNOP=5 callcnt=140
2012-07-11 12:31:33.255151 :80015DD5:KFNU:kfn.c@4012:kfnclDelete(): kfnclDelete client=0x6e15f708 action=2
-------------------------------------------------------------------------------
Trace Bucket Dump End: default bucket for process 18 (osid: 15277)
KSI PGA Bucket:
-------------------------------------------------------------------------------
Trace Bucket Dump Begin: KSI
TIME(*=approx):SEQ:FILE@LINE:FUNCTION: DATA
-------------------------------------------------------------------------------
-------------------------------------------------------------------------------
Trace Bucket Dump End: KSI

(PS:修改初始化参数中control_files的位置为文件系统是可以成功，但是在执行restore databas的时候又会报类似的错误)
附上状态：
[grid@huifu ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    huifu      
ora....ER.lsnr ora....er.type    ONLINE    ONLINE    huifu      
ora.asm        ora.asm.type     ONLINE    ONLINE    huifu      
ora.cssd       ora.cssd.type   ONLINE    ONLINE    huifu      
ora.diskmon    ora....on.type OFFLINE   OFFLINE               
ora.evmd       ora.evm.type   ONLINE    ONLINE    huifu      
ora.ons        ora.ons.type     OFFLINE   OFFLINE      
在此请教大师，谢谢了！

alert_e1db.txt (5.05 KB, 下载次数: 1097)

2012-7-11 21:21 上传

点击文件名下载附件

[ 本帖最后由 xieyihn 于 2012-7-11 21:21 编辑 ]

ylw6006

ASM磁盘组里面的目录没建好吧！使用asmcmd命令进行看看！

xieyihn

ASMCMD> pwd
+data
ASMCMD> mkdir e1db
ASMCMD> cd e1db
ASMCMD> mkdir controlfile
ASMCMD> ls
controlfile/

RMAN> restore controlfile from '/mnt/backup/1lneq1sp_1_1';
Starting restore at 11-JUL-2012 14:56:27
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=12 device type=DISK
channel ORA_DISK_1: restoring control file
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of restore command at 07/11/2012 14:57:23
RMAN-10038: database session for channel ORA_DISK_1 terminated unexpectedly

还是一样

Maclean Liu(刘相兵

请上传 完整的 alert_e1db.log 和 alert_+ASM.log
有可能是bug引起的该问题

xieyihn

刘大  
altert_e1db.log传上来了 （分别是执行nomount---mount----restore database产生的）
alter_+ASM.log之前被我清空了（目前正在执行dbca建库，有需要后续补上）

xieyihn

昨天怀疑是ASM问题，后来dbca建库（ASM作存储）一切正常，排除了ASM的问题。
奇怪的是，建库完成后
再次执行restore database，居然可以恢复了啊？？（好像建了个库就打通了任督二脉似的感觉）
alert_e1db.log也只有一个错误：
Wed Jul 11 22:17:12 2012
ERROR: failed to establish dependency between database e1db and diskgroup resource ora.DATA.dg

ShineCQY

RMAN-03002: failure of restore command at 07/11/2012 14:57:23RMAN-10038: database session for channel ORA_DISK_1 terminated unexpectedly极有可能是ASM磁盘组，或者存储出现了问题。

xieyihn

绝对不是ASM磁盘出现了问题
我dbca建完一个单实例库(ASM) 后，再做restore database  已经恢复成功
看起来确实像一个BUG

[ 本帖最后由 xieyihn 于 2012-7-12 23:54 编辑 ]