数据库在线日志删不了

oracle_ray1986

环境描述：RHEL6.5+oracle 11.2.0.4.0     双节点RAC+ASM

问题描述：
2节点正常，1节点后台日志报错：
ORACLE Instance orcl1 - Archival Error
ORA-16038: log 5 sequence# 14651 cannot be archived
ORA-00742: Log read detects lost write in thread %d sequence %d block %d
ORA-00312: online log 5 thread 1: '+DATA/orcl/redo05.log'
Archived Log entry 9227 added for thread 1 sequence 14663 ID 0x534c92d9 dest 1:
Archiver process freed from errors. No longer stopped
ARCH: Archival stopped, error occurred. Will continue retrying
ORACLE Instance orcl1 - Archival Error
ORA-16014: log 5 sequence# 14651 not archived, no available destinations
ORA-00312: online log 5 thread 1: '+DATA/orcl/redo05.log'

查询在线日志：
SQL> select a.thread#,a.group#,bytes/1024/1024 MB,a.status,b.status,b.member  from v$log a,v$logfile b where a.group#=b.group# order by 2;

   THREAD#     GROUP#         MB STATUS           STATUS  MEMBER
---------- ---------- ---------- ---------------- ------- ------------------------------
         1          1        500 INACTIVE                 +DATA/orcl/redo01.log
         1          2        500 CURRENT                  +DATA/orcl/redo02.log
         2          3        500 INACTIVE                 +DATA/orcl/redo03.log
         2          4        500 INACTIVE                 +DATA/orcl/redo04.log
         1          5        500 INACTIVE                 +DATA/orcl/redo05.log
         1          6        500 INACTIVE                 +DATA/orcl/redo06.log
         2          7        500 CURRENT                  +DATA/orcl/redo07.log
         2          8        500 INACTIVE                 +DATA/orcl/redo08.log

想删除在线日志5
SQL> alter database drop logfile group 5;
alter database drop logfile group 5
*
ERROR at line 1:
ORA-00350: log 5 of instance orcl1 (thread 1) needs to be archived
ORA-00312: online log 5 thread 1: '+DATA/orcl/redo05.log'

切换日志也切不了，一直hang在那里，10046追踪，也没有等待

SQL> alter system switch logfile;
^Calter system switch logfile
*
ERROR at line 1:
ORA-01013: user requested cancel of current operation

SQL> alter system archive log current;
alter system archive log current
*
ERROR at line 1:
ORA-16014: log 5 sequence# 14651 not archived, no available destinations
ORA-00312: online log 5 thread 1: '+DATA/orcl/redo05.log'

请问还需要哪些信息可以帮忙诊断的？

oracle_ray1986

补充一下，ASM磁盘权限正确
SQL> select name,path from v$asm_disk order by 1;

NAME                           PATH
------------------------------ --------------------
DATA_0000                      /dev/dm-8
DATA_0001                      /dev/dm-5
DATA_0002                      /dev/dm-4
DATA_0003                      /dev/dm-6
OCRVOTE_0000                   /dev/dm-3
OCRVOTE_0001                   /dev/dm-10
OCRVOTE_0002                   /dev/dm-9

[dbra@rac01 ~]$ ll /dev/dm*
brw-rw---- 1 root disk     253,  0 10月 17 12:49 /dev/dm-0
brw-rw---- 1 root disk     253,  1 10月 17 12:49 /dev/dm-1
brw-rw---- 1 grid oinstall 253, 10 11月  4 14:10 /dev/dm-10
brw-rw---- 1 root disk     253, 11 10月 17 12:49 /dev/dm-11
brw-rw---- 1 root disk     253, 12 10月 17 12:49 /dev/dm-12
brw-rw---- 1 root disk     253, 13 10月 17 12:49 /dev/dm-13
brw-rw---- 1 root disk     253,  2 10月 17 12:49 /dev/dm-2
brw-rw---- 1 grid oinstall 253,  3 11月  4 14:10 /dev/dm-3
brw-rw---- 1 grid oinstall 253,  4 11月  4 14:10 /dev/dm-4
brw-rw---- 1 grid oinstall 253,  5 11月  4 14:10 /dev/dm-5
brw-rw---- 1 grid oinstall 253,  6 11月  4 14:10 /dev/dm-6
brw-rw---- 1 root disk     253,  7 10月 17 12:49 /dev/dm-7
brw-rw---- 1 grid oinstall 253,  8 11月  4 14:10 /dev/dm-8
brw-rw---- 1 grid oinstall 253,  9 11月  4 14:10 /dev/dm-9

归档目录切到本地也是同样报错

Liu Maclean(刘相兵

ORACLE Instance orcl1 - Archival Error
ORA-16038: log 5 sequence# 14651 cannot be archived
ORA-00742: Log read detects lost write in thread %d sequence %d block %d
ORA-00312: online log 5 thread 1: '+DATA/orcl/redo05.log'
Archived Log entry 9227 added for thread 1 sequence 14663 ID 0x534c92d9 dest 1:
Archiver process freed from errors. No longer stopped
ARCH: Archival stopped, error occurred. Will continue retrying


00742, 00000, "Log read detects lost write in thread %d sequence %d block %d"
// *Cause:  Either a write issued by Oracle was lost by the underlying
//          operating system or storage system or an Oracle internal error
//          occurred.
// *Action: The trace file shows the lost write location. Dump the problematic
//          log file to see whether it is a real lost write. Contact Oracle
//          Support Services.


ORA-742 发现 有写 丢失

尝试

alter database drop unarchived  logfile group 5;

oracle_ray1986

Liu Maclean(刘相兵 发表于 2016-11-4 13:51
ORACLE Instance orcl1 - Archival Error
ORA-16038: log 5 sequence# 14651 cannot be archived
ORA-00742 ...

alter database clear unarchived logfile group 5后恢复正常，今天logfile group 6又出现同样的情况，请问这是存储有问题吗？从哪些方面排查出现问题的根本原因？