问题说明
客户环境主库4节点RAC11.2.0.4,单实例DG环境,DG由于空间不足,导致同步中断,由于DG备库未应用的归档主库都再,本次恢复的方式,是开启dg mrp进程,自动同步追上主库。
以下遇到的问题,都在此过程中,遇到的报错。
一 dg环境遇到
ORA-00353 ORA-00334 如果主库还存在归档日志,则可以mv ,rm删除备库有问题的归档,让d*生gap,主库会再次像备库传输归档日志
另一种方法,就是如果主库无法自动像备库传输日志,可以从主库scp归档至备库dg,注册归档后,解决问题。
其次,本次通过主库,dg alert排除存在异常现象,也就是说再本次问题前,alert日志中并未出现日志块损坏现象!
ORA-354 ORA-353 Corrupt Redo Log Block Header against online redolog using EMC/Cisco SANTap Service (Doc ID 779711.1)
ORA-354 ORA-353 and ORA-312 on Redo Log Group members (Doc ID 332672.1)
hu Nov ::
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_4_31416_gxf6v6p0_.arc
Incomplete read from log member '/oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxc023sj_.arc'.
Trying next member.
Errors in file /u01/app/oracle/diag/rdbms/newora901dg/ora901/trace/ora901_pr00_9153.trc (incident=):
ORA-: log corruption near block change time // ::
ORA-: archived log: '/oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxc023sj_.arc'
Incident details in: /u01/app/oracle/diag/rdbms/newora901dg/ora901/incident/incdir_192300/ora901_pr00_9153_i192300.trc
Errors with log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_4_31416_gxf6v6p0_.arc
MRP0: Background Media Recovery terminated with error
Errors in file /u01/app/oracle/diag/rdbms/newora901dg/ora901/trace/ora901_pr00_9153.trc:
ORA-: corrupt redo log block header
ORA-: log corruption near block change time // ::
ORA-: archived log: '/oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxc023sj_.arc'
Thu Nov ::
Dumping diagnostic data in directory=[cdmp_20191121221305], requested by (instance=, osid= (PR00)), summary=[incident=].
Recovery interrupted!
Recovered data files to a consistent state at change
Thu Nov ::
MRP0: Background Media Recovery process shutdown (ora901)
Thu Nov ::
Sweep [inc][]: completed
Sweep [inc][]: completed
Sweep [inc2][]: completed
Sweep [inc2][]: completed
MRP0: Background Media Recovery process shutdown (ora901) 操作:
dg环境
mv 有问题的归档 xxx.bak 后,dg备库启动Mrp进程
SQL> recover managed standby database disconnect from session;
Thu Nov ::
ALTER DATABASE RECOVER managed standby database disconnect from session
Attempt to start background Managed Standby Recovery process (ora901)
Thu Nov ::
MRP0 started with pid=, OS id=
MRP0: Background Managed Standby Recovery process started (ora901)
started logmerger process
Thu Nov ::
Managed Standby Recovery not using Real Time Apply
Parallel Media Recovery started with slaves
Waiting for all non-current ORLs to be archived...
All non-current ORLs have been archived.
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_2_47491_gxf6t3v7_.arc
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxc023sj_.arc
Error opening /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxc023sj_.arc
Attempting refetch
Media Recovery Waiting for thread sequence
Fetching gap sequence in thread , gap sequence -
Thu Nov ::
RFS[]: Allowing overwrite of partial archivelog for thread sequence
RFS[]: Opened log for thread sequence dbid - branch
Archived Log entry added for thread sequence rlc ID 0x948808ac dest :
Completed: ALTER DATABASE RECOVER managed standby database disconnect from session
Thu Nov ::
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46650_gxf7ctdd_.arc
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_3_31565_gxbzzfxk_.arc
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_4_31416_gxf6v6p0_.arc
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_4_31417_gxbzvr69_.arc
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_1_46651_gxc023sz_.arc
#备选方案,如果是10G环境,备库产生gap,但是主库很可能并不会再次将归档传输到备库,因此需要手工scp归档日志传输至备库。
SQL> select name,thread# from v$archived_log where sequence#=46650;
NAME
------------------------------------------------------------------------
+FRA/newora901/archivelog/2019_11_19/thread_1_seq_46650.4973.1024753747
ASMCMD> cp thread_1_seq_46650.4973.1024753747 /home/grid/thread_1_seq_46650.arc
copying +FRA/newora901/archivelog/2019_11_19/thread_1_seq_46650.4973.1024753747 -> /home/grid/thread_1_seq_46650.arc
scp 传输归档到备库
SQL> ALTER DATABASE REGISTER LOGFILE '/zz/xxx.arc';
二 DG同步遇到如下ORA 600报错,MOS并未找到相关文档
本次通过将报错的上一个归档日志,进行mv 移除后,再次开启mrp进程,d*生gap,主库重传报错归档解决问题。
Waiting for all non-current ORLs to be archived...
All non-current ORLs have been archived.
Media Recovery Log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_2_47745_gxc193wj_.arc
Errors in file /u01/app/oracle/diag/rdbms/newora901dg/ora901/trace/ora901_pr00_17446.trc (incident=):
ORA-: internal error code, arguments: [], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/newora901dg/ora901/incident/incdir_208045/ora901_pr00_17446_i208045.trc
Completed: ALTER DATABASE RECOVER managed standby database disconnect from session
Thu Nov ::
Dumping diagnostic data in directory=[cdmp_20191121231430], requested by (instance=, osid= (PR00)),
summary=[incident=].
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Errors with log /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_2_47745_gxc193wj_.arc
MRP0: Background Media Recovery terminated with error
Errors in file /u01/app/oracle/diag/rdbms/newora901dg/ora901/trace/ora901_pr00_17446.trc:
ORA-: internal error code, arguments: [], [], [], [], [], [], [], [], [], [], [], []
Recovery interrupted!
Errors in file /u01/app/oracle/diag/rdbms/newora901dg/ora901/trace/ora901_pr00_17446.trc:
ORA-: internal error code, arguments: [], [], [], [], [], [], [], [], [], [], [], []
MRP0: Background Media Recovery process shutdown (ora901)
SQL> host mv /oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_2_47745_gxc193wj_.arc
/oradata/newora901dg/archivelog/NEWORA901DG/archivelog/2019_11_21/o1_mf_2_47745_gxc193wj_.arc_20191121.bak