一.1 BLOG文档结构图
一.2 前言部分
一.2.1 导读和注意事项
各位技术爱好者，看完本文后，你可以掌握如下的技能，也可以学到一些其它你所不知道的知识，~O(∩_∩)O~：
① OGG-00446 Could not find archived log for sequence 的解决方法（重点）
② OGG基本的维护、排错操作
Tips：
① 若文章代码格式有错乱，推荐使用QQ或360浏览器，也可以下载pdf格式的文档来查看，pdf文档下载地址：http://yunpan.cn/cdEQedhCs2kFz （提取码：ed9b）
② 本篇BLOG中代码部分需要特别关注的地方我都用黄色背景和红色字体来表示，比如下边的例子中，thread 1的最大归档日志号为33，thread 2的最大归档日志号为43是需要特别关注的地方，命令一般使用粉红颜色标注，注释一般采用蓝色字体表示。
List of Archived Logs in backup set 11
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- ------------------- ---------- ---------
1 32 1621589 2015-05-29 11:09:52 1625242 2015-05-29 11:15:48
1 33 1625242 2015-05-29 11:15:48 1625293 2015-05-29 11:15:58
2 42 1613951 2015-05-29 10:41:18 1625245 2015-05-29 11:15:49
2 43 1625245 2015-05-29 11:15:49 1625253 2015-05-29 11:15:53
[ZFXDESKDB1:root]:/>lsvg -o
T_XDESK_APP1_vg
rootvg
[ZFXDESKDB1:root]:/>
[ZFXDESKDB1:root]:/>lsvg rootvg
====》2097152*512/1024/1024/1024=1G
本文如有错误或不完善的地方请大家多多指正，ITPUB留言或QQ皆可，您的批评指正是我写作的最大动力。
一.2.2 相关参考文章链接
一.2.3 本文简介
同事说有一套OGG的环境挂掉了，不能同步了，让处理一下，查看了进程状态和错误日志后分析得出是source端的归档日志不见了，也没有备份，最后只能重新初始化数据来解决了。
一.3 相关知识点扫盲
一.3.1 OGG的告警日志路径
ogg也有类似oracle的告警文件，该文件在 $OGG_HOME/ggserr.log
oracle@ZT1XPADRDB1:/gg/ogg$ l ggserr.log
-rw-rw-r-- 1 oracle dba 81355509 Jul 25 2025 ggserr.log
oracle@ZT1XPADRDB1:/gg/ogg$
一.4 故障分析及解决过程
一.4.1 故障环境介绍
项目 |
source db |
target db |
db 类型 |
rac环境 |
rac环境 |
db version |
10.2.0.5.0 |
11.2.0.3.0 |
db 存储 |
RAW |
ASM |
ORACLE_SID |
oraXPAD |
oraXPAD |
db_name |
oraXPAD |
oraXPAD |
主机IP地址： |
22.188.131.27 22.188.131.47 |
22.188.132.82 22.188.132.85 |
OS版本及kernel版本 |
AIX 5.3 |
AIX 6.1 |
OS hostname |
ZTGXPADDB1 |
ZT1XPADRDB1 |
一.4.2 故障发生现象及报错信息
source 端：
root@ZTGXPADDB1:/# ps -ef|grep gg
root 3248278 3211312 1 09:15:45 pts/0 0:00 grep gg
oracle 3719330 3751980 1 Dec 30 - 7:29 /gg/ogg/extract PARAMFILE /gg/ogg/dirprm/ggspump.prm REPORTFILE /gg/ogg/dirrpt/GGSPUMP.rpt PROCESSID GGSPUMP USESUBDIRS
oracle 3723472 3706978 0 Aug 03 - 0:03 /oracle/app/oracle/product/10.2.0/crs/bin/evmlogger.bin -o /oracle/app/oracle/product/10.2.0/crs/evm/log/evmlogger.info -l /oracle/app/oracle/product/10.2.0/crs/evm/log/evmlogger.log
oracle 3751980 1 0 Aug 03 - 21:00 ./mgr PARAMFILE /gg/ogg/dirprm/mgr.prm REPORTFILE /gg/ogg/dirrpt/MGR.rpt PROCESSID MGR PORT 7809
oracle 3772504 3751980 3 Dec 30 - 18:42 /gg/ogg/extract PARAMFILE /gg/ogg/dirprm/ggsext.prm REPORTFILE /gg/ogg/dirrpt/GGSEXT.rpt PROCESSID GGSEXT USESUBDIRS
root@ZTGXPADDB1:/# cd /gg/ogg/
oracle@ZTHXPADDB2:/gg/ogg$ ggsci
Oracle GoldenGate Command Interpreter for Oracle
Version 11.1.1.1.2 OGGCORE_11.1.1.1.2_PLATFORMS_111004.2100
AIX 5L, ppc, 64bit (optimized), Oracle 10.2 on Oct 5 2011 02:32:51
Copyright (C) 1995, 2011, Oracle and/or its affiliates. All rights reserved.
GGSCI (ZTHXPADDB2) 1> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT STOPPED GGSEXT 00:00:00 21915:44:49
EXTRACT RUNNING GGSPUMP 00:00:00 unknown
GGSCI (ZTHXPADDB2) 5> view report GGSEXT
***********************************************************************
Oracle GoldenGate Capture for Oracle
Version 11.1.1.1.2 OGGCORE_11.1.1.1.2_PLATFORMS_111004.2100
AIX 5L, ppc, 64bit (optimized), Oracle 10.2 on Oct 5 2011 02:52:14
Copyright (C) 1995, 2011, Oracle and/or its affiliates. All rights reserved.
Starting at 2020-08-03 07:47:21
***********************************************************************
Operating System Version:
AIX
Version 5, Release 3
Node: ZTGXPADDB1
Machine: 00C207D44C00
soft limit hard limit
Address Space Size : unlimited unlimited
Heap Size : unlimited unlimited
File Size : unlimited unlimited
CPU Time : unlimited unlimited
Process id: 2113596
Description:
***********************************************************************
** Running with the following parameters **
***********************************************************************
EXTRACT ggsext
SETENV (NLS_LANG="AMERICAN_AMERICA.ZHS16GBK")
Set environment variable (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)
SETENV (ORACLE_SID="oraXPAD1")
Set environment variable (ORACLE_SID=oraXPAD1)
USERID goldengate, PASSWORD **********
DISCARDFILE ./dirrpt/ggsext.dsc, APPEND, MEGABYTES 100
--DDL INCLUDE MAPPED
--DDLOPTIONS ADDTRANDATA NOCRO***ENAME REPORT
TRANLOGOPTIONS RAWDEVICEOFFSET 0
EXTTRAIL ./dirdat/st
TRANLOGOPTIONS ALTARCHIVELOGDEST PRIMARY INSTANCE oraXPAD1 /gg/sarch1, ALTARCHIVELOGDEST INSTANCE oraXPAD1 /gg/sarch2, ALTARCHIVELOGDEST INSTANCE oraXPAD2 /gg/sarch2, ALTARCHIVELOGDEST INSTANCE oraXPAD2 /gg/sarch1
--TRANLOGOPTIONS ALTARCHIVELOGDEST PRIMARY INSTANCE oraXPAD1 /gg/sarch1, ALTARCHIVELOGDEST INSTANCE oraXPAD2 /gg/sarch2
WILDCARDRESOLVE DYNAMIC
dynamicresolution
THREADOPTIONS MAXCOMMITPROPAGATIONDELAY 60000
--GETTRUNCATES
TABLE XPADB.BASE_ACTIONPOWER;
TABLE XPADB.BASE_BANK;
TABLE XPADB.BASE_BANKMERGE;
TABLE XPADB.BASE_BANKTREE;
TABLE XPADB.BASE_BRCHBANKCTRL;
TABLE XPADB.BASE_CERTIFICATE;
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
TABLE XPADB.RICH_TRANSFERTRADE;
TABLE XPADB.RICH_LISTING;
TABLE XPADB.RICH_DELISTING;
TABLE XPADB.RICH_CUSTPROOFPROPERTY;
TABLE XPADB.BASE_FEESCALE;
TABLE XPADB.BASE_FEEDISCOUNT;
TABLE t.t2;
Bounded Recovery Parameter:
BRINTERVAL = 4HOURS
BRDIR = /gg/ogg
CACHEMGR virtual memory values (may have been adjusted)
CACHEBUFFERSIZE: 64K
CACHESIZE: 8G
CACHEBUFFERSIZE (soft max): 4M
CACHEPAGEOUTSIZE (normal): 4M
PROCESS VM AVAIL FROM OS (min): 16G
CACHESIZEMAX (strict force to disk): 13.99G
2020-08-03 07:47:22 INFO OGG-01639 BOUNDED RECOVERY: ACTIVE: for object pool 1: p1916948_Redo Thread 1.
2020-08-03 07:47:22 INFO OGG-01640 BOUNDED RECOVERY: recovery start XID: 0.0.0.
2020-08-03 07:47:22 INFO OGG-01641 BOUNDED RECOVERY: recovery start position: SeqNo: 2598, RBA: 89822224, SCN: 2850.524344649 (12241181138249), Timestamp: 2018-07-01 04:09:42.000000.
2020-08-03 07:47:22 INFO OGG-01642 BOUNDED RECOVERY: recovery end position: SeqNo: 2598, RBA: 89823232, SCN: 2850.524344649 (12241181138249), Timestamp: 2018-07-01 04:09:42.000000.
2020-08-03 07:47:22 INFO OGG-01639 BOUNDED RECOVERY: ACTIVE: for object pool 2: p1916948_Redo Thread 2.
2020-08-03 07:47:22 INFO OGG-01640 BOUNDED RECOVERY: recovery start XID: 0.0.0.
2020-08-03 07:47:22 INFO OGG-01641 BOUNDED RECOVERY: recovery start position: SeqNo: 2382, RBA: 245488144, SCN: 2850.524344719 (12241181138319), Timestamp: 2018-07-01 04:09:41.000000.
2020-08-03 07:47:22 INFO OGG-01642 BOUNDED RECOVERY: recovery end position: SeqNo: 2382, RBA: 245489152, SCN: 2850.524344719 (12241181138319), Timestamp: 2018-07-01 04:09:41.000000.
2020-08-03 07:47:22 INFO OGG-01643 BOUNDED RECOVERY: CANCELED: for object pool 2: p1916948_Redo Thread 2.
2020-08-03 07:47:22 INFO OGG-01579 BOUNDED RECOVERY: VALID BCP: CP.GGSEXT.000000102.
2020-08-03 07:47:22 INFO OGG-01629 BOUNDED RECOVERY: PERSISTED OBJECTS RECOVERED: 1.
Database Version:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bi
PL/SQL Release 10.2.0.5.0 - Production
CORE 10.2.0.5.0 Production
TNS for IBM/AIX RISC System/6000: Version 10.2.0.5.0 - Productio
NLSRTL Version 10.2.0.5.0 - Production
Database Language and Character Set:
NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK"
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY = "AMERICA"
NLS_CHARACTERSET = "ZHS16GBK"
2020-08-03 07:47:24 INFO OGG-00546 Default thread stack size: 196608.
2020-08-03 07:47:24 INFO OGG-00547 Increasing thread stack size from 196608 to 1048576.
2020-08-03 07:47:24 INFO OGG-01513 Positioning to (Thread 1) Sequence 2598, RBA 89822224, SCN 2850.524344649.
Source Context :
SourceModule : [er.main]
SourceID : [/scratch/aime2/adestore/views/aime2_staxk11/oggcore/OpenSys/src/app/er/rep.c]
SourceFunction : [extract_start_point(time_elt_def *, time_elt_def *)]
SourceLine : [13026]
2020-08-03 07:47:44 ERROR OGG-00446 Could not find archived log for sequence 2598 thread 1 under alternative destinations. SQL <SELECT MAX(sequence#) FROM v$log WHERE thread# = :ora_thread>. Last alternative log tried /gg/sarch2/1_2598_704996932.arc, error retrieving redo file name for sequence 2598, archived = 1, use_alternate = 0Not able to establish initial position for sequence 2598, rba 89822224.
2020-08-03 07:47:44 ERROR OGG-01668 PROCESS ABENDING.
source端告警日志：
oracle@ZT1XPADRDB1:/gg/ogg$ tail -f ggserr.log
2020-08-03 07:47:27 INFO OGG-01226 Oracle GoldenGate Capture for Oracle, ggspump.prm: Socket buffer size set to 27985 (flush size 27985).
2020-08-03 07:47:27 INFO OGG-01055 Oracle GoldenGate Capture for Oracle, ggspump.prm: Recovery initialization completed for target file ./dirdat/tt002073, at RBA 1153.
2020-08-03 07:47:27 INFO OGG-01478 Oracle GoldenGate Capture for Oracle, ggspump.prm: Output file ./dirdat/tt is using format RELEASE 10.4/11.1.
2020-08-03 07:47:27 INFO OGG-01026 Oracle GoldenGate Capture for Oracle, ggspump.prm: Rolling over remote file ./dirdat/tt002074.
2020-08-03 07:47:27 INFO OGG-01053 Oracle GoldenGate Capture for Oracle, ggspump.prm: Recovery completed for target file ./dirdat/tt002074, at RBA 1119.
2020-08-03 07:47:27 INFO OGG-01057 Oracle GoldenGate Capture for Oracle, ggspump.prm: Recovery completed for all targets.
2020-08-03 07:47:44 ERROR OGG-00446 Oracle GoldenGate Capture for Oracle, ggsext.prm: Could not find archived log for sequence 2598 thread 1 under alternative destinations. SQL <SELECT MAX(sequence#) FROM v$log WHERE thread# = :ora_thread>. Last alternative log tried /gg/sarch2/1_2598_704996932.arc, error retrieving redo file name for sequence 2598, archived = 1, use_alternate = 0Not able to establish initial position for sequence 2598, rba 89822224.
2020-08-03 07:47:44 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, ggsext.prm: PROCESS ABENDING.
2020-12-29 15:37:48 ERROR OGG-01117 Oracle GoldenGate Command Interpreter for Oracle: Received signal: Program interrupt (2).
2020-12-29 15:37:48 ERROR OGG-01668 Oracle GoldenGate Command Interpreter for Oracle: PROCESS ABENDING.
target 端：
oracle@ZT1XPADRDB1:/gg/ogg$ ggsci
Oracle GoldenGate Command Interpreter for Oracle
Version 11.1.1.1.2 OGGCORE_11.1.1.1.2_PLATFORMS_111004.2100
AIX 5L, ppc, 64bit (optimized), Oracle 11g on Oct 5 2011 00:37:03
Copyright (C) 1995, 2011, Oracle and/or its affiliates. All rights reserved.
GGSCI (ZT1XPADRDB1) 1> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT ABENDED GGSREP 30088:08:59 3577:00:35
GGSCI (ZT1XPADRDB1) 4> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT ABENDED GGSREP 30088:08:59 3577:47:23
GGSCI (ZT1XPADRDB1) 5> start GGSREP
Sending START request to MANAGER ...
REPLICAT GGSREP starting
GGSCI (ZT1XPADRDB1) 6> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT ABENDED GGSREP 33665:56:32 00:03:08
GGSCI (ZT1XPADRDB1) 8> view report GGSREP
***********************************************************************
Oracle GoldenGate Delivery for Oracle
Version 11.1.1.1.2 OGGCORE_11.1.1.1.2_PLATFORMS_111004.2100
AIX 5L, ppc, 64bit (optimized), Oracle 11g on Oct 5 2011 02:03:36
Copyright (C) 1995, 2011, Oracle and/or its affiliates. All rights reserved.
Starting at 2020-12-30 09:34:14
***********************************************************************
Operating System Version:
AIX
Version 6, Release 1
Node: ZT1XPADRDB1
Machine: 00C08DF04C00
soft limit hard limit
Address Space Size : unlimited unlimited
Heap Size : unlimited unlimited
File Size : unlimited unlimited
CPU Time : unlimited unlimited
Process id: 35717358
Description:
***********************************************************************
** Running with the following parameters **
***********************************************************************
REPLICAT ggsrep
--SETENV (ORACLE_SID = ggstd)
SETENV (NLS_LANG="AMERICAN_AMERICA.ZHS16GBK")
Set environment variable (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)
USERID goldengate, PASSWORD **********
--DDL include MAPPED
--DDLERROR DEFAULT IGNORE RETRYOP MAXRETRIES 3 RETRYDELAY 5
--DDLOPTIONS report
REPERROR DEFAULT, ABEND
ASSUMETARGETDEFS
DBOPTIONS DEFERREFCONST
DBOPTIONS SUPPRESSTRIGGERS
--BATCHSQL
--GROUPTRANSOPS 2000
DISCARDFILE ./dirrpt/ggsrep.dsc, APPEND, MEGABYTES 1000
WILDCARDRESOLVE DYNAMIC
Dynamicresolution
ALLOWNOOPUPDATES
--GETTRUNCATES
MAP XPADB.*, TARGET XPADRPT.*;
--OGG test table
MAP t.*, TARGET tt.t*;
CACHEMGR virtual memory values (may have been adjusted)
CACHEBUFFERSIZE: 64K
CACHESIZE: 512M
CACHEBUFFERSIZE (soft max): 4M
CACHEPAGEOUTSIZE (normal): 4M
PROCESS VM AVAIL FROM OS (min): 1G
CACHESIZEMAX (strict force to disk): 881M
Database Version:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
PL/SQL Release 11.2.0.3.0 - Production
CORE 11.2.0.3.0 Production
TNS for IBM/AIX RISC System/6000: Version 11.2.0.3.0 - Production
NLSRTL Version 11.2.0.3.0 - Production
Database Language and Character Set:
NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK"
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY = "AMERICA"
NLS_CHARACTERSET = "ZHS16GBK"
For further information on character set settings, please refer to user manual.
***********************************************************************
** Run Time Messages **
***********************************************************************
Opened trail file ./dirdat/tt002032 at 2020-12-30 09:34:14
Wildcard MAP resolved (entry XPADB.*):
MAP XPADB.RICH_CUSTPAYAMOUNTHIS, TARGET XPADRPT.RICH_CUSTPAYAMOUNTHIS;
2020-12-30 09:34:14 WARNING OGG-00869 No unique key is defined for table RICH_CUSTPAYAMOUNTHIS. All viable columns will be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.
Using following columns in default map by name:
SERIALNO, TRADENO, ACCOUNT, CUSTACCOUNT, ISSUEID, FLAG, BANKID,
EXECDATE, CURRENCYID, AMOUNT, BANCSNO, CASHREMIT, STATE, MEMO,
PAYEXRATE, RESEND, EXECMODE, TRANCODE, RESPONSECODE, DATEEXPIRATION,
TRADECHANNEL, TSNUMBER, FREEZESRLNO, EXPDATE, AMTTYPE, RELTRANTYPE,
PROMOCODE, RELSERIALNO
Using the following key columns for target table XPADRPT.RICH_CUSTPAYAMOUNTHIS: SERIALNO, TRADENO, ACCOUNT, CUSTACCOUNT, ISSUEID, FLAG, BANKID, EXECDATE, CURRENCYID, AMOUNT, BANCSNO, CASHREMIT, STATE, MEMO, PAYEXRATE, RESEND, EXECMODE, TRANCODE, RESPONSECODE, DATEEXPIRATION, TRADECHANNEL, TSNUMBER, FREEZESRLNO, EXPDATE, AMTTYPE, RELTRANTYPE, PROMOCODE, RELSERIALNO.
2020-12-30 09:34:14 WARNING OGG-01004 Aborted grouped transaction on 'XPADRPT.RICH_CUSTPAYAMOUNTHIS', Database error 1403 ().
2020-12-30 09:34:14 WARNING OGG-01003 Repositioning to rba 47143866 in seqno 2032.
2020-12-30 09:34:14 WARNING OGG-01154 SQL error 1403 mapping XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
2020-12-30 09:34:14 WARNING OGG-01003 Repositioning to rba 47143866 in seqno 2032.
Source Context :
SourceModule : [er.main]
SourceID : [/scratch/aime2/adestore/views/aime2_staxk11/oggcore/OpenSys/src/app/er/rep.c]
SourceFunction : [take_rep_err_action(short, int32_t, const char *, extr_ptr_def *, std_rec_hdr_def *, char *, file_def *, bool)]
SourceLine : [16148]
2020-12-30 09:34:14 ERROR OGG-01296 Error mapping from XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Last record for the last committed transaction is the following:
___________________________________________________________________
Trail name : ./dirdat/tt002032
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 854 (x0356) IO Time : 2017-02-26 15:37:42.331328
IOType : 115 (x73) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 2301 AuditPos : 568568848
Continued : N (x00) RecCount : 1 (x01)
2017-02-26 15:37:42.331328 GGSKeyFieldComp Len 854 RBA 47143866
Name: XPADB.RICH_CUSTPAYAMOUNTHIS
___________________________________________________________________
Reading ./dirdat/tt002032, current RBA 47143866, 0 records
Report at 2020-12-30 09:34:14 (activity since 2020-12-30 09:34:14)
From Table XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS:
# inserts: 0
# updates: 0
# deletes: 0
# discards: 1
Last log location read:
FILE: ./dirdat/tt002032
SEQNO: 2032
RBA: 47143866
TIMESTAMP: 2017-02-26 15:37:42.331328
EOF: NO
READERR: 0
2020-12-30 09:34:14 ERROR OGG-01668 PROCESS ABENDING.
CACHE OBJECT MANAGER statistics
CACHE MANAGER VM USAGE
vm current = 0 vm anon queues = 0
vm anon in use = 0 vm file = 0
vm used max = 0 ==> CACHE BALANCED
CACHE CONFIGURATION
cache size = 512M cache force paging = 881M
buffer min = 64K buffer highwater = 4M
pageout eligible size = 4M
================================================================================
RUNTIME STATS FOR SUPERPOOL
CACHE Transaction Stats
trans active = 0 max concurrent = 0
non-zero total = 0 trans total = 0
CACHE File Caching
disk current = 0 disk total = 0
disk caching = 0 file cached = 0
file retrieves = 0
CACHE MANAGEMENT
buffer links = 0 anon gets = 0
forced unmaps = 0 cnnbl try = 0
cached out = 0 force out = 0
Allocation Request Distribution
< 128B: 0
128B: 0 0 | 512B: 0 0
2K: 0 0 | 8K: 0 0
32K: 0 0 | 128K: 0 0
512K: 0 0 | 2M: 0 0
8M: 0 0 | 32M: 0 0
128M: 0 0 | 512M: 0 0
2G: 0 0 | 8G: 0
Cached Transaction Size Distribution
0: 0
< 4K: 0
4K: 0 0 | 16K: 0 0
64K: 0 0 | 256K: 0 0
1M: 0 0 | 4M: 0 0
16M: 0 0 | 64M: 0 0
256M: 0 0 | 1G: 0 0
4G: 0 0 | 16G: 0 0
64G: 0 0 | 256G: 0 0
1T: 0 0 | 4T: 0 0
16T: 0 0 | 64T: 0 0
256T: 0 0 |1024T: 0 0
================================================================================
CUMULATIVE STATS FOR SUPERPOOL
CACHE Transaction Stats
trans active = 0 max concurrent = 0
non-zero total = 0 trans total = 0
CACHE File Caching
disk current = 0 disk total = 0
disk caching = 0 file cached = 0
file retrieves = 0
CACHE MANAGEMENT
buffer links = 0 anon gets = 0
forced unmaps = 0 cnnbl try = 0
cached out = 0 force out = 0
Allocation Request Distribution
< 128B: 0
128B: 0 0 | 512B: 0 0
2K: 0 0 | 8K: 0 0
32K: 0 0 | 128K: 0 0
512K: 0 0 | 2M: 0 0
8M: 0 0 | 32M: 0 0
128M: 0 0 | 512M: 0 0
2G: 0 0 | 8G: 0
Cached Transaction Size Distribution
0: 0
< 4K: 0
4K: 0 0 | 16K: 0 0
64K: 0 0 | 256K: 0 0
1M: 0 0 | 4M: 0 0
16M: 0 0 | 64M: 0 0
256M: 0 0 | 1G: 0 0
4G: 0 0 | 16G: 0 0
64G: 0 0 | 256G: 0 0
1T: 0 0 | 4T: 0 0
16T: 0 0 | 64T: 0 0
256T: 0 0 |1024T: 0 0
QUEUE Statistics:
num queues = 15 default index = 0
cur len = 0 max len = 0
q vm current = 0 vm max = 0
q hits = 0 q misses = 0
queue size q hits curlen maxlen cannibalized
0 64K 0 0 0 0
1 128K 0 0 0 0
2 256K 0 0 0 0
3 512K 0 0 0 0
4 1M 0 0 0 0
5 2M 0 0 0 0
6 4M 0 0 0 0
7 8M 0 0 0 0
8 16M 0 0 0 0
9 32M 0 0 0 0
10 64M 0 0 0 0
11 128M 0 0 0 0
12 256M 0 0 0 0
13 512M 0 0 0 0
14 1G 0 0 0 0
================================================================================
RUNTIME STATS FOR CACHE POOL #0
POOL INFO group: ggsrep id: p35717358_BLOB
trans active = 0 trans concurrent (max) = 0
trans total = 0 (0 )
flag = 0x00000030
last error = (0=<none>)
Allocation Request Distribution
< 128B: 0
128B: 0 0 | 512B: 0 0
2K: 0 0 | 8K: 0 0
32K: 0 0 | 128K: 0 0
512K: 0 0 | 2M: 0 0
8M: 0 0 | 32M: 0 0
128M: 0 0 | 512M: 0 0
2G: 0 0 | 8G: 0
================================================================================
CUMULATIVE STATS FOR CACHE POOL #0
POOL INFO group: ggsrep id: p35717358_BLOB
trans active = 0 trans concurrent (max) = 0
trans total = 0 (0 )
flag = 0x00000030
target端告警日志：
oracle@ZT1XPADRDB1:/gg/ogg$ tail -f ggserr.log
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39947, modtime is 212619862981000000 for /gg/ogg/dirdat/tt001891.
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39951, modtime is 212619877906000000 for /gg/ogg/dirdat/tt001892.
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -40038, modtime is 212620189201000000 for /gg/ogg/dirdat/tt001893.
2020-12-30 09:27:54 WARNING OGG-00950 Oracle GoldenGate Manager for Oracle, mgr.prm: Purge of old extract file /gg/ogg/dirdat/tt001894 failed because the prev seqno exists. Purge rule was applying UseCheckPoints purge rule: Oldest Chkpt Seqno 2032 > 1894.
2020-12-30 09:34:14 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start GGSREP.
2020-12-30 09:34:14 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host 22.188.132.82 (START REPLICAT GGSREP ).
2020-12-30 09:34:14 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: REPLICAT GGSREP starting.
2020-12-30 09:34:14 INFO OGG-00995 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: REPLICAT GGSREP starting.
2020-12-30 09:34:14 INFO OGG-00996 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: REPLICAT GGSREP started.
2020-12-30 09:34:14 WARNING OGG-00869 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: No unique key is defined for table RICH_CUSTPAYAMOUNTHIS. All viable columns will be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.
2020-12-30 09:34:14 WARNING OGG-01004 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Aborted grouped transaction on 'XPADRPT.RICH_CUSTPAYAMOUNTHIS', Database error 1403 ().
2020-12-30 09:34:14 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Repositioning to rba 47143866 in seqno 2032.
2020-12-30 09:34:14 WARNING OGG-01154 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: SQL error 1403 mapping XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
2020-12-30 09:34:14 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Repositioning to rba 47143866 in seqno 2032.
2020-12-30 09:34:14 ERROR OGG-01296 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Error mapping from XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
2020-12-30 09:34:14 ERROR OGG-01668 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: PROCESS ABENDING.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39947, modtime is 212619862981000000 for /gg/ogg/dirdat/tt001891.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39951, modtime is 212619877906000000 for /gg/ogg/dirdat/tt001892.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -40038, modtime is 212620189201000000 for /gg/ogg/dirdat/tt001893.
2020-12-30 09:37:54 WARNING OGG-00950 Oracle GoldenGate Manager for Oracle, mgr.prm: Purge of old extract file /gg/ogg/dirdat/tt001894 failed because the prev seqno exists. Purge rule was applying UseCheckPoints purge rule: Oldest Chkpt Seqno 2032 > 1894.
一.4.3 故障分析及解决过程
一.4.3.1 确认归档文件是否存在
根据报错信息，可以知道source端的thread 1 2598归档日志不存在了，如果备份存在的话可以先把备份的归档还原回来就可以了，我们看看归档是否存在？
oracle@ZTHXPADDB2:/oracle$ sqlplus / as sysdba
SQL*Plus: Release 10.2.0.5.0 - Production on Wed Dec 30 08:50:48 2020
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, Data Mining and Real Application Testing options
SQL> set line 9999
SQL> select * from v$log;
GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIME
---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------
1 1 2907 1072693248 1 NO CURRENT 1.2242E+13 30-DEC-20
2 1 2905 1072693248 1 YES INACTIVE 1.2242E+13 28-DEC-20
3 1 2906 1072693248 1 YES INACTIVE 1.2242E+13 29-DEC-20
4 2 2718 1072693248 1 YES INACTIVE 1.2242E+13 29-DEC-20
5 2 2719 1072693248 1 NO CURRENT 1.2242E+13 29-DEC-20
6 2 2717 1072693248 1 YES INACTIVE 1.2242E+13 28-DEC-20
6 rows selected.
SQL> archive log list;
Database log mode Archive Mode
Automatic archival Enabled
Archive destination /gg/sarch2
Oldest online log sequence 2717
Next log sequence to archive 2719
Current log sequence 2719
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, Data Mining and Real Application Testing options
oracle@ZTHXPADDB2:/oracle$ cd /gg/sarch2
oracle@ZTHXPADDB2:/gg/sarch2$ l
total 193332080
-rw-rw---- 1 oracle dba 1065581568 Mar 05 2020 2_2625_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Mar 06 2020 2_2626_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Mar 06 2020 2_2627_704996932.arc
-rw-rw---- 1 oracle dba 1065577472 Mar 07 2020 2_2628_704996932.arc
-rw-rw---- 1 oracle dba 1065568768 Mar 20 2020 2_2629_704996932.arc
-rw-rw---- 1 oracle dba 1065582592 Mar 21 2020 2_2630_704996932.arc
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
-rw-rw---- 1 oracle dba 1065574400 Dec 23 13:06 2_2707_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Dec 24 00:26 2_2708_704996932.arc
-rw-rw---- 1 oracle dba 1065574912 Dec 24 13:15 2_2709_704996932.arc
-rw-rw---- 1 oracle dba 1065744384 Dec 25 02:23 2_2710_704996932.arc
-rw-rw---- 1 oracle dba 1065566208 Dec 25 19:23 2_2711_704996932.arc
-rw-rw---- 1 oracle dba 1065576960 Dec 26 09:08 2_2712_704996932.arc
-rw-rw---- 1 oracle dba 1065627648 Dec 26 23:21 2_2713_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Dec 27 12:25 2_2714_704996932.arc
-rw-rw---- 1 oracle dba 1065691648 Dec 28 04:32 2_2715_704996932.arc
-rw-rw---- 1 oracle dba 1065658368 Dec 28 21:02 2_2716_704996932.arc
-rw-rw---- 1 oracle dba 1065575936 Dec 29 10:37 2_2717_704996932.arc
-rw-rw---- 1 oracle dba 1067223552 Dec 29 23:22 2_2718_704996932.arc
-rw-r--r-- 1 oracle dba 79 Jun 27 2013 afiedt.buf
oracle@ZTHXPADDB2:/gg/sarch2$ l *1_2598*
ls: 0653-341 The file *1_2598* does not exist.
oracle@ZTHXPADDB2:/gg/sarch2$ cd /gg/sarch1
oracle@ZTHXPADDB2:/gg/sarch1$ l
total 166951440
-rw-rw---- 1 oracle dba 1065574400 Mar 05 2020 1_2825_704996932.arc
-rw-rw---- 1 oracle dba 1065580032 Mar 06 2020 1_2826_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Mar 06 2020 1_2827_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Mar 07 2020 1_2828_704996932.arc
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
-rw-rw---- 1 oracle dba 1065574400 Dec 27 10:52 1_2902_704996932.arc
-rw-rw---- 1 oracle dba 1065574400 Dec 28 00:59 1_2903_704996932.arc
-rw-rw---- 1 oracle dba 1065687040 Dec 28 15:16 1_2904_704996932.arc
-rw-rw---- 1 oracle dba 1065607680 Dec 29 08:40 1_2905_704996932.arc
-rw-rw---- 1 oracle dba 1065577984 Dec 30 01:32 1_2906_704996932.arc
-rw-rw---- 1 oracle dba 278522368 Aug 06 07:15 2_2689_704996932.arc
-rw-r--r-- 1 oracle dba 90 Dec 22 2013 afiedt.buf
oracle@ZTHXPADDB2:/gg/sarch1$
RMAN> list archivelog all;
List of Archived Log Copies
Key Thrd Seq S Low Time Name
------- ---- ------- - --------- ----
4651 1 2825 A 05-MAR-20 /gg/sarch1/1_2825_704996932.arc
4653 1 2826 A 05-MAR-20 /gg/sarch1/1_2826_704996932.arc
4655 1 2827 A 06-MAR-20 /gg/sarch1/1_2827_704996932.arc
4656 1 2828 A 06-MAR-20 /gg/sarch1/1_2828_704996932.arc
4658 1 2829 A 07-MAR-20 /gg/sarch1/1_2829_704996932.arc
4660 1 2830 A 20-MAR-20 /gg/sarch1/1_2830_704996932.arc
4662 1 2831 A 20-MAR-20 /gg/sarch1/1_2831_704996932.arc
4665 1 2832 A 21-MAR-20 /gg/sarch1/1_2832_704996932.arc
4667 1 2833 A 30-MAR-20 /gg/sarch1/1_2833_704996932.arc
4670 1 2834 A 30-MAR-20 /gg/sarch1/1_2834_704996932.arc
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
4793 2 2702 A 02-OCT-20 /gg/sarch2/2_2702_704996932.arc
4795 2 2703 A 20-DEC-20 /gg/sarch2/2_2703_704996932.arc
4796 2 2704 A 21-DEC-20 /gg/sarch2/2_2704_704996932.arc
4798 2 2705 A 21-DEC-20 /gg/sarch2/2_2705_704996932.arc
4801 2 2706 A 22-DEC-20 /gg/sarch2/2_2706_704996932.arc
4803 2 2707 A 22-DEC-20 /gg/sarch2/2_2707_704996932.arc
4804 2 2708 A 23-DEC-20 /gg/sarch2/2_2708_704996932.arc
4806 2 2709 A 24-DEC-20 /gg/sarch2/2_2709_704996932.arc
4808 2 2710 A 24-DEC-20 /gg/sarch2/2_2710_704996932.arc
4811 2 2711 A 25-DEC-20 /gg/sarch2/2_2711_704996932.arc
4813 2 2712 A 25-DEC-20 /gg/sarch2/2_2712_704996932.arc
4815 2 2713 A 26-DEC-20 /gg/sarch2/2_2713_704996932.arc
4817 2 2714 A 26-DEC-20 /gg/sarch2/2_2714_704996932.arc
4819 2 2715 A 27-DEC-20 /gg/sarch2/2_2715_704996932.arc
4821 2 2716 A 28-DEC-20 /gg/sarch2/2_2716_704996932.arc
4823 2 2717 A 28-DEC-20 /gg/sarch2/2_2717_704996932.arc
4824 2 2718 A 29-DEC-20 /gg/sarch2/2_2718_704996932.arc
可以看到 2598号的归档日志已经不存在了。
一.4.3.2 第一种办法：改变抽取进程的时间
改变抽取进程的时间， 但是会导致数据不一致，若是测试库，可以执行：alter extract extl,begin now
GGSCI (ZTHXPADDB2) 11> alter extract GGSEXT,begin now
EXTRACT altered.
GGSCI (ZTHXPADDB2) 12> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT STOPPED GGSEXT 00:00:00 00:00:05
EXTRACT RUNNING GGSPUMP 00:00:00 00:00:00
GGSCI (ZTHXPADDB2) 13> start GGSEXT
Sending START request to MANAGER ...
EXTRACT GGSEXT starting
GGSCI (ZTHXPADDB2) 14> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING GGSEXT 00:00:00 00:00:28
EXTRACT RUNNING GGSPUMP 00:00:00 unknown
GGSCI (ZTHXPADDB2) 17> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING GGSEXT 00:00:00 unknown
EXTRACT RUNNING GGSPUMP 00:00:00 00:00:00
GGSCI (ZTHXPADDB2) 18> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING GGSEXT 00:00:00 unknown
EXTRACT RUNNING GGSPUMP 00:00:00 unknown
GGSCI (ZTHXPADDB2) 19> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING GGSEXT 00:00:00 unknown
EXTRACT RUNNING GGSPUMP 00:00:00 00:00:01
可以看到虽然处于RUNNING的状态，但是Time Since Chkpt列是不对的，而这是target端也不能正常启动。
oracle@ZT1XPADRDB1:/gg/ogg$ tail -f ggserr.log
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39947, modtime is 212619862981000000 for /gg/ogg/dirdat/tt001891.
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39951, modtime is 212619877906000000 for /gg/ogg/dirdat/tt001892.
2020-12-30 09:27:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -40038, modtime is 212620189201000000 for /gg/ogg/dirdat/tt001893.
2020-12-30 09:27:54 WARNING OGG-00950 Oracle GoldenGate Manager for Oracle, mgr.prm: Purge of old extract file /gg/ogg/dirdat/tt001894 failed because the prev seqno exists. Purge rule was applying UseCheckPoints purge rule: Oldest Chkpt Seqno 2032 > 1894.
2020-12-30 09:34:14 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start GGSREP.
2020-12-30 09:34:14 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host 22.188.132.82 (START REPLICAT GGSREP ).
2020-12-30 09:34:14 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: REPLICAT GGSREP starting.
2020-12-30 09:34:14 INFO OGG-00995 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: REPLICAT GGSREP starting.
2020-12-30 09:34:14 INFO OGG-00996 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: REPLICAT GGSREP started.
2020-12-30 09:34:14 WARNING OGG-00869 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: No unique key is defined for table RICH_CUSTPAYAMOUNTHIS. All viable columns will be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.
2020-12-30 09:34:14 WARNING OGG-01004 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Aborted grouped transaction on 'XPADRPT.RICH_CUSTPAYAMOUNTHIS', Database error 1403 ().
2020-12-30 09:34:14 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Repositioning to rba 47143866 in seqno 2032.
2020-12-30 09:34:14 WARNING OGG-01154 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: SQL error 1403 mapping XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
2020-12-30 09:34:14 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Repositioning to rba 47143866 in seqno 2032.
2020-12-30 09:34:14 ERROR OGG-01296 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: Error mapping from XPADB.RICH_CUSTPAYAMOUNTHIS to XPADRPT.RICH_CUSTPAYAMOUNTHIS.
2020-12-30 09:34:14 ERROR OGG-01668 Oracle GoldenGate Delivery for Oracle, ggsrep.prm: PROCESS ABENDING.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39947, modtime is 212619862981000000 for /gg/ogg/dirdat/tt001891.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -39951, modtime is 212619877906000000 for /gg/ogg/dirdat/tt001892.
2020-12-30 09:37:54 WARNING OGG-00956 Oracle GoldenGate Manager for Oracle, mgr.prm: hours_since_modified calculated as -40038, modtime is 212620189201000000 for /gg/ogg/dirdat/tt001893.
2020-12-30 09:37:54 WARNING OGG-00950 Oracle GoldenGate Manager for Oracle, mgr.prm: Purge of old extract file /gg/ogg/dirdat/tt001894 failed because the prev seqno exists. Purge rule was applying UseCheckPoints purge rule: Oldest Chkpt Seqno 2032 > 1894.
GGSCI (ZT1XPADRDB1) 6> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT ABENDED GGSREP 33665:56:32 00:03:08
一.4.3.3 第二种办法：数据初始化
一、 source端准备
oracle@ZTGXPADDB1:/softtmp$ sqlplus / as sysdba
SQL*Plus: Release 10.2.0.5.0 - Production on Sat Jan 2 16:38:32 2021
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, Data Mining and Real Application Testing options
SQL> col current_scn format 999999999999999
SQL> Select current_scn from v$database;
CURRENT_SCN
----------------
12242466771468
SQL>
由于是基于表级别的复制，并且全用户和表的大小差异很大，所以建议导出的时候基于表来导出，导入也基于表来导入。
source库导出操作，flashback_scn为 12242466771468：
oracle@ZTGXPADDB1:/softtmp$ expdp XPADB/XPADB directory=DMP dumpfile=xpadb_20160125_01.dmp LOGFILE=xpadb_20160125.log TABLES=BASE_ACTIONPOWER,BASE_BANK,BASE_BANKMERGE,BASE_BANKTREE FLASHBACK_SCN=12242466771468
Export: Release 10.2.0.5.0 - 64bit Production on Saturday, 02 January, 2021 16:41:50
Copyright (c) 2003, 2007, Oracle. All rights reserved.
Connected to: Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, Data Mining and Real Application Testing options
Starting "XPADB"."SYS_EXPORT_TABLE_01": XPADB/******** directory=DMP dumpfile=xpadb_20160125_01.dmp LOGFILE=xpadb_20160125.log TABLES=BASE_ACTIONPOWER,BASE_BANK,BASE_BANKMERGE,BASE_BANKTREE,BASE_BRCHBANKCTRL,BASE_CERTIFICATE,BASE_CESS,BASE_COREBANK,BASE_CURRENCY,BASE_DEPARTMENT,BASE_HOLIDAYCALENDAR,BASE_HOLIDAYDATE,BASE_INTEREST,BASE_INTERESTHIS,BASE_MAINAREA,BASE_MENU,BASE_PRODTYPECODE,BASE_RATE,BASE_ROLE,BASE_SYSLOG,BASE_SYSPARAM,BASE_TERMINALTELLER,BASE_USER,FINANCIAL_BANKPROFITLOG,FINANCIAL_DIVIDENDPLAN,FINANCIAL_FUNDPRICE,FINANCIAL_INTERESTRESET,FINANCIAL_ISSUE,FINANCIAL_ISSUEAUDIT,FINANCIAL_ISSUEAUDITHIS,FINANCIAL_ISSUEBRAND,FINANCIAL_ISSUECFL,FINANCIAL_ISSUECONTROL,FINANCIAL_ISSUEDIFFRATE,FINANCIAL_ISSUEDISCOUNT,FINANCIAL_ISSUEEXPD,FINANCIAL_ISSUEEXT,FINANCIAL_ISSUEFEE,FINANCIAL_ISSUEFORCUSTRISKLVL,FINANCIAL_ISSUEFUNDSTRANSFER,FINANCIAL_ISSUEOBSERV,FINANCIAL_ISSUEPAY,FINANCIAL_ISSUEPROFIT,FINANCIAL_ISSUEQTYSPLIT,FINANCIAL_ISSUESELLCTRL,FINANCIAL_ISSUESERIAL,FINANCIAL_ISSUEVARIABLE,FINANCIAL_ISSUEWORKTIME,FINANCIAL_LIQUIDATEACT,FINANCIAL_MESSAGEINFO,FINANCIAL_PERIOD,FINANCIAL_PRICE,FINANCIAL_PRICEHIS,FINANCIAL_REFERINDEX,FINANCIAL_POSITION,RICH_AUTOTRADE,RICH_CUSTACCOUNT,RICH_CUSTAUTOTRADE,RICH_CUSTAUTOTRADEHIS,RICH_CUSTCAPITAL,RICH_CUSTFAVORABLE,RICH_CUSTFREEZEUNIT,RICH_CUSTFUNDPROFIT,RICH_CUSTIMPAWN,RICH_CUSTKEEPBAL,RICH_CUSTOMERINFO,RICH_CUSTOMERINFOHIS,RICH_CUSTORDERTRADE,RICH_CUSTPAYAMOUNTLOG,RICH_CUSTPRODUCTBAL,RICH_CUSTPRODUCTBALQTY,RICH_CUSTPROFITDCCY,RICH_CUSTPROFITLOG,RICH_CUSTPROFITNORMAL,RICH_CUSTPROFITPAYMODE,RICH_CUSTPROFITPAYMODEHIS,RICH_CUSTRISKLVL,RICH_FUNDTRADELOG,RICH_NOPAYAMOUNT,RICH_NORMALPAY,RICH_ORDERTRADE,RICH_SMSCMDSIGN,RICH_SMSCMDTRADE,RICH_STARTBAL,RICH_STARTBALHIS,financial_positionhis,financial_positiontra,financial_positioncst,financial_positionacc,corp_stattemptab,corp_stattemptabacc,corp_stattemptabcst,FINANCIAL_ICCARDCODE,BASE_FINANCIALICCARD,FINANCIAL_ISSUESPECIFICATION,PA_RPT_PARAM,FINANCIAL_SALEBANK_HIS,RICH_TRA
Estimate in progress using BLOCKS method...
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Total estimation using BLOCKS method: 6.913 GB
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/INDEX/INDEX
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/COMMENT
Processing object type TABLE_EXPORT/TABLE/TRIGGER
Processing object type TABLE_EXPORT/TABLE/INDEX/FUNCTIONAL_AND_BITMAP/INDEX
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/FUNCTIONAL_AND_BITMAP/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
. . exported "XPADB"."RICH_CUSTPRODUCTBAL" 63.64 KB 582 rows
. . exported "XPADB"."RICH_CUSTOMERINFO" 616.9 KB 2596 rows
. . exported "XPADB"."RICH_CUSTACCOUNT" 11.33 MB 177757 rows
. . exported "XPADB"."FINANCIAL_MESSAGEINFO" 329.7 MB 3067896 rows
. . exported "XPADB"."RICH_AUTOTRADE" 36.53 KB 161 rows
. . exported "XPADB"."BASE_SYSLOG" 24.70 KB 131 rows
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
. . exported "XPADB"."RICH_TRADELOG_HIS":"P_201411" 0 KB 0 rows
. . exported "XPADB"."RICH_TRADELOG_HIS":"P_201412" 0 KB 0 rows
. . exported "XPADB"."RICH_TRADELOG_HIS":"P_999999" 0 KB 0 rows
ORA-39166: Object RIC was not found.
Master table "XPADB"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for XPADB.SYS_EXPORT_TABLE_01 is:
/softtmp/dmp/xpadb_20160125_01.dmp
Job "XPADB"."SYS_EXPORT_TABLE_01" completed with 1 error(s) at 16:42:37
二、 target 准备
先做导出备份操作：
root@ZT1XPADRDB1:/# su - oracle
oracle@ZT1XPADRDB1:/oracle$ expdp xpadrpt/xpadrpt directory=OGGD dumpfile=xpadb_20160125_02.dmp LOGFILE=xpadb_20160125_2.log TABLES=BASE_ACTIONPOWER,BASE_BANK,BASE_BANKMERGE,BASE_BANKTREE,BASE_BRCHBANKCTRL,BASE_CERTIFICATE,BASE_CESS,BASE_COREBANK,BASE_CURRENCY,BASE_DEPARTMENT,BASE_HOLIDAYCALENDAR,BASE_HOLIDAYDATE,BASE_INTEREST,BASE_INTERESTHIS,BASE_MAINAREA,BASE_MENU,BASE_PRODTYPECODE,BASE_RATE,BASE_ROLE,BASE_SYSLOG,BASE_SYSPARAM
Export: Release 11.2.0.3.0 - Production on Sat Jan 2 17:06:22 2021
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
Starting "XPADRPT"."SYS_EXPORT_TABLE_01": xpadrpt/******** directory=OGGD dumpfile=xpadb_20160125_02.dmp LOGFILE=xpadb_20160125_2.log TABLES=BASE_ACTIONPOWER,BASE_BANK,BASE_BANKMERGE,BASE_BANKTREE,BASE_BRCHBANKCTRL,BASE_CERTIFICATE,BASE_CESS,BASE_COREBANK,BASE_CURRENCY,BASE_DEPARTMENT,BASE_HOLIDAYCALENDAR,BASE_HOLIDAYDATE,BASE_INTEREST,BASE_INTERESTHIS,BASE_MAINAREA,BASE_MENU,BASE_PRODTYPECODE,BASE_RATE,BASE_ROLE,BASE_SYSLOG,BASE_SYSPARAM,BASE_TERMINALTELLER,BASE_USER,FINANCIAL_BANKPROFITLOG,FINANCIAL_DIVIDENDPLAN,FINANCIAL_FUNDPRICE,FINANCIAL_INTERESTRESET,FINANCIAL_ISSUE,FINANCIAL_ISSUEAUDIT,FINANCIAL_ISSUEAUDITHIS,FINANCIAL_ISSUEBRAND,FINANCIAL_ISSUECFL,FINANCIAL_ISSUECONTROL,FINANCIAL_ISSUEDIFFRATE,FINANCIAL_ISSUEDISCOUNT,FINANCIAL_ISSUEEXPD,FINANCIAL_ISSUEEXT,FINANCIAL_ISSUEFEE,FINANCIAL_ISSUEFORCUSTRISKLVL,FINANCIAL_ISSUEFUNDSTRANSFER,FINANCIAL_ISSUEOBSERV,FINANCIAL_ISSUEPAY,FINANCIAL_ISSUEPROFIT,FINANCIAL_ISSUEQTYSPLIT,FINANCIAL_ISSUESELLCTRL,FINANCIAL_ISSUESERIAL,FINANCIAL_ISSUEVARIABLE,FINANCIAL_ISSUEWORKTIME,FINANCIAL_LIQUIDATEACT,FINANCIAL_MESSAGEINFO,FINANCIAL_PERIOD,FINANCIAL_PRICE,FINANCIAL_PRICEHIS,FINANCIAL_REFERINDEX,FINANCIAL_POSITION,RICH_AUTOTRADE,RICH_CUSTACCOUNT,RICH_CUSTAUTOTRADE,RICH_CUSTAUTOTRADEHIS,RICH_CUSTCAPITAL,RICH_CUSTFAVORABLE,RICH_CUSTFREEZEUNIT,RICH_CUSTFUNDPROFIT,RICH_CUSTIMPAWN,RICH_CUSTKEEPBAL,RICH_CUSTOMERINFO,RICH_CUSTOMERINFOHIS,RICH_CUSTORDERTRADE,RICH_CUSTPAYAMOUNTLOG,RICH_CUSTPRODUCTBAL,RICH_CUSTPRODUCTBALQTY,RICH_CUSTPROFITDCCY,RICH_CUSTPROFITLOG,RICH_CUSTPROFITNORMAL,RICH_CUSTPROFITPAYMODE,RICH_CUSTPROFITPAYMODEHIS,RICH_CUSTRISKLVL,RICH_FUNDTRADELOG,RICH_NOPAYAMOUNT,RICH_NORMALPAY,RICH_ORDERTRADE,RICH_SMSCMDSIGN,RICH_SMSCMDTRADE,RICH_STARTBAL,RICH_STARTBALHIS,financial_positionhis,financial_positiontra,financial_positioncst,financial_positionacc,corp_stattemptab,corp_stattemptabacc,corp_stattemptabcst,FINANCIAL_ICCARDCODE,BASE_FINANCIALICCARD,FINANCIAL_ISSUESPECIFICATION,PA_RPT_PARAM,FINANCIAL_SALEBANK_HIS,R
Estimate in progress using BLOCKS method...
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Total estimation using BLOCKS method: 7.606 GB
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/COMMENT
Processing object type TABLE_EXPORT/TABLE/INDEX/INDEX
Processing object type TABLE_EXPORT/TABLE/INDEX/FUNCTIONAL_INDEX/INDEX
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/FUNCTIONAL_INDEX/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/BITMAP_INDEX/INDEX
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/BITMAP_INDEX/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/TRIGGER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
. . exported "XPADRPT"."RICH_CUSTPRODUCTBAL" 45.04 KB 367 rows
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_201408" 0 KB 0 rows
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_201409" 0 KB 0 rows
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_201410" 0 KB 0 rows
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_201411" 0 KB 0 rows
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_201412" 0 KB 0 rows
. . exported "XPADRPT"."RICH_TRADELOG_HIS":"P_999999" 0 KB 0 rows
ORA-39166: Object XPADRPT.RICH_CUSTPRODUCTBALHIS_ was not found.
Master table "XPADRPT"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for XPADRPT.SYS_EXPORT_TABLE_01 is:
/gg/bkup/xpadb_20160125_02.dmp
Job "XPADRPT"."SYS_EXPORT_TABLE_01" completed with 1 error(s) at 17:11:30
数据备份完成后可以进行导入操作，注意schema、tablespace的remap操作，以及表的操作，我这里根据业务需求应该是删除后重建，所以选择replace：
oracle@ZT1XPADRDB1:/oracle$ impdp XPADRPT/xpadrpt DIRECTORY=OGGD DUMPFILE=xpadb_20160125_01.dmp LOGFILE=impdp.xpadb_20160125_01.log REMAP_SCHEMA=xpadb:xpadrpt REMAP_TABLESPACE=xpaddat:xpaddata table_exists_action=replace
Import: Release 11.2.0.3.0 - Production on Sat Jan 2 17:18:39 2021
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
Master table "XPADRPT"."SYS_IMPORT_FULL_01" successfully loaded/unloaded
Starting "XPADRPT"."SYS_IMPORT_FULL_01": XPADRPT/******** DIRECTORY=OGGD DUMPFILE=xpadb_20160125_01.dmp LOGFILE=impdp.xpadb_20160125_01.log REMAP_SCHEMA=xpadb:xpadrpt REMAP_TABLESPACE=xpaddat:xpaddata table_exists_action=replace
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
. . imported "XPADRPT"."RICH_CUSTPRODUCTBAL" 63.64 KB 582 rows
. . imported "XPADRPT"."RICH_CUSTOMERINFO" 616.9 KB 2596 rows
. . imported "XPADRPT"."RICH_CUSTACCOUNT" 11.33 MB 177757 rows
. . imported "XPADRPT"."FINANCIAL_MESSAGEINFO" 329.7 MB 3067896 rows
《《《《。。。。。。。。篇幅原因，有省略。。。。。。。。》》》》
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_201408" 0 KB 0 rows
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_201409" 0 KB 0 rows
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_201410" 0 KB 0 rows
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_201411" 0 KB 0 rows
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_201412" 0 KB 0 rows
. . imported "XPADRPT"."RICH_TRADELOG_HIS":"P_999999" 0 KB 0 rows
Processing object type TABLE_EXPORT/TABLE/INDEX/INDEX
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/COMMENT
Processing object type TABLE_EXPORT/TABLE/TRIGGER
Processing object type TABLE_EXPORT/TABLE/INDEX/FUNCTIONAL_AND_BITMAP/INDEX
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/FUNCTIONAL_AND_BITMAP/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Job "XPADRPT"."SYS_IMPORT_FULL_01" successfully completed at 17:29:25
导入成功，接下来启动target端的REPLICAT进程：
GGSCI (ZT1XPADRDB1) 16> stop ggsrep
REPLICAT GGSREP is already stopped.
GGSCI (ZT1XPADRDB1) 17> info all
Program Status Group Lag Time Since Chkpt
MANAGER STOPPED
REPLICAT ABENDED GGSREP 33743:45:19 01:56:55
GGSCI (ZT1XPADRDB1) 18> info all
Program Status Group Lag Time Since Chkpt
MANAGER STOPPED
REPLICAT ABENDED GGSREP 33743:45:19 02:07:52
GGSCI (ZT1XPADRDB1) 19> start mgr
Manager started.
GGSCI (ZT1XPADRDB1) 20> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT ABENDED GGSREP 33743:45:19 02:08:01
GGSCI (ZT1XPADRDB1) 21> start replicat ggsrep , aftercsn 12242466771468
Sending START request to MANAGER ...
REPLICAT GGSREP starting
GGSCI (ZT1XPADRDB1) 22> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 33716:13:56 00:00:02
GGSCI (ZT1XPADRDB1) 23> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 33216:43:48 00:00:04
GGSCI (ZT1XPADRDB1) 24> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 30818:03:37 00:00:05
GGSCI (ZT1XPADRDB1) 25> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 24194:29:09 00:00:02
GGSCI (ZT1XPADRDB1) 26> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 00:00:00 00:00:06
GGSCI (ZT1XPADRDB1) 27> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 00:00:00 00:00:08
GGSCI (ZT1XPADRDB1) 28> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 00:00:00 00:00:09
GGSCI (ZT1XPADRDB1) 29> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING GGSREP 00:00:00 00:00:06
可以看到target端的进程已经正常了。
一.4.4 验证是否可以正常同步数据
当时忘记记录日志，经测试已经可以正常同步数据了，省略验证过程。。。。。
一.5 故障处理总结
一.5.1 OGG-00446 Could not find archived log for sequence 53586 thread 1 under alternative destinations.
错误信息：
OGG-00446 Could not find archived log for sequence 53586 thread 1 under alternative destinations. SQL <SELECT MAX(sequence#) FROM v$log WHERE thread# = :ora_thread>. Last alternative log tried /arch_cx/1_53586_776148274.arc., error retri
eving redo file name for sequence 53586, archived = 1, use_alternate = 0Not able to establish initial position for sequence 53586, rba
44286992.
处理办法：
将缺失的归档日志从备份中恢复出来。如果依旧找不到所需归档日志，那么只能重新实施数据初始化。
第一种办法，会导致数据不一致，改变抽取进程的时间，如下执行：
GGSCI (HP-HP) 8> alter extract extl,begin now
第二种办法：重新初始化
重新初始化过程如下：
---- source库
SQL> col current_scn format 999999999999999
SQL> Select current_scn from v$database;
CURRENT_SCN
----------------
12242466771468
expdp XPADB/XPADB directory=DMP dumpfile=xpadb_20160125_01.dmp LOGFILE=xpadb_20160125.log TABLES=BASE_ACTIONPOWER,BASE_BANK FLASHBACK_SCN=12242466771468
--- target库
impdp XPADRPT/xpadrpt DIRECTORY=OGGD DUMPFILE=xpadb_20160125_01.dmp LOGFILE=impdp.xpadb_20160125_01.log REMAP_SCHEMA=xpadb:xpadrpt REMAP_TABLESPACE=xpaddat:xpaddata table_exists_action=replace
start replicat ggsrep , aftercsn 12242466771468
到此所有的处理算是基本完毕，过程很简单，但是不同的场景处理方式有很多种，我们应该学会灵活变通。