OGG基初数据导入KAFKA
ORACLE 配置方式,适合12C 19C
背景
源:10.10.123.11
目标;10.10.123.12
对应的表; TEST_OGG.TEST_OGG
源端配置
config extract
edit param extInit
编辑内容:
EXTRACT extInit
SETENV (ORACLE_SID = “orcl”)
SETENV (NLS_LANG = “american_america.AL32UTF8”)
userid ogg,password ogg
RMTHOST 10.10.123.12, mgrport 7809
RMTTASK REPLICAT, GROUP rencInit 这行很重要 一定要和目标端初始化进程对应
NOCOMPRESSDELETES
NOCOMPRESSUPDATES
GETUPDATEBEFORES
TABLE TEST_OGG.TEST_OGG;
ADD extract
dblogin userid ogg password ogg
add extract extInit,sourceistable
—启动抽取进程之前,建议先启动目标端的复制初始化进程
start extInit
目标端配置
config mgr
edit param mgr
添加权限:
配置复制初始化进程 config replicat
REPLICAT rencInit
sourcedefs /u01/ogg/dirdef/ogg_kafka
TARGETDB LIBFILE libggjava.so SET property=dirprm/kafka.props
REPORTCOUNT EVERY 1 MINUTES, RATE
GROUPTRANSOPS 10000
GETUPDATEBEFORES
MAP TEST_OGG.TEST_OGG, TARGETTEST_OGG.TEST_OGG;
添加复制进程
add replicat rencInit,specialrun
start renclnit
分别在源端和目标端:
info extInit
inof rencInit
跑批完数据自动会 stop
校验:
--------------------------------------mysql 配置------------------------------------------------
源端配置:
extract extInit
sourcedb occ@127.0.0.1:3306 userid ogg password welcome1
RMTHOST 192.168.10.2, mgrport 7809
RMTTASK REPLICAT, GROUP reztInit
GETUPDATEBEFORES
NOCOMPRESSUPDATES
NOCOMPRESSDELETES
table TEST_OGG.TEST_OGG;
目标端
REPLICAT reztInit
sourcedefs /u01/ogg/dirdef/ogg_mp
TARGETDB LIBFILE libggjava.so SET property=dirprm/kafka.props
HANDLECOLLISIONS
REPORTCOUNT EVERY 1 MINUTES, RATE
GROUPTRANSOPS 10000
GETUPDATEBEFORES
MAP TEST_OGG.TEST_OGG target TEST_OGG.TEST_OGG;