oracle goldengate实现postgresql 到 postgresql的实时同步

源端：postgresql1 -> postgresql2 流复制主备同步
目标端：postgresql
数据库版本：postgresql 12.14
ogg版本：21.3

架构图：

数据库安装以及流复制主备同步配置忽略。以下直接进入OGG的配置

odbc配置：

[root@oradb1 ogg213]# yum list |grep postgresql-odbc.x86_64
Repodata is over 2 weeks old. Install yum-cron? Or run: yum makecache fast
postgresql-odbc.x86_64                  09.03.0100-2.el7               @centos7 
[root@oradb1 ogg213]# 

[root@oradb1 ogg213]# cat /etc/odbcinst.ini 
# Example driver definitions# Driver from the postgresql-odbc package
# Setup from the unixODBC package
[PostgreSQL]
Description	= ODBC for PostgreSQL
Driver		= /usr/lib64/psqlodbcw.so
Setup		= /usr/lib64/libodbcpsqlS.so
Driver64	= /usr/lib64/psqlodbcw.so
Setup64		= /usr/lib64/libodbcpsqlS.so
FileUsage	= 1# Driver from the mysql-connector-odbc package
# Setup from the unixODBC package
[MySQL]
Description	= ODBC for MySQL
Driver		= /usr/lib/libmyodbc5.so
Setup		= /usr/lib/libodbcmyS.so
Driver64	= /usr/lib64/libmyodbc5.so
Setup64		= /usr/lib64/libodbcmyS.so
FileUsage	= 1
[root@oradb1 ogg213]# cat /etc/odbc.ini 
#Sample DSN entries
[ODBC Data Sources]
PG_src=DataDirect 12.14 PostgreSQL Wire Protocol
PG_tgt=DataDirect 12.14 PostgreSQL Wire Protocol[ODBC]
IANAAppCodePage=4
InstallDir=/ogg213[pg_src1]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.11
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2[pg_src]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.12
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2[pg_tgt]
Driver=/ogg213/lib/GGpsql25.so
Description=DataDirect 12.14 PostgreSQL Wire Protocol
Database=testdb
HostName=192.168.56.101
PortNumber=5432
LogonID=ggadmin
Password=Bai_yun123
TransactionErrorBehavior=2
[root@oradb1 ogg213]# 

验证登录成功：

GGSCI (oradb1) 6> dblogin sourcedb pg_src userid ggadmin password Bai_yun1232025-05-30 21:45:31  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:45:31  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oradb1 as ggadmin@pg_src) 7> dblogin sourcedb pg_tgt userid ggadmin password Bai_yun1232025-05-30 21:45:38  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:45:38  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oradb1 as ggadmin@pg_tgt) 8> 

OGG解压：

[root@oradb1 soft]# cd oggsoft/
[root@oradb1 oggsoft]# ll
total 467684
-rwxrwxr-x 1 postgres postgres  97040905 May 30 16:04 213000_ggs_Linux_x64_PostgreSQL_64bit.zip
-rw-rw-rw- 1 postgres postgres 381552640 Aug  5  2021 ggs_Linux_x64_PostgreSQL_64bit.tar
-rw-r--r-- 1 postgres postgres      2409 Aug 11  2021 OGG-21.3.0.0-README.txt
-rw-r--r-- 1 postgres postgres    306395 Aug 11  2021 oracle-goldengate-release-notes_21.3.pdf
[root@oradb1 oggsoft]# $ tar -xvf ggs_Linux_x64_PostgreSQL_64bit.tar -C /ogg213$ cd /ogg213
$ ./ggsci
$ create subdirs

链接到备库注册抽取进程，失败。

GGSCI (oradb1 as ggadmin@pg_src) 9> register extract ep12025-05-30 21:47:59  WARNING OGG-00552  Database operation failed: Executing statement to create replication slot. Called from PGUTIL_registerExtract:178. ODBC error: SQLSTATE S1C00 native database error 466560. [Oracle][ODBC PostgreSQL Wire Protocol driver][PostgreSQL]ERROR: VERROR; logical decoding cannot be used while in recovery(File logical.c; Line 113; Routine CheckLogicalDecodingRequirements;.

链接到主库注册抽取进程，成功。

GGSCI (oradb1 as ggadmin@pg_src) 10> dblogin sourcedb pg_src1 userid ggadmin password Bai_yun1232025-05-30 21:52:04  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-30 21:52:04  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 10> register extract ep12025-05-31 11:34:52  INFO    OGG-25353  The replication slot 'ep1_831e5a3f6113dbb2' for group 'EP1' already exist in the database 'testdb'.GGSCI (oggser as ggadmin@pg_src1) 11> UNREGISTER EXTRACT ep1 with DATABASE testdb2025-05-31 11:36:30  INFO    OGG-25356  Successfully dropped the replication slot 'ep1_831e5a3f6113dbb2' for Extract group 'EP1' in database 'testdb'.GGSCI (oggser as ggadmin@pg_src1) 12> register extract ep12025-05-31 11:36:37  INFO    OGG-25355  Successfully created replication slot 'ep1_831e5a3f6113dbb2' for Extract group 'EP1' in database 'testdb'.GGSCI (oradb1 as ggadmin@pg_src1) 12> edit param ep1GGSCI (oradb1 as ggadmin@pg_src1) 13> view param ep1extract ep1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
sourcedb testdb, userid ggadmin, password Bai_yun123
exttrail ./dirdat/e1
discardfile ./dirrpt/ep1.dsc
table public.tab1;

添加trandata

GGSCI (oggser as ggadmin@pg_src1) 2> ADD TRANDATA public.tab1Logging of supplemental log data is already enabled for table public.tab1 with REPLICA IDENTITY set to DEFAULT

启动进程失败：

2025-05-30 22:13:22  ERROR   OGG-00551  Database operation failed: Couldn't connect to testdb. ODBC error: SQLSTATE IM002 native database error 0. [DataDirect][ODBC lib] D
ata source name not found and no default driver specified.2025-05-30 22:13:22  ERROR   OGG-01668  PROCESS ABENDING.

修改
sourcedb pg_src1, userid ggadmin, password Bai_yun123

2025-05-30 22:16:24  ERROR   OGG-25516  Oracle GoldenGate capture using LIBPQ client library version as 90,401 which is incompatible with the connected PostgreSQL server v
ersion 121,400 for streaming the log record. The LIBPQ client library version must be the same as or bigger than, that of the connected PostgreSQL server library version.Source Context :SourceModule            : [ggvam.gen]SourceID                : [../gglib/ggvam/cvamgen.cpp]SourceMethod            : [vamInitialize]SourceLine              : [536]ThreadBacktrace         : [14] elements: [/ogg213/libgglog.so(CMessageContext::AddThreadContext())]: [/ogg213/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]: [/ogg213/libgglog.so(_MSG_String_Int32(CSourceContext*, int, char const*, int, CMessageFactory::MessageDisposition))]: [/ogg213/extract(com_goldengate_vam::CVamGen::vamInitialize())]: [/ogg213/extract()]: [/ogg213/extract(ggs::er::VAMDataSource::finalizeConfiguration())]: [/ogg213/extract(ggs::gglib::ggapp::ReplicationContext::finalizeConfiguration())]: [/ogg213/extract()]: [/ogg213/extract(ggs::gglib::MultiThreading::MainThread::ExecMain())]: [/ogg213/extract(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*))]: [/ogg213/extract(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]: [/ogg213/extract(main)]: [/lib64/libc.so.6(__libc_start_main)]: [/ogg213/extract()]2025-05-30 22:16:24  ERROR   OGG-00145  Call to VAMInitialize returned with error status 16002.2025-05-30 22:16:24  ERROR   OGG-01668  PROCESS ABENDING.

根据提示的版本LIBPG的版本号与postgresql的版本号不一致导致。查看postgresql lib的安装包。

[root@oggser soft]# rpm -ivh postgresql12-libs-12.21-1PGDG.rhel7.x86_64.rpm 
warning: postgresql12-libs-12.21-1PGDG.rhel7.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID 73e3b907: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...1:postgresql12-libs-12.21-1PGDG.rhe################################# [100%][root@oggser ogg213]# yum list |grep postgres
postgresql-libs.x86_64                 9.2.24-1.el7_5              @local         
postgresql12-libs.x86_64               12.21-1PGDG.rhel7           installed    

重新启动ep1进程，问题仍然出现。

尝试卸载

[root@oggser ogg213]# rpm -qa |grep postgresql-libs
postgresql-libs-9.2.24-1.el7_5.x86_64
[root@oggser ogg213]# rpm -e postgresql-libs-9.2.24-1.el7_5.x86_64
[root@oggser ogg213]# rpm -qa |grep postgresql-libs

再次重启ep1进程，正常。

GGSCI (oggser) 3> start ep1Sending START request to Manager ...
Extract group EP1 starting.GGSCI (oggser) 4> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:42:22      00:00:01    GGSCI (oggser) 9> info ep1Extract    EP1       Last Started 2025-05-31 12:19   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:05 ago)
Process ID           4427
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     Unavailable(requires DBLOGIN)
Slot Restart LSN     Unavailable(requires DBLOGIN)
Slot Flush LSN       Unavailable(requires DBLOGIN)
Current Log Position Unavailable(requires DBLOGIN)GGSCI (oggser) 10> stop ep1Sending STOP request to Extract group EP1 ...
Request processed.

查看进程状态的提示需要登录，尝试先登录数据库再启动。

GGSCI (oggser) 12> dblogin sourcedb pg_src1 userid ggadmin password Bai_yun1232025-05-31 12:42:07  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 12:42:07  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 13> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     STOPPED     EP1         00:00:00      00:21:55    GGSCI (oggser as ggadmin@pg_src1) 14> start ep1Sending START request to Manager ...
Extract group EP1 starting.GGSCI (oggser as ggadmin@pg_src1) 15> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:01    GGSCI (oggser as ggadmin@pg_src1) 16> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:05 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     ep1_831e5a3f6113dbb2 is active with PID 1900 in database testdb
Slot Restart LSN     0/301BE30
Slot Flush LSN       0/301BE68
Current Log Position 0/301BE68GGSCI (oggser as ggadmin@pg_src1) 17> 

至此抽取进去配置完成。

添加应用进程

GGSCI (oggser as ggadmin@pg_src1) 19> dblogin sourcedb pg_tgt, userid ggadmin, password Bai_yun1232025-05-31 12:53:51  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 12:53:51  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_tgt) 20> ADD CHECKPOINTTABLE ggadmin.oggcheck2025-05-31 12:54:06  WARNING OGG-30055  Database error 5738688 ([Oracle][ODBC PostgreSQL Wire Protocol driver][PostgreSQL]ERROR: VERROR; schema "ggadmin" does not exist(Position 14; File namespace.c; Line 3045; Routine get_namespace_oid; )).
Error: Failed creating checkpoint table ggadmin.oggcheck.<NIL>GGSCI (oggser as ggadmin@pg_tgt) 21> ADD CHECKPOINTTABLE public.oggcheckSuccessfully created checkpoint table public.oggcheck.edit param rp1 replicat rp1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
targetdb pg_tgt, userid ggadmin, password Bai_yun123
map public.tab1, public.tab1;GGSCI (oggser as ggadmin@pg_tgt) 23> ADD REPLICAT rp1, EXTTRAIL ./dirdat/e1, CHECKPOINTTABLE public.oggcheck
Replicat added.

启动进程失败

2025-05-31 12:57:24  INFO    OGG-03037  Session character set identified as UTF-8.
map public.tab1, public.tab1;Source Context :SourceModule            : [er.wildcard]SourceID                : [er/wildcard.c]SourceMethod            : [WILDCARD_get_entry]SourceLine              : [2658]ThreadBacktrace         : [12] elements: [/ogg213/libgglog.so(CMessageContext::AddThreadContext())]: [/ogg213/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...))]: [/ogg213/libgglog.so(_MSG_String(CSourceContext*, int, char const*, CMessageFactory::MessageDisposition))]: [/ogg213/replicat(WILDCARD_get_entry(ggs::gglib::ggunicode::UString const&, recopts_t*, bool, bool, unsigned int*, void*, int, int, bool&, catalogList&, bool, bool, bool))]: [/ogg213/replicat(get_infile_params(ggs::gglib::ggapp::ReplicationContextParams&, ggs::gglib::ggdatasource::DataSourceParams&, ggs::gglib::ggdatatarget::DataTargetParams&, ggs::ggli
b::ggmetadata::MetadataContext&))]: [/ogg213/replicat()]: [/ogg213/replicat(ggs::gglib::MultiThreading::MainThread::ExecMain())]: [/ogg213/replicat(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*))]: [/ogg213/replicat(ggs::gglib::MultiThreading::MainThread::Run(int, char**))]: [/ogg213/replicat(main)]: [/lib64/libc.so.6(__libc_start_main)]: [/ogg213/replicat()]2025-05-31 12:57:24  ERROR   OGG-00204  Missing TARGET specification.2025-05-31 12:57:24  ERROR   OGG-01668  PROCESS ABENDING.

原因：
参数配置中缺少target 关键字。
map public.tab1, public.tab1;

修复后再次启动正常。

GGSCI (oggser as ggadmin@pg_tgt) 35> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:00    
REPLICAT    RUNNING     RP1         00:00:00      00:00:05    

查看抽取进程和应用进程信息

GGSCI (oggser as ggadmin@pg_tgt) 39> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:11 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     Unavailable(requires DBLOGIN)
Slot Restart LSN     Unavailable(requires DBLOGIN)
Slot Flush LSN       Unavailable(requires DBLOGIN)
Current Log Position Unavailable(requires DBLOGIN)GGSCI (oggser as ggadmin@pg_tgt) 40> dblogin sourcedb pg_src1, userid ggadmin, password Bai_yun1232025-05-31 13:04:43  INFO    OGG-03036  Database character set identified as UTF-8. Locale: en_US.UTF-8.2025-05-31 13:04:43  INFO    OGG-03037  Session character set identified as UTF-8.
Successfully logged into database.GGSCI (oggser as ggadmin@pg_src1) 41> info ep1Extract    EP1       Last Started 2025-05-31 12:42   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:03 ago)
Process ID           13486
VAM Read Checkpoint  2025-05-31 11:37:21.985039Replication Slot     ep1_831e5a3f6113dbb2 is active with PID 1900 in database testdb
Slot Restart LSN     0/301BE30
Slot Flush LSN       0/301BE68
Current Log Position 0/301BE68

数据初始化进程配置

初始化抽取进程

dblogin sourcedb pg_src1, userid ggadmin, password Bai_yun123add ext ie1, sourceistable
edit param ie1
--添加如下内容
extract ie1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
sourcedb pg_src1, userid ggadmin, password Bai_yun123
extfile ./dirdat/i1
table public.tab1;--启动存量数据抽取
start ie1
info ie1

初始化应用进程

add rep ir1, exttrail ./dirdat/i1, nodbcheckpoint
edit param ir1
--添加如下内容replicat ir1
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/etc/odbc.ini" )
targetdb pg_tgt, userid ggadmin, password Bai_yun123
discardfile ./dirrpt/ir11.dsc
map public.tab1, target public.tab1;--启动ir1进程
start ir1
info ir1

查看初始化信息

GGSCI (oggser as ggadmin@pg_src1) 50> info ir1Replicat   IR1       Last Started 2025-05-31 13:10   Status RUNNING
Checkpoint Lag       00:01:45 (updated 00:00:03 ago)
Process ID           14884
Log Read Checkpoint  File ./dirdat/i10000002025-05-31 13:08:25.380705  RBA 1781GGSCI (oggser as ggadmin@pg_src1) 51> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:07    
REPLICAT    RUNNING     IR1         00:01:45      00:00:07    
REPLICAT    RUNNING     RP1         00:00:00      00:00:05    GGSCI (oggser as ggadmin@pg_src1) 52> info allProgram     Status      Group       Lag at Chkpt  Time Since ChkptMANAGER     RUNNING                                           
EXTRACT     RUNNING     EP1         00:00:00      00:00:00    
REPLICAT    RUNNING     IR1         00:00:00      00:00:02    
REPLICAT    RUNNING     RP1         00:00:00      00:00:00    GGSCI (oggser as ggadmin@pg_src1) 53> stats ir1, totalSending STATS request to Replicat group IR1 ...Start of statistics at 2025-05-31 13:10:45.Replicating from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:10:11 ***Total inserts                              1.00Total updates                              0.00Total deletes                              0.00Total upserts                              0.00Total discards                             0.00Total operations                           1.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 54> GGSCI (oggser as ggadmin@pg_src1) 46> info ie1Extract    IE1       Last Started 2025-05-31 13:08   Status STOPPED
Checkpoint Lag       Not Available
Log Read Checkpoint  Table public.tab12025-05-31 13:08:25  Record 1
Task                 SOURCEISTABLE

目标端查看数据已经初始化完成。

DML测试验证

源端主库插入变更。

testdb=# insert into tab1 values(2,'pg2');
INSERT 0 1
testdb=# 
testdb=# insert into tab1 values(3,'pg3');
INSERT 0 1
testdb=# insert into tab1 values(4,'pg4');
INSERT 0 1
testdb=# update tab1 set tname='pgbak' where tid=1;
UPDATE 1
testdb=# delete from tab1 where tid=2;
DELETE 1

OGG服务器查看进程统计信息

GGSCI (oggser as ggadmin@pg_src1) 57> stats ep1 ,totalSending STATS request to Extract group EP1 ...Start of statistics at 2025-05-31 13:16:46.Output to ./dirdat/e1:Extracting from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:15:08 ***Total inserts                              3.00Total updates                              1.00Total deletes                              1.00Total upserts                              0.00Total discards                             0.00Total operations                           5.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 58> stats rp1 ,totalSending STATS request to Replicat group RP1 ...Start of statistics at 2025-05-31 13:16:55.Replicating from public.tab1 to public.tab1:*** Total statistics since 2025-05-31 13:15:12 ***Total inserts                              3.00Total updates                              1.00Total deletes                              1.00Total upserts                              0.00Total discards                             0.00Total operations                           5.00End of statistics.GGSCI (oggser as ggadmin@pg_src1) 59>