Release-2.4.0
ruanhang1993
released this
25 Jun 08:02
·
575 commits
to master
since this release
Release Notes
Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.4
Features and Improvements
- [hotfix] Add vitess connector to the release profile
- [docs][hotfix] Update debezium reference links to 1.9 version
- [build] Update the copyright year to 2023 (#2205)
- [postgres] Fix postgres e2e test
- [postgres] scan.incremental.snapshot.enabled is closed by default
- [postgres] Backfill task will be able to end when there is not new change data but read the ending lsn
- [postgres] Create slot for backfill task before snapshot reading
- [postgres] Prepare a slot for the unique global stream split
- [mysql] Fix GTID issues to recover from checkpoint normally in specifying startup mode (#2220)
- [doc][hotfix] Fix driver version and correct vitess doc path (#2224)
- [vitess] Add e2e case for Vitess connector
- [vitess] Add Vitess tests in Azure pipeline
- [vitess] Add Vitess CDC connector (#456)
- [debezium] Bump debezium version to 1.9.7.Final (#2156)
- [oracle] Fix the backfill task not running bug in oracle cdc connector (#2218)
- [hotfix][sqlserver] Merge high and low watermark data during snapshot reading process (#2179)
- [Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
- [oracle] Fix the incremental phase not skip the data that has been read in the snapshot full phase (#2215)
- [mongodb] Support specific timestamp startup mode. (#2207)
- [tests][mysql] Shutdown mysql container timely for legacy mysql tests
- [mongodb][hotfix] Fix regex inference of database or collection only contains dash. (#2209)
- [hotfix][build] Use different name for each job
- [hotfix][Mysql] MySqlBinlogSplitAssigner should support method isStreamSplitAssigned
- [MySQL] Remove deleted tables when using a new table filter and restarting from checkpoint
- [build][mysql][e2e] Increase the azure test job timeout to 90 minutes
- [mysql] Fix MySql CDC Connector outputs duplicated binlog when enable newly-added-table
- [mysql][minor] Print clear log information for key path
- [mongodb][hotfix] Fix drop or rename record cause documentKey being empty. (#2210)
- [ci][oceanbase] Only compile necessary modules for self hosted pipeline
- [doc] Add docs for close idle readers feature. (#2208)
- [cdc-base] Close idle readers when snapshot finished (#2202)
- [mongodb] Add support for mongodb+srv connection protocol. (#2203)
- [oceanbase] Always cleanup resources after reading before exit (#2189)
- [mongodb][hotfix] Fix NullPointerException when executing ddl operation in MongoDB (#2107)
- [mysql-cdc] Supports MYSQL_TYPE_TYPED_ARRAY column type when parsing the table map event
- [mysql-cdc][hotfix] Optimize the error msg when binlog expire in source
- [mysql-cdc] Optimize the error msg when binlog expire or server id conflict This closes #2010.
- [oceanbase] add jdbc options and support oracle mode (#1854)
- [mysql-cdc] Add handler for catching async exceptions in snapshot reading executor This closes #2016.
- [hotfix][mysql-cdc] Use session timezone instead of local time zone as the default server time zone
- [mysql] Fix NullPointerException when database name or table name contains dot
- [mysql] Fix NullPointerException caused by mysql ignores the capitalization when splitting chunks
- [sqlserver] Fix old change data that will be captured when the latest mode starts (#2176)
- [core] support print configuration options for connectors (#2099)
- [oceanbase] support libobcdc 4.x and fix restore timestamp config (#2161)
- [sqlserver] Sqlserver incremental source. (#1732)
- [OceanBase][test] Update oceanbase and oblogproxy docker image (#2060)
- [oceanbase] use real charset to convert change record (#2159)
- [mysql] Support tables which do not contain a primary key (#2150)
- [common] Bump flink to 1.17.0 (#2057)
- [doc] add mongodb cdc chinese doc (#2042)
- [hotfix][test] ignore OracleConnectorITCase.testConsumingAllEvents util issue 1875 fix (#2111)
- [docs][db2] Correct CHAR(n) to CHARACTER(n) (#2052)
- [postgres] Change config option slot.name to be required (#1996)
- [docs] Update the outdated DingTalk QR code
- [mongodb][hotfix] Fix pollAwaitTimeMillis does not take effect (#1995)
- [tests][mysql] Skip unnecessary IT Cases which uses legacy debezium source implementation
- [mysql] Add note for MySQL TINYINT(1) type to Flink SQL Boolean type
- [github] Minor typo in issue bug-report (#2020)
- [mysql-cdc] Fix race condition between split and coordinator thread that async exception might not be caught
- [mysql/oracle] Fix the wrong comments in ChunkSplitter
- [hotfix][docs] Correct the flink file path in MySQL docs
- [hotfix][mongodb] Fix resume token not found #1879 (#1938)
- [mongodb][hotfix] Fix authentication failed when using a non admin auth source and duplicated usernames #1934 (#1935)
- [mysql] Add various test cases to cover newly added table process from read binlog blocking to read binlog un-blocking
- [hotfix][base] Fix typo in java docs
- [mysql] Optimize the newly added table process from read binlog blocking to read binlog un-blocking
- [minor][mysql] Rename SplitsSize to SplitsNumber
- [hotfix][mysql] Correct meta group id as it is 0 based
- [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout
- [mongodb] Improve code structure (#1900)
- [build] Use issue form templates (#1830)
- [ci] Fix for dubious repo ownership issue (#1843)
- [docs] Update mysql-cdc.md to recommend latest version (#1842)
- [ci] Fix for dubious repo ownership issue (#1840)
- [docs][sqlserver] Update data type mapping (#1802)
- [ci][tidb] Fix dns cache works incorrect in latest jdk 8. (#1809)
- [postgresql] Upgrade postgresql driver from 42.2.26 to 42.2.27 to avoid CVE-2022-41946 (#1773)
- [minor][common] Improve the changelogMode expression (#1793)
- [hotfix][debezium] Forward root cause in DebeziumSourceFunction (#1791)
- [docs][oracle] Add new introduced config options from incremental snapshot framework (#1719)
- [mysql] Fix backward compatibility on deserializing binlog offset from old versions (#1758)
- [hotfix][docs] Correct the startup option's data type in Mysql docs and duplicate batch.size in MongoDB docs (#1751)
- [hotfix][docs] Correct the mysql driver version in MySQL docs
- [docs][site] update the supported cdc connectors picture
- [oracle] Add missing supported config options for oracle table source (#1727)
Contributor List (sorted alphabetically)
- Hang Ruan
- He Wang
- JasonLee
- Jiabao Sun
- Jingsong Lee
- Xiao Meng
- Leonard Xu
- Qingsheng Ren
- Robert Metzger
- Sergey Nuyanzin
- Simonas Gelazevicius
- Yaroslav Tkachenko
- Tigran Manasyan
- Tyrantlucifer
- ZhongLinLeo
- bb chen
- ehui
- emhui
- gintarasm
- gongzhongqiang
- liangyaohui97
- lin.zl
- molsionmo
- skylines
- tison
- wallkop
- wangxiaojing
- wuzhenhua
- xixingya
- zhaomin
- zhuyuan03
- 含风