Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.4

Features and Improvements

1. [hotfix] Add vitess connector to the release profile
2. [docs][hotfix] Update debezium reference links to 1.9 version
3. [build] Update the copyright year to 2023 (#2205)
4. [postgres] Fix postgres e2e test
5. [postgres] scan.incremental.snapshot.enabled is closed by default
6. [postgres] Backfill task will be able to end when there is not new change data but read the ending lsn
7. [postgres] Create slot for backfill task before snapshot reading
8. [postgres] Prepare a slot for the unique global stream split
9. [mysql] Fix GTID issues to recover from checkpoint normally in specifying startup mode (#2220)
10. [doc][hotfix] Fix driver version and correct vitess doc path (#2224)
11. [vitess] Add e2e case for Vitess connector
12. [vitess] Add Vitess tests in Azure pipeline
13. [vitess] Add Vitess CDC connector (#456)
14. [debezium] Bump debezium version to 1.9.7.Final (#2156)
15. [oracle] Fix the backfill task not running bug in oracle cdc connector (#2218)
16. [hotfix][sqlserver] Merge high and low watermark data during snapshot reading process (#2179)
17. [Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
18. [oracle] Fix the incremental phase not skip the data that has been read in the snapshot full phase (#2215)
19. [mongodb] Support specific timestamp startup mode. (#2207)
20. [tests][mysql] Shutdown mysql container timely for legacy mysql tests
21. [mongodb][hotfix] Fix regex inference of database or collection only contains dash. (#2209)
22. [hotfix][build] Use different name for each job
23. [hotfix][Mysql] MySqlBinlogSplitAssigner should support method isStreamSplitAssigned
24. [MySQL] Remove deleted tables when using a new table filter and restarting from checkpoint
25. [build][mysql][e2e] Increase the azure test job timeout to 90 minutes
26. [mysql] Fix MySql CDC Connector outputs duplicated binlog when enable newly-added-table
27. [mysql][minor] Print clear log information for key path
28. [mongodb][hotfix] Fix drop or rename record cause documentKey being empty. (#2210)
29. [ci][oceanbase] Only compile necessary modules for self hosted pipeline
30. [doc] Add docs for close idle readers feature. (#2208)
31. [cdc-base] Close idle readers when snapshot finished (#2202)
32. [mongodb] Add support for mongodb+srv connection protocol. (#2203)
33. [oceanbase] Always cleanup resources after reading before exit (#2189)
34. [mongodb][hotfix] Fix NullPointerException when executing ddl operation in MongoDB (#2107)
35. [mysql-cdc] Supports MYSQL_TYPE_TYPED_ARRAY column type when parsing the table map event
36. [mysql-cdc][hotfix] Optimize the error msg when binlog expire in source
37. [mysql-cdc] Optimize the error msg when binlog expire or server id conflict This closes #2010.
38. [oceanbase] add jdbc options and support oracle mode (#1854)
39. [mysql-cdc] Add handler for catching async exceptions in snapshot reading executor This closes #2016.
40. [hotfix][mysql-cdc] Use session timezone instead of local time zone as the default server time zone
41. [mysql] Fix NullPointerException when database name or table name contains dot
42. [mysql] Fix NullPointerException caused by mysql ignores the capitalization when splitting chunks
43. [sqlserver] Fix old change data that will be captured when the latest mode starts (#2176)
44. [core] support print configuration options for connectors (#2099)
45. [oceanbase] support libobcdc 4.x and fix restore timestamp config (#2161)
46. [sqlserver] Sqlserver incremental source. (#1732)
47. [OceanBase][test] Update oceanbase and oblogproxy docker image (#2060)
48. [oceanbase] use real charset to convert change record (#2159)
49. [mysql] Support tables which do not contain a primary key (#2150)
50. [common] Bump flink to 1.17.0 (#2057)
51. [doc] add mongodb cdc chinese doc (#2042)
52. [hotfix][test] ignore OracleConnectorITCase.testConsumingAllEvents util issue 1875 fix (#2111)
53. [docs][db2] Correct CHAR(n) to CHARACTER(n) (#2052)
54. [postgres] Change config option slot.name to be required (#1996)
55. [docs] Update the outdated DingTalk QR code
56. [mongodb][hotfix] Fix pollAwaitTimeMillis does not take effect (#1995)
57. [tests][mysql] Skip unnecessary IT Cases which uses legacy debezium source implementation
58. [mysql] Add note for MySQL TINYINT(1) type to Flink SQL Boolean type
59. [github] Minor typo in issue bug-report (#2020)
60. [mysql-cdc] Fix race condition between split and coordinator thread that async exception might not be caught
61. [mysql/oracle] Fix the wrong comments in ChunkSplitter
62. [hotfix][docs] Correct the flink file path in MySQL docs
63. [hotfix][mongodb] Fix resume token not found #1879 (#1938)
64. [mongodb][hotfix] Fix authentication failed when using a non admin auth source and duplicated usernames #1934 (#1935)
65. [mysql] Add various test cases to cover newly added table process from read binlog blocking to read binlog un-blocking
66. [hotfix][base] Fix typo in java docs
67. [mysql] Optimize the newly added table process from read binlog blocking to read binlog un-blocking
68. [minor][mysql] Rename SplitsSize to SplitsNumber
69. [hotfix][mysql] Correct meta group id as it is 0 based
70. [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout
71. [mongodb] Improve code structure (#1900)
72. [build] Use issue form templates (#1830)
73. [ci] Fix for dubious repo ownership issue (#1843)
74. [docs] Update mysql-cdc.md to recommend latest version (#1842)
75. [ci] Fix for dubious repo ownership issue (#1840)
76. [docs][sqlserver] Update data type mapping (#1802)
77. [ci][tidb] Fix dns cache works incorrect in latest jdk 8. (#1809)
78. [postgresql] Upgrade postgresql driver from 42.2.26 to 42.2.27 to avoid CVE-2022-41946 (#1773)
79. [minor][common] Improve the changelogMode expression (#1793)
80. [hotfix][debezium] Forward root cause in DebeziumSourceFunction (#1791)
81. [docs][oracle] Add new introduced config options from incremental snapshot framework (#1719)
82. [mysql] Fix backward compatibility on deserializing binlog offset from old versions (#1758)
83. [hotfix][docs] Correct the startup option's data type in Mysql docs and duplicate batch.size in MongoDB docs (#1751)
84. [hotfix][docs] Correct the mysql driver version in MySQL docs
85. [docs][site] update the supported cdc connectors picture
86. [oracle] Add missing supported config options for oracle table source (#1727)

Contributor List (sorted alphabetically)

1. Hang Ruan
2. He Wang
3. JasonLee
4. Jiabao Sun
5. Jingsong Lee
6. Xiao Meng
7. Leonard Xu
8. Qingsheng Ren
9. Robert Metzger
10. Sergey Nuyanzin
11. Simonas Gelazevicius
12. Yaroslav Tkachenko
13. Tigran Manasyan
14. Tyrantlucifer
15. ZhongLinLeo
16. bb chen
17. ehui
18. emhui
19. gintarasm
20. gongzhongqiang
21. liangyaohui97
22. lin.zl
23. molsionmo
24. skylines
25. tison
26. wallkop
27. wangxiaojing
28. wuzhenhua
29. xixingya
30. zhaomin
31. zhuyuan03
32. 含风