Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.2/

Features and Improvements

1. [docs] Update the supported database vendors and improve the notes.
2. [docs][mysql][polardbx] Add polardbx tutorials (#1003)
3. [docs][mysql] Remove redundant docker environment variable in tutorials (#1005)
4. [cdc-base] Add MySQL Incremental Source to validate the Incremental Snapshot Framework(#776)
5. [cdc-base] Improve the Incremental Snapshot Interfaces
6. [cdc-base] The first version of Incremental Snapshot Framework abstraction
7. [hotfix][docs] Fix markdown title due to typo in readme
8. [oceanbase] Bump the oblogclient version to 1.0.3 to fix the NPE in oblogclient connection (#998)
9. [docs] Clarify ownership to comply with ASF trademark policies (#1000)
10. [build] Decrease the azure job timeout to reasonable 40 minutes (#991)
11. [hotfix][site] Use Flink with its trademark
12. [docs] Adopt the full name 'Apache Flink' with its trademark notice (#988)
13. [hotfix][docs] Update the copyright
14. [docs][mysql] Correct the jdbc driver version in documentation
15. [docs] Organize the connector docs in alphabetical order
16. [docs][tidb] Add tidb cdc connector document
17. [hotfix][docs] Fix typo in tidb-tutorial.md and tidb-tutorial-zh.md
18. [mysql] Suspend SourceReader eagerly to reduce restoration time
19. [docs][oceanbase] Add quickstart tutorials for OceanBase CDC connector
20. [docs][oceanbase] Add docs for OceanBase CDC connector
21. [build][oceanbase] Use self-hosted agent for oceanbase cdc tests
22. [oceanbase] Add OceanBase CDC connector
23. [tidb] remove useless code.
24. [test][e2e] Use single fork in tests
25. [test][e2e] Clean up database resources for every e2e tests.
26. [e2e] bump flink e2e test version.
27. [tidb] Add tidb cdc connector e2e test.
28. [tidb] Add flink1.14 support.
29. [hotfix][mysql] Avoid schema isn't known error when scanNewlyAddedTable enabled (#965)
30. [mysql][polardbx] Remove debug print code in PolardbxSourceTCase (#968)
31. [tidb] Introduce runtime converter to improve the deserialization
32. [tidb][test] Add timezone tests for tidb
33. [tidb] Remove useless config options
34. [docs][site] Add favicon fot website index html
35. [docs][site] Introduce static index html for the project website (#961)
36. [mysql] Split snapshot chunks asynchronously (#931)
37. [docs][tidb] Add index for tidb tutorial docs
38. [tidb][docs] Add tidb connector tutorial (#938)
39. [tidb] Add metadata column ITCase and improve the code style
40. [tidb][test] Fix tikv port conflicts
41. [tidb] Support metadata column
42. [tidb][test] Add tidb pipeline in azure CI
43. [tidb][test] Add TiDBTableSourceFactoryTest and TiDBConnectorITCase
44. [tidb] Fix tikv.pd.addresses not work and use ResolvedSchema instead of TableSchema.
45. [tidb] Bump tikv client version to v3.2.0
46. [tidb] The first draft of tidb cdc connector
47. [docs] List supported databases in docs (#954)
48. [mysql] Fallback to build schema by 'desc table' case when parsing DDL failure (#949)
49. [docs] Fix download url in mongodb tutorial (#951)
50. [docs] Update DingTalk QR code to English version (#950)
51. [mongodb] Match multiple database and collection names using a regular expression in MongoDB. (#940)
52. [mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921)
53. [mongodb][test] Fix unstable tests of MongoDBConnectorITCase (#944)
54. [mysql] Improve mysql heartbeat feature and tests
55. [mysql] Original implementation of mysql heartbeat feature
56. [common] Update issue templates
57. [hotfix][mysql] Fix MySqlSourceReader#snapshotState should return unfinishedSplits (#926)
58. [docs] Fix the outdated link of flink download link (#922)
59. [hotfix][mysql] Fix the binlog position didn't update when emit DDL (#925)
60. [mongodb] Correct the TypeInformation argument of DebeziumDeserializationSchema in SourceFuntion (#780)
61. [common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615)
62. [mysql] Improve the test to cover table with varbinary primary key (#879)
63. [mysql] Support primary key with varbinary type (#879)
64. [format][changelog-json] Remove the support of changelog-json format (#912)
65. [hotfix][minor] Fix the test code typo
66. [mysql] Fix ArrayIndexOutOfBoundsException in mysql binlog read phase (#911)
67. [mongodb][tests] Track MongoDBITCase hang in azure (#881)
68. [docs] Update the supported flink version mapping (#885)
69. [common] Fix emitDelay and fetchDelay metrics to be 0L during snapshot phase (#878)
70. [hotfix][docs][mongodb] Update supported mongodb versions in README.md
71. [docs][sql-server] Add sqlserver-cdc connector tutorial (#687) This closes #687.
72. [common] Use ResolvedSchema instead of deprecated TableSchema API (#782)
73. [docs][sqlserver] Add SqlServer CDC connector document (#705)
74. [doc][sqlserver] Add SqlServer English tutorial document. (#693)
75. [common] Make Flink CDC Compatible with Flink 1.14
76. [build] Bump flink version to 1.13.5
77. [docs][oracle] Add guidance about oracle CDB database (#792)
78. [docs] Add connection.pool.size and connect.max-retries option in mysql document (#857)
79. [sqlserver] Add e2e tests for sqlserver cdc connector (#837)
80. [hotfix][mysql] Rename method from dispatchHighWatermark to dispatchBinlogEndEvent (#810) This closes #810.
81. [mysql] Use READ type for all records in snapshot reading (#842)
82. [mysql] Rewrite the newly added table tests to cover more cases (#777) This closes #777.
83. [mysql] Improve newly added tables process
84. [mysql] Support capture newly added tables for existed pipeline
85. [docs] Fix typo in mongodb-cdc.md (#836)
86. [mysql] add test to cover the datatype GeomCollection that's synonymous with GeometryCollection for mysql8 (#822)
87. [sqlserver] Add SqlServer cdc connector (#662)
88. [build] Remove redundant maven enforce plugin (#794)
89. [hotfix] Fix MySqlSource comment typo (#793)
90. [mysql] Support MySQL 5.6 (#396)
91. [build] Switch to Log4j 2 by default (#791)
92. [oracle] Fix Oracle numeric types conversion (#560)
93. [hotfix][mysql] Fix message timestamp of snapshot record to 0L (#752)
94. [docs] Translate the Chinese FAQ document to English (#737)
95. [docs] Remove the fixed version of website (#730)
96. [hotfix][mysql] Set minimum connection pool size to 1 (#692)
97. [build] Bump log4j2 version to 2.16.0 (#714)
98. [build] Remove override definition of maven-surefire-plugin in connectors pom (#673)
99. [docs] Add FAQ for tableList option usage in DataStream API (#634)
100. [mongodb] Support to connect MongoDB without authentication (#642)
101. [hotfix] Fix the parameter typo in java doc (#651)
102. [mysql] Add a method to get MySqlSourceConfigFactory from MySqlSource (#648)
103. [mysql] Set default driver class name for PooledDataSource (#659)
104. [mysql] Fix there is duplicate records outputted when keep updating table during snapshot read (#592)
105. [docs] Improve column name note in oracle cdc document. (#625)
106. [docs] Add Flink cdc eco-system picture (#623)
107. [hotfix][docs] Fix typo in oracle-cdc.md (#613)
108. [docs] Add supported Flink versions for Flink CDC 2.1(#611)
109. [build] Bump version to 2.2-SNAPSHOT

Download

• flink-sql-connector-mongodb-cdc-2.2.0.jar
• flink-sql-connector-mysql-cdc-2.2.0.jar
• flink-sql-connector-oceanbase-cdc-2.2.0.jar
• flink-sql-connector-oracle-cdc-2.2.0.jar
• flink-sql-connector-postgres-cdc-2.2.0.jar
• flink-sql-connector-sqlserver-cdc-2.2.0.jar
• flink-sql-connector-tidb-cdc-2.2.0.jar

Contributor List (sorted alphabetically)

1. Dian Qi
2. He Wang
3. Jark Wu
4. Jiabao Sun
5. Jingsong Lee
6. Junwang Zhao
7. Konstantin Knauf
8. Leonard Xu
9. Mustang Kong
10. Paul Zhang
11. Qingsheng Ren
12. Sergey Nuyanzin
13. Shengkai
14. Tuple
15. Xianxun Ye
16. Xuebing Li
17. Zongwen Li
18. camelusluo
19. eastfisher
20. ehui
21. fangpc
22. gongzhongqiang
23. hele.kc
24. hiscat
25. luoyuxia
26. paul8263
27. skylines
28. szgeqin
29. taox
30. tsreaper
31. wangxiaojing
32. wysstartgo
33. yexianxun
34. 元组