2.3.4
版本发布时间: 2024-02-20 11:01:15
apache/seatunnel最新发布版本:2.3.7(2024-08-19 15:40:30)
2.3.4 Release Note
Bug Fix
Core
- [Core] [API] Fixed generic class loss for lists (#4421)
- [Starter] Fix the problem of "," being divided in [] (#5401)
- [Core] [API] Fix ReadonlyConfig lose key error (#5565)
- [Core] [API] Fix get bytes from LinkHashMap (#5622)
- [Core] [API] Fix log error when multi-table sink close (#5683)
- [Core] [API] Fix MultiTableSink return committer but sink do not support (#5710)
- [Core] [API] Fix the error msg when parse schema with unsupported type (#5790)
- [Core] [API] Fix flaky test
OptionUtilTest.test
(#5894) - [Core] [API] Fix SaveModeHandler not be closed (#5843)
- [Core] [API] Fix MultiTableSinkWriter thread index always 1 (#5832)
- [Core] [API] Fix
SeaTunnelRow::getBytesSize
not support map interface (#5990) - [Core] [Common] Fix
FileUtils::createNewFile
not create new file (#5943) - [Core] [API] Fix Debezium format cannot parse date/time/timestamp (#5887)
- [Starter] When inside double quotes,',' are treated as normal characters instead of delimiters (#6042
- [Core] [Common] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED (#5978)
- [Core] [API] Fix
Object.class
option value can not return normal value (#6247)
Transformer-V2
- [All] Fix PrimaryKey in transform (#5704)
- [All] Fix cast to timestamp, date, time bug (#5812)
Formats
- [Text] Allow the entry in the map to be null and allow the key in the entry to be null (#5277)
Connector-V2
- [Connector-V2] [Clickhouse] Fix clickhouse old version compatibility (#5326)
- [Connector-V2] [Clickhouse] Fix http header cover (#5446)
- [Connector-V2] [StarRocks] Fix starrocks template sql parser (#5332)
- [Connector-V2] [Hive] Fix the bug that hive-site.xml can not be injected in HiveConf (#5261)
- [Connector-V2] [Clickhouse] Fix clickhouse sink flush bug (#5448)
- [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)
- [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)" (#5487)
- [Connector-V2] [Oss jindo] Fix the problem of jindo driver download failure. (#5511)
- [Connector-V2] [Oss jindo] Remove useless code (#5540)
- [Connector-V2] [File] Fix WriteStrategy parallel writing thread unsafe issue (#5546)
- [Connector-V2] [CDC] Fix the cdc bug about NPE when the original table deletes a field (#5579)
- [Connector-V2] [Jdbc] oracle catalog create table repeat and oracle pg null point (#5517)
- [Connector-V2] [CDC] Fix thread-unsafe collection container in cdc enumerator (#5614)
- [Connector-V2] [Mongodb] Fixed unsupported exception caused by bsonNull (#5659)
- [Connector-V2] [File] Fix file sink
isPartitionFieldWriteInFile
occurred exception when no columns are given (#5508) - [Connector-V2] [Doris] Fix RestService report NullPointerException (#5319)
- [Connector-V2] [MaxCompute] Fix MaxCompute use not exist SCHEMA option (#5708)
- [Connector-V2] [Doris] Using try-with-resources to simplify the code. (#4995)
- [Connector-V2] [Clickhouse] Fixed an out-of-order BUG with output data fields of clickhouse-sink (#5346)
- [Connector-V2] [Jdbc] support postgresql xml type (#5724)
- [Connector-V2] [Jdbc] Nullable Column source have null data could be unexpected results. (#5560)
- [Connector-V2] [Iceberg] Iceberg source lost data with parallelism option (#5732)
- [Connector-V2] [Jdbc] Fix PG will not create index when using auto create table #5721
- [Connector-V2] [Jdbc] Fix database identifier (#5756)
- [Connector-V2] [CDC] Fix MultiTableSink restore failed when add new table (#5746)
- [Connector-V2] [Postgres CDC] Fix Postgres create table test case failed (#5778)
- [Connector-V2] [CDC] Clean unused code (#5785)
- [Connector-V2] [CDC] Fix state recovery error when switching a single table to multiple tables (#5784)
- [Connector-V2] [ElasticSearch] Fixed conversion exception of elasticsearch array format (#5825)
- [Connector-V2] [Jdbc] Fix read from Oracle Date type value lose time (#5814)
- [Connector-V2] [Pulsar] Fix: update IDENTIFIER = Pulsar for pulsar-datasource on project:seatunnel-web (#5852)
- [Connector-V2] [Jdbc] Fix Hive-Jdbc use krb5 overwrite kerberosKeytabPath (#5891)
- [Connector-V2] [InfluxDB] Resolve invalid SQL in initColumnsIndex method caused by direct QUERY_LIMIT appendage with 'tz' function. (#4829)
- [Connector-V2] [Jdbc] Fix cdc updates were not filtering same primary key (#5923)
- [Connector-V2] [File] Parquet reader parsing array type exception. (#4457)
- [Connector-V2] [Http] Fix bug http config no schema option and improve e2e test add case (#5939)
- [Connector-V2] [Doris] Fix DorisCatalog not implement
name
method (#5988) - [Connector-V2] [TDengine] Fix the degree of multiple parallelism affects driver loading (#6020)
- [Connector-V2] [Jdbc] Fix jdbc setFetchSize error (#6005)
- [Connector-V2] [CDC] Fix CDC job cannot consume incremental data After restore run (#625) (#6094)
- [Connector-V2] [File] Fix the Issue of Abnormal Data Reading from Excel Files (#5932)
- [Connector-V2] [CDC] Fix NPE caused by adding a table for restore job (#6145)
- [Connector-V2] [Jdbc] Fix dameng catalog query table sql (#6141)
- [Connector-V2] [Jdbc] update pgsql catalog for save mode (#6080)
- [Connector-V2] [Jdbc] Fix Spliter Error in Case of Extensive Duplicate Data (#6026)
- [Connector-V2] [CDC] Fix added columns cannot be parsed after job restore (#6118)
- [Connector-V2] [CDC] Fix negative values in CDCRecordEmitDelay metric (#6259)
- [Connector-V2] [Oracle CDC] Fix invalid split key when no primary key (#6251)
Zeta(ST-Engine)
- [Zeta] Fix NotifyTaskRestoreOperation npe (#5362)
- [Zeta] Fix Zeta will close task twice error (#5422)
- [Zeta] Disable CheckpointTimeOutTest (#5438)
- [Zeta] Fix CDC task restore throw NPE (#5507)
- [Zeta] Multiple sink actions of the same type have the same name (#5499)
- [Zeta] Checkpoint exception status messages exclude state data (#5547)
- [Zeta] Fix memory leak issues related to checkpoints (#5539)
- [Zeta] Fix the checkpoint be blocked with long time (#5695)
- [Zeta] Fix the problem of unstable job status (#5450)
- [Zeta] Fix submit job api (#5702)
- [Zeta] Set default DeployMode to DeployMode.CLIENT (#5783)
- [Zeta] rest api submit a job with chinese name return Garbled code name (#5870)
- [Zeta] Fix CheckpointCoordinator report NPE when ack not existed pending checkpoint (#5909)
- [Zeta] Fix submit job has the same job name error. (#6041)
- [Zeta] Fixed the problem that the return list is empty due to no status parameters (#6040)
- [Zeta] Fix zeta scheduler bug (#6050)
- [Zeta] Fix job can not restore when last checkpoint failed (#6193)
- [Zeta] [Rest-API] Submit or stop job from an inactive master node (#6217)
E2E
- [E2E] [Common] Update test container version of seatunnel engine (#5323)
- [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite (#5586)
- [E2E] [ClickHouse] Enhance ClickHouse E2E testing to trigger multiple checkpoints (#5476)
- [E2E] Fix not remove docker image after test finish on jdbc suite (#5586)
- [E2E] Fix
ConnectorPackageServiceContainer
miss implement getSavePointCommand/getRestoreCommand (#5780) - [E2E] Fix build failed cause by
JdbcHiveIT
andSparkSinkTest
(#5798) - [E2E] Fix submit job case error (#6059)
- [E2E] Fixed action related err (#6264)
- [E2E] Lock mysql container version to 8.0 (#6263)
CI
- [CI] Fix jindo oss connector name (#5385)
- [Build] Fix error msg when fork repository not up to date. (#5497)
- [CI] Fix file change not be check when CI run in fork repository (#5515)
- [CI] remove jindo dependencies (#5528)
- [CI] Fix phoenix ci error (#5530)
- [Build] Update build version to 2.3.4-SNAPSHOT (#5619)
- [Build] Ensure install-plugin.sh compatibility with sh on Debian #5630 (#5631)
- [CI] [Chore] Remove useless sonar check script (#5665
- [Chore] Remove DISCLAIMER file (#5673)
- [CI] Fix CI unstable problem (#5896)
- [Build] Fix empty line in config/plugin_config causes BUILD FAILURE (#5921)
- [CI] Fix CI not run Kudu/AmazonSQS IT when not change api (#5955)
- [CI] Split doris e2e into separate modules (#5999)
- [CI] Fix Dead Links checker failure (#6016)
- [CI] Fix e2e error (#6018)
- [Build] Updated pom.xml (#6113)
- [Build] Solve the problem of example running failure (#6173)
- [Build] Fix build error (#6196)
- [CI] Fix engine client not close (#6241)
Examples
- [Examples] modify the transform URL link (#5298)
Improve
- [Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260)
- [Improve][CheckStyle] Adjust the phase of spotless plugin for release plugin. (#5607)
Core
- [Core] [API] Remove CatalogTable field in CatalogTableUtil (#5521)
- [Core] [API] Move get schema logic from Config to ReadonlyConfig (#5534)
- [Starter] Throw IllegalArgumentException when find multiple connector jar for one pluginIdentifier (#5551)
- [Core] [API] Refactor CatalogTable and add
SeaTunnelSource::getProducedCatalogTables
(#5562) - [Core] [API] Support config column/primaryKey/constraintKey in schema (#5564)
- [Core] [API] Remove useless ReadonlyConfig flatten feature (#5612)
- [Core] [Flink & Spark] Refactor Spark/Flink execution processor (#5595)
- [Core] [API] Mark
SeaTunnelPluginLifeCycle
as deprecated (#5625 - [Core] [API] Support config tableIdentifier for schema (#5628)
- [Core] [Pom] Add junit4 to the root pom (#5611)
- [Core] [API] Remove catalog tag for config file (#5645)
- [Core] [API] Remove useless transform code come from
setTypeInfo
(#5647) - [Core] [API] Make sure CatalogTable options and partitionKeys are mutable (#5681)
- [Core] [API] Add default implement for
SeaTunnelSource::getProducedType
(#5670) - [Core] [API] Add default implement for
SeaTunnelSink::setTypeInfo
(#5682) - [Core] [API] Add warning for use fall back keys (#5753)
- [Core] [API] Adjust the sleep mode of flink and spark engine to be consistent with zeta (#5698)
- [Core] [API] Remove
Factory
option to avoid useless info (#5754) - [Core] [API] Add field name to
DataTypeConvertor
to improve error message (#5782) - [Core] [API] Remove use
SeaTunnelSink::getConsumedType
method and mark it as deprecated (#5755) - [Core] [Common] Remove assert key word. (#5915)
- [Core] [Common] Clean flow control code (#5991)
- [Core] [Common] Adapt
FILE_OPERATION_FAILED
toCommonError
(#5928) - [Core] [API] Add
serialVersionUID
to Column - [Core] [Common] Extend
SupportResourceShare
to spark/flink (#5847) - [Core] [API] Remove checkpoint timeout check if checkpoint disabled (#6231)
Formats
- [Json]Use a static object mapper instead of creating it every time (#5460)
- [Json] Remove assert key word. (#5919)
- [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5948)
- [Formats] Refactor exception catch for
ignoreParseErrors
. (#6065) - [Formats] Using number format for Decimal type in
seatunnel-format-compatible-debezium-json
(#5803) - [Text] add dateTimeFormatter to parse ISO8601 (#5974)
- [Formats] Replace
CommonErrorCodeDeprecated.JSON_OPERATION_FAILED
(#5948)
Connector-V2
- [Connector-V2] [IoTDB] Remove scheduler in IoTDB sink (#5270)
- [Connector-V2] [InfluxDB] Remove scheduler in InfluxDB sink (#5271)
- [Connector-V2] [Dynamodb] Remove scheduler in Dynamodb sink (#5248)
- [Connector-V2] [StarRocks] Remove scheduler in StarRocks sink (#5269)
- [Connector-V2] [CDC] avoid listing tables under unnecessary databases (#5365)
- [Connector-V2] [Jdbc] Refactor AbstractJdbcCatalog (#5096)
- [Connector-V2] [CDC] Support flink running cdc job (#4918)
- [Connector-V2] [Assert] support 'DECIMAL' type and Fix 'Number' type precision issue (#5479)
- [Connector-v2] [Redis] Redis support select db (#5570)
- [Connector-v2] [CDC] Use Source to output the CatalogTable (#5626)
- [Connector-v2] [SqlServer CDC] add dataType datetimeoffset (#5548)
- [Connector-v2] [Jdbc] Support read multiple tables (#5581)
- [Connector-v2] [SqlServer CDC] Unified sqlserver TypeUtils type conversion mode (#5668)
- [Connector-v2] [Http] improve http e2e test (#5655)
- [Connector-v2] [AmazonDynamicDB] add amazondynamicdb source split (#5275)
- [Connector-v2] [File] parquet use system timezone (#5605)
- [Connector-v2] [Amazonsqs] Change
amazonsqs
toAmazonSqs
as connector identifier (#5742) - [Connector-v2] [File] unifiy option between file source/sink and update document (#5680)
- [Connector-v2] [AmazonDynamicDB] Code clean for AmazonDynamoDB connector (#5791)
- [Connector-v2] [MongoDB] Implement TableSourceFactory to create mongodb source
- [Connector-v2] [Jdbc] Optimize catalog-table metadata merge logic (#5828)
- [Connector-v2] [Jdbc] Rename
getCountSql
togetExistDataSql
(#5838) - [Connector-v2] [ClickHouse] Speed up ClickhouseFile Local generate a mmap object (#5822)
- [Connector-v2] [Jdbc] Improve Jdbc connector error message when datatype unsupported (#5864)
- [Connector-v2] [Jdbc] Reduce the time cost of getCatalogTable in jdbc (#5908)
- [Connector-v2] [StarRocks] Support create varchar field type in StarRocks (#5911)
- [Connector-v2] [StarRocks] add http socket timeout. (#5918)
- [Connector-v2] [File] Clean memory buffer of
JsonWriteStrategy
&ExcelWriteStrategy
(#5925) - [Connector-v2] [StarRocks] StarRocks support create table template with unique key (#5905)
- [Connector-v2] [CDC] Disable memory buffering when
exactly_once
is turned off (#6017) - [Connector-v2] [Doris] Add batch flush in doris sink (#6024
- [Connector-v2] [Paimon] Adaptation Paimon 0.6 Version (#6061)
- [Connector-v2] [File] Make Oss implement source factory and sink factory (#6062)
- [Connector-v2] [File] Disable HDFSFileSystem cache (#6039)
- [Connector-v2] [Jdbc] Shade hikari in jdbc connector (#6116)
- [Connector-v2] [Jdbc] Supports Sqlserver Niche Data Types (#6122)
- [Connector-v2] [Kafka] Remove useless code for kafka connector (#6157)
- [Connector-v2] [Doris] Improve doris sink to random use be (#6132)
- [Connector-v2] [Http] Increase custom configuration timeout. (#6223)
- [Connector-v2] [Pulsar] Improve pulsar throughput performance. (#6234)
- [Connector-v2] [SqlServer CDC] Support
int identity
type in sql server (#6186) - [Connector-v2] [Doris] Doris stream load use FE instead of BE (#6235)
- [Connector-v2] [Postgres CDC] Fix name typos (#6248)
- [Connector-v2] [Tdengine] support read bool column from tdengine (#6025)
- [Connector-v2] [Jdbc] Use PreparedStatement to sample data from column (#6242)
CI
- [CI] update sql-udf document (#5197)
- [CI][E2E][Zeta] Increase Zeta checkpoint timeout to avoid connector-file-sftp-e2e failed frequently (#5339)
- [CI] Fix phoenix ci error
- [Build] Put
seatunnel-hadoop3-3.1.4-uber.jar
into release binary package (#5743) - [Test] Make sure the value in spark not be reused. (#5767)
- [Test] Move MaxCompute test case file (#5786)
- [CI] Always run all module unit test (#5800)
- [Test] Change System.out.println to log output. (#5912)
- [Test] Add some test case for command useage
- [Test] Fix sql server catalog test case failed (#6128)
- [Test] Fix JobMetricsTest unstable (#6152)
- [Test] Fix ConnectorSpecificationCheckTest not work (#5820
E2E
- [E2E] Remove unnecessary code to reduce disk pressure (#5613)
- [E2E] Enable IT case for Oceanbase Mysql mode (#5697)
- [E2E] load driver class from url on demand (#5712)
- [E2E] Jdbc test checking data consistency. (#5734)
- [E2E] Enable e2e log output and disable console sink log (#5879)
- [E2E] Improve e2e log for all engines (#5936)
- [E2E] Enhanced stability of Kudu E2E (#6258)
Zeta(ST-Engine)
- [Zeta] Optimize Test Cases
CheckpointTimeOutTest.testJobLevelCheckpointTimeOut
(#5403) - [Zeta] Improve dependency packages (#5624)
- [Zeta] Change hard code config key to reference (#5618)
- [Zeta] Change class name for
RestJobExecutionEnvironment
implement (#5671) - [Zeta] Change default Zeta client JVM heap value (#5674)
- [Zeta] Move generate_client_protocol.sh to engine module (#5667)
- [Zeta] Optimize SeaTunnel Zeta engine Jar package upload logic (#5542)
- [Zeta] Move
RestJobExecutionEnvironment
to rest package (#5764) - [Zeta] Remove
result_table_name
from action name(checkpoint state key) (#5779) - [Zeta] Refactor jar package service module (#5763)
- [Zeta] Expose client cluster-connect-timeout-millis to yaml (#5868)
- [Zeta] Reduce checkpoint completed log (#5916)
- [Zeta] Remove assert key words (#5947)
- [Zeta] Adjusting the log level for factory validation implementation. (#6153)
- [Zeta] Ignore useless wrong target slot error (#6135)
- [Zeta] Add restore when commit failed (#6101)
Transformer-V2
- [All] Code clean for SeaTunnel transform (#5810)
- [All] Add common error for transform (#5815)
Feature
Core
- [Core] [API] Add job-level configuration for checkpoint timeout. (#5222)
- [Core] [API] Catalog add Case Conversion Definition (#5328)
- [Core] [API] Add InMemoryCatalog for test and add new getCatalogTableFromConfig method (#5485)
- [Core] [Flink] Support Decimal Type with configurable precision and scale (#5419)
- [Core] [API] Add
init
andrestoreCommit
method inSinkAggregatedCommitter
(#5598) - [Core] [Flink] Support flow control in Flink (#5509)
- [Core] [Spark] Support SeaTunnel Time Type. (#5188)
- [Core] [Flink] Remove useless stageType. (#5650)
- [Core] [API] Support multi-table sink (#5620)
- [Core] [Spark] Support flow control in Spark (#5510)
- [Core] [Flink] Add external configuration parameters (#5480)
- [Core] [API] Remove all useless
prepare
,getProducedType
method (#5741) - [Core] [Common] Introduce new error define rule (#5793)
- [Core] [Common] Remove useless DeserializationFormatFactory and its implement (#5880)
- [Core] [API] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter
- [Core] [Flink] Upgrade flink source translation (#5100)
- [Core] [API] Add unsupported datatype check for all catalog (#5890)
- [Core] [Flink] Support record metrics in flink engine (#6035)
Connector-V2
- [Connector-V2] [SqlServer CDC] Support multi-table read (#4377)
- [Connector-V2] [Jdbc] Jdbc database support identifier (#5089)
- [Connector-V2] [Jdbc] jdbc connector supports Kingbase database (#4803)
- [Connector-V2] [Jdbc] Add tidb datatype convertor (#5440)
- [Connector-V2] [Jdbc] Add Dameng catalog (#5451)
- [Connector-V2] [File] Supports writing column names when the output type is file (CSV) (#5459)
- [Connector-V2] [File] FILE_FORMAT_TYPE is text/csv ,add parameter BaseSinkConfig.ENABLE_HEADER_WRITE: #5566 (#5567)
- [Connector-V2] [CDC] Support for preferring numeric fields as split keys (#5384)
- [Connector-V2] [File] Support read empty directory (#5591)
- [Connector-V2] [Fake&Assert] Add
table-names
from FakeSource/Assert to produce/assert multi-table (#5604) - [Connector-V2] [Jdbc] Add OceanBase catalog (#5439)
- [Connector-V2] [File] Support
LZO
compress on File Read (#5083) - [Connector-V2] [MongoDB CDC] Support MongoDB CDC running on flink (#5644)
- [Connector-V2] [Jdbc] Supporting more ways to configure connection parameters. (#5388)
- [Connector-V2] [Kafka] KafkaSource use Factory to create source (#5635)
- [Connector-V2] [Jdbc] Add connector amazonsqs (#5367)
- [Connector-V2] [Jdbc] Support catalog in MaxCompute Source (#5283)
- [Connector-V2] [Kudu] Refactor Kudu functionality and Sink support CDC data. (#5437)
- [Connector-V2] [Mysql CDC] Optimize the default value range of mysql server-id to reduce conflicts. (#5550)
- [Connector-V2] [Http] HTTP supports page increase #5477 (#5561)
- [Connector-V2] [Jdbc] Add Save Mode function and Connector-JDBC (MySQL) connector has been realized (#5663)
- [Connector-V2] [Jdbc] Support XMLTYPE data integration #5716 (#5723)
- [Connector-V2] [Jdbc] Support Hive JDBC Source Connector (#5424)
- [Connector-V2] [Http] Http paramter support custom encryption (#5727)
- [Connector-V2] [Kudu] Support TableSourceFactory/TableSinkFactory on kudu (#5789)
- [Connector-V2] [File] LocalFileSource support multiple table
- [Connector-V2] [Fake] FakeSource support generate different CatalogTable for MultipleTable (#5766)
- [Connector-V2] [Kudu] Support multi-table source read (#5878
- [Connector-V2] [Http] Support TableSourceFactory/TableSinkFactory on http (#5816)
- [Connector-V2] [Redis] Support TableSourceFactory/TableSinkFactory on redis (#5901)
- [Connector-V2] [Jdbc] Fix split key not support BigInteger type
- [Connector-V2] [File] LocalFile sink support multiple table (#5931)
- [Connector-V2] [Doris] Doris Catalog (#5175)
- [Connector-V2] [Kudu] Support multi-table sink feature for kudu (#5951)
- [Connector-V2] [File] Support using multiple hadoop account (#5903)
- [Connector-V2] [File] Put Multiple Table File API to File Base Module (#6033)
- [Connector-V2] [Paimon] Flink table store failed to prepare commit (#6057)
- [Connector-V2] [File] Add multiple table file sink to base (#6049)
- [Connector-V2] [Jdbc] add JDBC source support string type as partition key (#6079)
- [Connector-V2] [File] Support read .xls excel file (#6066)
- [Connector-V2] [CDC] Support read no primary key table (#6098)
- [Connector-V2] [Assert] Support check the precision and scale of Decimal type. (#6110)
- [Connector-V2] [Hbase] support array data. (#6100)
- [Connector-V2] [File] FTP source/sink add ftp connection mode (#6077) (#6099)
- [Connector-V2] [Jdbc] update sqlserver catalog for save mode (#6086)
- [Connector-V2] [CDC] Support custom table primary key (#6106)
- [Connector-V2] [Doris] Support SaveMode on Doris (#6085)
- [Connector-V2] [Jdbc] update oracle catalog for save mode (#6092)
- [Connector-V2] [ElasticSearch] add elasticsearch save_mode (#6046) (#6092)
- [Connector-V2] [Jdbc] Improve get column sql compatibility (#5664)
- [Connector-V2] [Jdbc] Improve get column sql compatibility (#5664)
- [Connector-V2] [Pulsar] Add Pulsar Sink Connector. (#4382)
- [Connector-V2] [StarRocks] add starrocks save_mode (#6029)
- [Connector-V2] [Oracle CDC] Support for oracle cdc (#5196)
- [Connector-V2] [Doris] Add Doris ConnectorV2 Source (#6161)
- [Connector-V2] [Jdbc] Support
uuid
in postgres jdbc (#6185) - [Connector-V2] [Oracle CDC] Support read no primary key table (#6209)
- [Connector-V2] [Oracle CDC] Fix jdbc setFetchSize error (#6210)
- [Connector-V2] [Oracle CDC] Fix state recovery error when switching a single table to multiple tables (#6211)
- [Connector-V2] [Oracle CDC] Clean unused code (#6212)
- [Connector-V2] [File] add s3file save mode function (#6131)
- [Connector-V2] [Oracle CDC] Support custom table primary key (#6216)
- [Connector-V2] [CDC] Add date type and float type column split support (#6160)
- [Connector-V2] [Postgres CDC] Support for Postgres cdc (#5986)
- [Connector-V2] [Postgres CDC] Update jdbc fetchsize (#6245)
- [Connector-V2] [CDC] Disable exactly_once by default to improve stability (#6244)
- [Connector-V2] [CDC] Support Short and Byte Type in spliter (#6027)
- [Connector-V2] [Jdbc] Improve query Approximate Total Row Count of a Table (#5972)
Zeta(ST-Engine)
- [Zeta] Add the UNKNOWABLE job status. (#5303)
- [Zeta] Support flow control in zeta (#5502)
- [Zeta] [REST-API] Stop a running job. (#5512)
- [Zeta] Support Zeta engine on Kubernetes (#5594)
- [Zeta] In batch mode, checkpoint can be disabled (#5914)
- [Zeta] Change skip trigger checkpoint log level to debug (#5954)
- [Zeta] add new job status
DOING_SAVEPOINT
andSAVEPOINT_DONE
(#5917) - [Zeta] Add waitForJobCompleteV2 api (#5965)
- [Zeta] Can submit job with rest api to Zeta master node automaticly (#5950)
- [Zeta] [REST-API] get finished jobs info (#5949)
- [Zeta] Fix transform action return same name (#6034)
- [Zeta] Unify job env parameters (#6003)
- [Zeta] Add TaskGroupLocation to the thread name of the TaskExecutionService (#6095)
- [Zeta] Using G1 as defaut garbage colletor in zeta (#6114)
- [Zeta] Fix start with savepoint with no checkpoint file error (#6215)
- [Zeta] Support hocon style declare row type in generic type (#6187)
CI
- [Bin] Add .bat script for all shell script. (#5445)
- [INFRA] Move CI to running on fork repository container (#5495)
- [Build] Remove
connector/seatunnel
directory (#5489) - [INFRA] Update PR template to add test and user change question (#5486)
- [INFRA] Add log for notify_test_workflow.yml to trace error reason
- [INFRA] Fix notify_test_workflow.yml not stable
- [Test]Remove docker image after test finish on jdbc suite (#5568)
- [Test] Add test for ResourceManager to keep task will be deployed in different node (#5518)
- [Chore] Remove useless
.scalafmt.conf
file (#5616) - [LICENSE] Add hadoop license (#6067)
- [Build] Add seatunnel-spark-3-starter.jar into release package (#6044)
- [Test] Reduce repeated catalog test times (#6207)
- [CI] Make sure notify_test_workflow.yml error will be throwed (#6226)
Formats
- [Ogg] Support read ogg format message #4201 (#4225)
- [Json] Remove assert key word. (#5919)
- [Avro] support avro format (#5084)
- [Formats] Refactor exception catch for
ignoreParseErrors
. (#6065) - [Avro] improve avro format convert (#6082)
Transformer-V2
- [All] add JsonPath transform (#5632)
- [All] Support SqlTransform Not Like Expression (#5768)
- [All] add from_unixtime function (#5462)
- [All] Support case when Expression (#6123)
Docs
- [Docs] Refactor connector-v2 docs using unified format Feishu (#5343)
- [Docs] Refactor IoTDB sink docs (#5306)
- [Docs] Correct word errors (#5360)
- [Docs] Improved iceberg documentation (#5335)
- [Docs] Use short url https://s.apache.org/seatunnel-slack to replace long URL (#5363)
- [Docs] improve http doc param body des (#5368)
- [Docs] Refactor connector-v2 docs using unified format Slack (#5344)
- [Docs] update sql-udf document (#5197)
- [Docs] Refactor MySQL-CDC docs (#5302)
- [Docs] Replace username by user in the options description of FtpFile (#5421)
- [Docs] update iotdb document (#5404)
- [Docs] Added the mysql Connector Document version title Example pr (#5249)
- [Docs] add Parallel parallelism (#5310)
- [Docs] Http source option key poll_interval_ms different in source code (#5430)
- [Docs] Fix error examples of kafka sink (#5527)
- [Docs] Improve Console Sink document (#5230)
- [Docs] Add how to change logging configuration of e2e test (#5589)
- [Docs] Add RocketMq connector (#5361)
- [Docs] Fix build status in README.md not update (#5574)
- [Docs] hdfsFile file_format changed to file_format_type (#5653)
- [Docs] Improved README.md (#5662)
- [Docs] Add FakeSource connector documentation (#5255)
- [Docs] Introduce SeaTunnel web project in README.md (#5634)
- [Docs] Added Table of Contents and FAQs to README (#5693)
- [Docs] Update quick-start-spark.md (#5795)
- [Docs] Add Socket connector doc #5255 (#5287)
- [Docs] Improve file sink doc (#5799)
- [Docs] Add SqlServer connector documentation (#5498)
- [Docs] update (#5808)
- [Docs] Add hive jdbc reference value (#5882)
- [Docs] Checkpoint-Storage description is incorrect. (#5883)
- [Docs] Reconstruct the OssFile connector document (#5233)
- [Docs] Fix oss connector can not run bug (#6010)
- [Docs] update doc for jdbc-connector (#5765)
- [Docs] Add V2 connector jdbc document parameter can speed up data import PR (#6176)
- [Docs] Modify some document title specifications (#6237)
- [Docs] Reconstruct the Socket Source and SftpFile connector document (#5386)
- [Docs] Improve doc of driver put path
- [Docs] Correct the introduction of array element types and map key types (#6261)