Skip to content

2.3.4 Release
Compare
Choose a tag to compare
@EricJoy2048 EricJoy2048 released this 20 Feb 03:01
· 625 commits to dev since this release
2.3.4
b96bf8a

2.3.4 Release Note

Bug Fix

Core

  • [Core] [API] Fixed generic class loss for lists (#4421)
  • [Starter] Fix the problem of "," being divided in [] (#5401)
  • [Core] [API] Fix ReadonlyConfig lose key error (#5565)
  • [Core] [API] Fix get bytes from LinkHashMap (#5622)
  • [Core] [API] Fix log error when multi-table sink close (#5683)
  • [Core] [API] Fix MultiTableSink return committer but sink do not support (#5710)
  • [Core] [API] Fix the error msg when parse schema with unsupported type (#5790)
  • [Core] [API] Fix flaky test OptionUtilTest.test (#5894)
  • [Core] [API] Fix SaveModeHandler not be closed (#5843)
  • [Core] [API] Fix MultiTableSinkWriter thread index always 1 (#5832)
  • [Core] [API] Fix SeaTunnelRow::getBytesSize not support map interface (#5990)
  • [Core] [Common] Fix FileUtils::createNewFile not create new file (#5943)
  • [Core] [API] Fix Debezium format cannot parse date/time/timestamp (#5887)
  • [Starter] When inside double quotes,',' are treated as normal characters instead of delimiters (#6042
  • [Core] [Common] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED (#5978)
  • [Core] [API] Fix Object.class option value can not return normal value (#6247)

Transformer-V2

  • [All] Fix PrimaryKey in transform (#5704)
  • [All] Fix cast to timestamp, date, time bug (#5812)

Formats

  • [Text] Allow the entry in the map to be null and allow the key in the entry to be null (#5277)

Connector-V2

  • [Connector-V2] [Clickhouse] Fix clickhouse old version compatibility (#5326)
  • [Connector-V2] [Clickhouse] Fix http header cover (#5446)
  • [Connector-V2] [StarRocks] Fix starrocks template sql parser (#5332)
  • [Connector-V2] [Hive] Fix the bug that hive-site.xml can not be injected in HiveConf (#5261)
  • [Connector-V2] [Clickhouse] Fix clickhouse sink flush bug (#5448)
  • [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)
  • [Connector-V2] [Hive] Fix An error occurred reading an empty directory (#5427)" (#5487)
  • [Connector-V2] [Oss jindo] Fix the problem of jindo driver download failure. (#5511)
  • [Connector-V2] [Oss jindo] Remove useless code (#5540)
  • [Connector-V2] [File] Fix WriteStrategy parallel writing thread unsafe issue (#5546)
  • [Connector-V2] [CDC] Fix the cdc bug about NPE when the original table deletes a field (#5579)
  • [Connector-V2] [Jdbc] oracle catalog create table repeat and oracle pg null point (#5517)
  • [Connector-V2] [CDC] Fix thread-unsafe collection container in cdc enumerator (#5614)
  • [Connector-V2] [Mongodb] Fixed unsupported exception caused by bsonNull (#5659)
  • [Connector-V2] [File] Fix file sink isPartitionFieldWriteInFile occurred exception when no columns are given (#5508)
  • [Connector-V2] [Doris] Fix RestService report NullPointerException (#5319)
  • [Connector-V2] [MaxCompute] Fix MaxCompute use not exist SCHEMA option (#5708)
  • [Connector-V2] [Doris] Using try-with-resources to simplify the code. (#4995)
  • [Connector-V2] [Clickhouse] Fixed an out-of-order BUG with output data fields of clickhouse-sink (#5346)
  • [Connector-V2] [Jdbc] support postgresql xml type (#5724)
  • [Connector-V2] [Jdbc] Nullable Column source have null data could be unexpected results. (#5560)
  • [Connector-V2] [Iceberg] Iceberg source lost data with parallelism option (#5732)
  • [Connector-V2] [Jdbc] Fix PG will not create index when using auto create table #5721
  • [Connector-V2] [Jdbc] Fix database identifier (#5756)
  • [Connector-V2] [CDC] Fix MultiTableSink restore failed when add new table (#5746)
  • [Connector-V2] [Postgres CDC] Fix Postgres create table test case failed (#5778)
  • [Connector-V2] [CDC] Clean unused code (#5785)
  • [Connector-V2] [CDC] Fix state recovery error when switching a single table to multiple tables (#5784)
  • [Connector-V2] [ElasticSearch] Fixed conversion exception of elasticsearch array format (#5825)
  • [Connector-V2] [Jdbc] Fix read from Oracle Date type value lose time (#5814)
  • [Connector-V2] [Pulsar] Fix: update IDENTIFIER = Pulsar for pulsar-datasource on project:seatunnel-web (#5852)
  • [Connector-V2] [Jdbc] Fix Hive-Jdbc use krb5 overwrite kerberosKeytabPath (#5891)
  • [Connector-V2] [InfluxDB] Resolve invalid SQL in initColumnsIndex method caused by direct QUERY_LIMIT appendage with 'tz' function. (#4829)
  • [Connector-V2] [Jdbc] Fix cdc updates were not filtering same primary key (#5923)
  • [Connector-V2] [File] Parquet reader parsing array type exception. (#4457)
  • [Connector-V2] [Http] Fix bug http config no schema option and improve e2e test add case (#5939)
  • [Connector-V2] [Doris] Fix DorisCatalog not implement name method (#5988)
  • [Connector-V2] [TDengine] Fix the degree of multiple parallelism affects driver loading (#6020)
  • [Connector-V2] [Jdbc] Fix jdbc setFetchSize error (#6005)
  • [Connector-V2] [CDC] Fix CDC job cannot consume incremental data After restore run (#625) (#6094)
  • [Connector-V2] [File] Fix the Issue of Abnormal Data Reading from Excel Files (#5932)
  • [Connector-V2] [CDC] Fix NPE caused by adding a table for restore job (#6145)
  • [Connector-V2] [Jdbc] Fix dameng catalog query table sql (#6141)
  • [Connector-V2] [Jdbc] update pgsql catalog for save mode (#6080)
  • [Connector-V2] [Jdbc] Fix Spliter Error in Case of Extensive Duplicate Data (#6026)
  • [Connector-V2] [CDC] Fix added columns cannot be parsed after job restore (#6118)
  • [Connector-V2] [CDC] Fix negative values in CDCRecordEmitDelay metric (#6259)
  • [Connector-V2] [Oracle CDC] Fix invalid split key when no primary key (#6251)

Zeta(ST-Engine)

  • [Zeta] Fix NotifyTaskRestoreOperation npe (#5362)
  • [Zeta] Fix Zeta will close task twice error (#5422)
  • [Zeta] Disable CheckpointTimeOutTest (#5438)
  • [Zeta] Fix CDC task restore throw NPE (#5507)
  • [Zeta] Multiple sink actions of the same type have the same name (#5499)
  • [Zeta] Checkpoint exception status messages exclude state data (#5547)
  • [Zeta] Fix memory leak issues related to checkpoints (#5539)
  • [Zeta] Fix the checkpoint be blocked with long time (#5695)
  • [Zeta] Fix the problem of unstable job status (#5450)
  • [Zeta] Fix submit job api (#5702)
  • [Zeta] Set default DeployMode to DeployMode.CLIENT (#5783)
  • [Zeta] rest api submit a job with chinese name return Garbled code name (#5870)
  • [Zeta] Fix CheckpointCoordinator report NPE when ack not existed pending checkpoint (#5909)
  • [Zeta] Fix submit job has the same job name error. (#6041)
  • [Zeta] Fixed the problem that the return list is empty due to no status parameters (#6040)
  • [Zeta] Fix zeta scheduler bug (#6050)
  • [Zeta] Fix job can not restore when last checkpoint failed (#6193)
  • [Zeta] [Rest-API] Submit or stop job from an inactive master node (#6217)

E2E

  • [E2E] [Common] Update test container version of seatunnel engine (#5323)
  • [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite (#5586)
  • [E2E] [ClickHouse] Enhance ClickHouse E2E testing to trigger multiple checkpoints (#5476)
  • [E2E] Fix not remove docker image after test finish on jdbc suite (#5586)
  • [E2E] Fix ConnectorPackageServiceContainer miss implement getSavePointCommand/getRestoreCommand (#5780)
  • [E2E] Fix build failed cause by JdbcHiveIT and SparkSinkTest (#5798)
  • [E2E] Fix submit job case error (#6059)
  • [E2E] Fixed action related err (#6264)
  • [E2E] Lock mysql container version to 8.0 (#6263)

CI

  • [CI] Fix jindo oss connector name (#5385)
  • [Build] Fix error msg when fork repository not up to date. (#5497)
  • [CI] Fix file change not be check when CI run in fork repository (#5515)
  • [CI] remove jindo dependencies (#5528)
  • [CI] Fix phoenix ci error (#5530)
  • [Build] Update build version to 2.3.4-SNAPSHOT (#5619)
  • [Build] Ensure install-plugin.sh compatibility with sh on Debian #5630 (#5631)
  • [CI] [Chore] Remove useless sonar check script (#5665
  • [Chore] Remove DISCLAIMER file (#5673)
  • [CI] Fix CI unstable problem (#5896)
  • [Build] Fix empty line in config/plugin_config causes BUILD FAILURE (#5921)
  • [CI] Fix CI not run Kudu/AmazonSQS IT when not change api (#5955)
  • [CI] Split doris e2e into separate modules (#5999)
  • [CI] Fix Dead Links checker failure (#6016)
  • [CI] Fix e2e error (#6018)
  • [Build] Updated pom.xml (#6113)
  • [Build] Solve the problem of example running failure (#6173)
  • [Build] Fix build error (#6196)
  • [CI] Fix engine client not close  (#6241)

Examples

  • [Examples] modify the transform URL link (#5298)

Improve

  • [Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260)
  • [Improve][CheckStyle] Adjust the phase of spotless plugin for release plugin. (#5607)

Core

  • [Core] [API] Remove CatalogTable field in CatalogTableUtil (#5521)
  • [Core] [API] Move get schema logic from Config to ReadonlyConfig (#5534)
  • [Starter] Throw IllegalArgumentException when find multiple connector jar for one pluginIdentifier (#5551)
  • [Core] [API] Refactor CatalogTable and add SeaTunnelSource::getProducedCatalogTables (#5562)
  • [Core] [API] Support config column/primaryKey/constraintKey in schema (#5564)
  • [Core] [API] Remove useless ReadonlyConfig flatten feature (#5612)
  • [Core] [Flink & Spark] Refactor Spark/Flink execution processor (#5595)
  • [Core] [API] Mark SeaTunnelPluginLifeCycle as deprecated (#5625
  • [Core] [API] Support config tableIdentifier for schema (#5628)
  • [Core] [Pom] Add junit4 to the root pom (#5611)
  • [Core] [API] Remove catalog tag for config file (#5645)
  • [Core] [API] Remove useless transform code come from setTypeInfo (#5647)
  • [Core] [API] Make sure CatalogTable options and partitionKeys are mutable (#5681)
  • [Core] [API] Add default implement for SeaTunnelSource::getProducedType (#5670)
  • [Core] [API] Add default implement for SeaTunnelSink::setTypeInfo (#5682)
  • [Core] [API] Add warning for use fall back keys (#5753)
  • [Core] [API] Adjust the sleep mode of flink and spark engine to be consistent with zeta (#5698)
  • [Core] [API] Remove Factory option to avoid useless info (#5754)
  • [Core] [API] Add field name to DataTypeConvertor to improve error message (#5782)
  • [Core] [API] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755)
  • [Core] [Common] Remove assert key word. (#5915)
  • [Core] [Common] Clean flow control code (#5991)
  • [Core] [Common] Adapt FILE_OPERATION_FAILED to CommonError (#5928)
  • [Core] [API] Add serialVersionUID to Column
  • [Core] [Common] Extend SupportResourceShare to spark/flink (#5847)
  • [Core] [API] Remove checkpoint timeout check if checkpoint disabled (#6231)

Formats

  • [Json]Use a static object mapper instead of creating it every time (#5460)
  • [Json] Remove assert key word. (#5919)
  • [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5948)
  • [Formats] Refactor exception catch for ignoreParseErrors. (#6065)
  • [Formats] Using number format for Decimal type in seatunnel-format-compatible-debezium-json (#5803)
  • [Text] add dateTimeFormatter to parse ISO8601 (#5974)
  • [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED (#5948)

Connector-V2

  • [Connector-V2] [IoTDB] Remove scheduler in IoTDB sink (#5270)
  • [Connector-V2] [InfluxDB] Remove scheduler in InfluxDB sink (#5271)
  • [Connector-V2] [Dynamodb] Remove scheduler in Dynamodb sink (#5248)
  • [Connector-V2] [StarRocks] Remove scheduler in StarRocks sink (#5269)
  • [Connector-V2] [CDC] avoid listing tables under unnecessary databases (#5365)
  • [Connector-V2] [Jdbc] Refactor AbstractJdbcCatalog (#5096)
  • [Connector-V2] [CDC] Support flink running cdc job (#4918)
  • [Connector-V2] [Assert] support 'DECIMAL' type and Fix 'Number' type precision issue (#5479)
  • [Connector-v2] [Redis] Redis support select db (#5570)
  • [Connector-v2] [CDC] Use Source to output the CatalogTable (#5626)
  • [Connector-v2] [SqlServer CDC] add dataType datetimeoffset (#5548)
  • [Connector-v2] [Jdbc] Support read multiple tables (#5581)
  • [Connector-v2] [SqlServer CDC] Unified sqlserver TypeUtils type conversion mode (#5668)
  • [Connector-v2] [Http] improve http e2e test (#5655)
  • [Connector-v2] [AmazonDynamicDB] add amazondynamicdb source split (#5275)
  • [Connector-v2] [File] parquet use system timezone (#5605)
  • [Connector-v2] [Amazonsqs] Change amazonsqs to AmazonSqs as connector identifier (#5742)
  • [Connector-v2] [File] unifiy option between file source/sink and update document (#5680)
  • [Connector-v2] [AmazonDynamicDB] Code clean for AmazonDynamoDB connector (#5791)
  • [Connector-v2] [MongoDB] Implement TableSourceFactory to create mongodb source
  • [Connector-v2] [Jdbc] Optimize catalog-table metadata merge logic (#5828)
  • [Connector-v2] [Jdbc] Rename getCountSql to getExistDataSql (#5838)
  • [Connector-v2] [ClickHouse] Speed up ClickhouseFile Local generate a mmap object (#5822)
  • [Connector-v2] [Jdbc] Improve Jdbc connector error message when datatype unsupported (#5864)
  • [Connector-v2] [Jdbc] Reduce the time cost of getCatalogTable in jdbc (#5908)
  • [Connector-v2] [StarRocks] Support create varchar field type in StarRocks (#5911)
  • [Connector-v2] [StarRocks] add http socket timeout. (#5918)
  • [Connector-v2] [File] Clean memory buffer of JsonWriteStrategy & ExcelWriteStrategy (#5925)
  • [Connector-v2] [StarRocks] StarRocks support create table template with unique key (#5905)
  • [Connector-v2] [CDC] Disable memory buffering when exactly_once is turned off (#6017)
  • [Connector-v2] [Doris] Add batch flush in doris sink (#6024
  • [Connector-v2] [Paimon] Adaptation Paimon 0.6 Version (#6061)
  • [Connector-v2] [File] Make Oss implement source factory and sink factory (#6062)
  • [Connector-v2] [File] Disable HDFSFileSystem cache (#6039)
  • [Connector-v2] [Jdbc] Shade hikari in jdbc connector (#6116)
  • [Connector-v2] [Jdbc] Supports Sqlserver Niche Data Types (#6122)
  • [Connector-v2] [Kafka] Remove useless code for kafka connector (#6157)
  • [Connector-v2] [Doris] Improve doris sink to random use be (#6132)
  • [Connector-v2] [Http] Increase custom configuration timeout. (#6223)
  • [Connector-v2] [Pulsar] Improve pulsar throughput performance. (#6234)
  • [Connector-v2] [SqlServer CDC] Support int identity type in sql server (#6186)
  • [Connector-v2] [Doris] Doris stream load use FE instead of BE (#6235)
  • [Connector-v2] [Postgres CDC] Fix name typos (#6248)
  • [Connector-v2] [Tdengine] support read bool column from tdengine (#6025)
  • [Connector-v2] [Jdbc] Use PreparedStatement to sample data from column (#6242)

CI

  • [CI] update sql-udf document (#5197)
  • [CI][E2E][Zeta] Increase Zeta checkpoint timeout to avoid connector-file-sftp-e2e failed frequently (#5339)
  • [CI] Fix phoenix ci error
  • [Build] Put seatunnel-hadoop3-3.1.4-uber.jar into release binary package (#5743)
  • [Test] Make sure the value in spark not be reused. (#5767)
  • [Test] Move MaxCompute test case file (#5786)
  • [CI] Always run all module unit test (#5800)
  • [Test] Change System.out.println to log output. (#5912)
  • [Test] Add some test case for command useage
  • [Test] Fix sql server catalog test case failed (#6128)
  • [Test] Fix JobMetricsTest unstable (#6152)
  • [Test] Fix ConnectorSpecificationCheckTest not work (#5820

E2E

  • [E2E] Remove unnecessary code to reduce disk pressure (#5613)
  • [E2E] Enable IT case for Oceanbase Mysql mode (#5697)
  • [E2E] load driver class from url on demand (#5712)
  • [E2E] Jdbc test checking data consistency. (#5734)
  • [E2E] Enable e2e log output and disable console sink log (#5879)
  • [E2E] Improve e2e log for all engines (#5936)
  • [E2E] Enhanced stability of Kudu E2E (#6258)

Zeta(ST-Engine)

  • [Zeta] Optimize Test Cases CheckpointTimeOutTest.testJobLevelCheckpointTimeOut (#5403)
  • [Zeta] Improve dependency packages (#5624)
  • [Zeta] Change hard code config key to reference (#5618)
  • [Zeta] Change class name for RestJobExecutionEnvironment implement (#5671)
  • [Zeta] Change default Zeta client JVM heap value (#5674)
  • [Zeta] Move generate_client_protocol.sh to engine module (#5667)
  • [Zeta] Optimize SeaTunnel Zeta engine Jar package upload logic (#5542)
  • [Zeta] Move RestJobExecutionEnvironment to rest package (#5764)
  • [Zeta] Remove result_table_name from action name(checkpoint state key) (#5779)
  • [Zeta] Refactor jar package service module (#5763)
  • [Zeta] Expose client cluster-connect-timeout-millis to yaml (#5868)
  • [Zeta] Reduce checkpoint completed log (#5916)
  • [Zeta] Remove assert key words (#5947)
  • [Zeta] Adjusting the log level for factory validation implementation. (#6153)
  • [Zeta] Ignore useless wrong target slot error (#6135)
  • [Zeta] Add restore when commit failed (#6101)

Transformer-V2

  • [All] Code clean for SeaTunnel transform (#5810)
  • [All] Add common error for transform (#5815)

Feature

Core

  • [Core] [API] Add job-level configuration for checkpoint timeout. (#5222)
  • [Core] [API] Catalog add Case Conversion Definition (#5328)
  • [Core] [API] Add InMemoryCatalog for test and add new getCatalogTableFromConfig method (#5485)
  • [Core] [Flink] Support Decimal Type with configurable precision and scale (#5419)
  • [Core] [API] Add init and restoreCommit method in SinkAggregatedCommitter (#5598)
  • [Core] [Flink] Support flow control in Flink (#5509)
  • [Core] [Spark] Support SeaTunnel Time Type. (#5188)
  • [Core] [Flink] Remove useless stageType. (#5650)
  • [Core] [API] Support multi-table sink (#5620)
  • [Core] [Spark] Support flow control in Spark (#5510)
  • [Core] [Flink] Add external configuration parameters (#5480)
  • [Core] [API] Remove all useless prepare, getProducedType method (#5741)
  • [Core] [Common] Introduce new error define rule (#5793)
  • [Core] [Common] Remove useless DeserializationFormatFactory and its implement (#5880)
  • [Core] [API] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter
  • [Core] [Flink] Upgrade flink source translation (#5100)
  • [Core] [API] Add unsupported datatype check for all catalog (#5890)
  • [Core] [Flink] Support record metrics in flink engine (#6035)

Connector-V2

  • [Connector-V2] [SqlServer CDC] Support multi-table read (#4377)
  • [Connector-V2] [Jdbc] Jdbc database support identifier (#5089)
  • [Connector-V2] [Jdbc] jdbc connector supports Kingbase database (#4803)
  • [Connector-V2] [Jdbc] Add tidb datatype convertor (#5440)
  • [Connector-V2] [Jdbc] Add Dameng catalog (#5451)
  • [Connector-V2] [File] Supports writing column names when the output type is file (CSV) (#5459)
  • [Connector-V2] [File] FILE_FORMAT_TYPE is text/csv ,add parameter BaseSinkConfig.ENABLE_HEADER_WRITE: #5566 (#5567)
  • [Connector-V2] [CDC] Support for preferring numeric fields as split keys (#5384)
  • [Connector-V2] [File] Support read empty directory (#5591)
  • [Connector-V2] [Fake&Assert] Add table-names from FakeSource/Assert to produce/assert multi-table (#5604)
  • [Connector-V2] [Jdbc] Add OceanBase catalog (#5439)
  • [Connector-V2] [File] Support LZO compress on File Read (#5083)
  • [Connector-V2] [MongoDB CDC] Support MongoDB CDC running on flink (#5644)
  • [Connector-V2] [Jdbc] Supporting more ways to configure connection parameters. (#5388)
  • [Connector-V2] [Kafka] KafkaSource use Factory to create source (#5635)
  • [Connector-V2] [Jdbc] Add connector amazonsqs (#5367)
  • [Connector-V2] [Jdbc] Support catalog in MaxCompute Source (#5283)
  • [Connector-V2] [Kudu] Refactor Kudu functionality and Sink support CDC data. (#5437)
  • [Connector-V2] [Mysql CDC] Optimize the default value range of mysql server-id to reduce conflicts. (#5550)
  • [Connector-V2] [Http] HTTP supports page increase #5477 (#5561)
  • [Connector-V2] [Jdbc] Add Save Mode function and Connector-JDBC (MySQL) connector has been realized (#5663)
  • [Connector-V2] [Jdbc] Support XMLTYPE data integration #5716 (#5723)
  • [Connector-V2] [Jdbc] Support Hive JDBC Source Connector (#5424)
  • [Connector-V2] [Http] Http paramter support custom encryption (#5727)
  • [Connector-V2] [Kudu] Support TableSourceFactory/TableSinkFactory on kudu (#5789)
  • [Connector-V2] [File] LocalFileSource support multiple table
  • [Connector-V2] [Fake] FakeSource support generate different CatalogTable for MultipleTable (#5766)
  • [Connector-V2] [Kudu] Support multi-table source read (#5878
  • [Connector-V2] [Http] Support TableSourceFactory/TableSinkFactory on http (#5816)
  • [Connector-V2] [Redis] Support TableSourceFactory/TableSinkFactory on redis (#5901)
  • [Connector-V2] [Jdbc] Fix split key not support BigInteger type
  • [Connector-V2] [File] LocalFile sink support multiple table (#5931)
  • [Connector-V2] [Doris] Doris Catalog (#5175)
  • [Connector-V2] [Kudu] Support multi-table sink feature for kudu (#5951)
  • [Connector-V2] [File] Support using multiple hadoop account (#5903)
  • [Connector-V2] [File] Put Multiple Table File API to File Base Module (#6033)
  • [Connector-V2] [Paimon] Flink table store failed to prepare commit (#6057)
  • [Connector-V2] [File] Add multiple table file sink to base (#6049)
  • [Connector-V2] [Jdbc] add JDBC source support string type as partition key (#6079)
  • [Connector-V2] [File] Support read .xls excel file (#6066)
  • [Connector-V2] [CDC] Support read no primary key table (#6098)
  • [Connector-V2] [Assert] Support check the precision and scale of Decimal type. (#6110)
  • [Connector-V2] [Hbase] support array data. (#6100)
  • [Connector-V2] [File] FTP source/sink add ftp connection mode (#6077) (#6099)
  • [Connector-V2] [Jdbc] update sqlserver catalog for save mode (#6086)
  • [Connector-V2] [CDC] Support custom table primary key (#6106)
  • [Connector-V2] [Doris] Support SaveMode on Doris (#6085)
  • [Connector-V2] [Jdbc] update oracle catalog for save mode (#6092)
  • [Connector-V2] [ElasticSearch] add elasticsearch save_mode (#6046) (#6092)
  • [Connector-V2] [Jdbc] Improve get column sql compatibility (#5664)
  • [Connector-V2] [Jdbc] Improve get column sql compatibility (#5664)
  • [Connector-V2] [Pulsar] Add Pulsar Sink Connector. (#4382)
  • [Connector-V2] [StarRocks] add starrocks save_mode (#6029)
  • [Connector-V2] [Oracle CDC] Support for oracle cdc (#5196)
  • [Connector-V2] [Doris] Add Doris ConnectorV2 Source (#6161)
  • [Connector-V2] [Jdbc] Support uuid in postgres jdbc (#6185)
  • [Connector-V2] [Oracle CDC] Support read no primary key table (#6209)
  • [Connector-V2] [Oracle CDC] Fix jdbc setFetchSize error (#6210)
  • [Connector-V2] [Oracle CDC] Fix state recovery error when switching a single table to multiple tables (#6211)
  • [Connector-V2] [Oracle CDC] Clean unused code (#6212)
  • [Connector-V2] [File] add s3file save mode function (#6131)
  • [Connector-V2] [Oracle CDC] Support custom table primary key (#6216)
  • [Connector-V2] [CDC] Add date type and float type column split support (#6160)
  • [Connector-V2] [Postgres CDC] Support for Postgres cdc (#5986)
  • [Connector-V2] [Postgres CDC] Update jdbc fetchsize (#6245)
  • [Connector-V2] [CDC] Disable exactly_once by default to improve stability (#6244)
  • [Connector-V2] [CDC] Support Short and Byte Type in spliter (#6027)
  • [Connector-V2] [Jdbc] Improve query Approximate Total Row Count of a Table (#5972)

Zeta(ST-Engine)

  • [Zeta] Add the UNKNOWABLE job status. (#5303)
  • [Zeta] Support flow control in zeta (#5502)
  • [Zeta] [REST-API] Stop a running job. (#5512)
  • [Zeta] Support Zeta engine on Kubernetes (#5594)
  • [Zeta] In batch mode, checkpoint can be disabled (#5914)
  • [Zeta] Change skip trigger checkpoint log level to debug (#5954)
  • [Zeta] add new job status DOING_SAVEPOINT and SAVEPOINT_DONE (#5917)
  • [Zeta] Add waitForJobCompleteV2 api (#5965)
  • [Zeta] Can submit job with rest api to Zeta master node automaticly (#5950)
  • [Zeta] [REST-API] get finished jobs info (#5949)
  • [Zeta] Fix transform action return same name (#6034)
  • [Zeta] Unify job env parameters (#6003)
  • [Zeta] Add TaskGroupLocation to the thread name of the TaskExecutionService (#6095)
  • [Zeta] Using G1 as defaut garbage colletor in zeta (#6114)
  • [Zeta] Fix start with savepoint with no checkpoint file error (#6215)
  • [Zeta] Support hocon style declare row type in generic type (#6187)

CI

  • [Bin] Add .bat script for all shell script. (#5445)
  • [INFRA] Move CI to running on fork repository container (#5495)
  • [Build] Remove connector/seatunnel directory (#5489)
  • [INFRA] Update PR template to add test and user change question (#5486)
  • [INFRA] Add log for notify_test_workflow.yml to trace error reason
  • [INFRA] Fix notify_test_workflow.yml not stable
  • [Test]Remove docker image after test finish on jdbc suite (#5568)
  • [Test] Add test for ResourceManager to keep task will be deployed in different node (#5518)
  • [Chore] Remove useless .scalafmt.conf file (#5616)
  • [LICENSE] Add hadoop license (#6067)
  • [Build] Add seatunnel-spark-3-starter.jar into release package (#6044)
  • [Test] Reduce repeated catalog test times (#6207)
  • [CI] Make sure notify_test_workflow.yml error will be throwed (#6226)

Formats

  • [Ogg] Support read ogg format message #4201 (#4225)
  • [Json] Remove assert key word. (#5919)
  • [Avro] support avro format (#5084)
  • [Formats] Refactor exception catch for ignoreParseErrors. (#6065)
  • [Avro] improve avro format convert (#6082)

Transformer-V2

  • [All] add JsonPath transform (#5632)
  • [All] Support SqlTransform Not Like Expression (#5768)
  • [All] add from_unixtime function (#5462)
  • [All] Support case when Expression (#6123)

Docs

  • [Docs] Refactor connector-v2 docs using unified format Feishu (#5343)
  • [Docs] Refactor IoTDB sink docs (#5306)
  • [Docs] Correct word errors (#5360)
  • [Docs] Improved iceberg documentation (#5335)
  • [Docs] Use short url https://s.apache.org/seatunnel-slack to replace long URL (#5363)
  • [Docs] improve http doc param body des (#5368)
  • [Docs] Refactor connector-v2 docs using unified format Slack (#5344)
  • [Docs] update sql-udf document (#5197)
  • [Docs] Refactor MySQL-CDC docs (#5302)
  • [Docs] Replace username by user in the options description of FtpFile (#5421)
  • [Docs] update iotdb document (#5404)
  • [Docs] Added the mysql Connector Document version title Example pr (#5249)
  • [Docs] add Parallel parallelism (#5310)
  • [Docs] Http source option key poll_interval_ms different in source code (#5430)
  • [Docs] Fix error examples of kafka sink (#5527)
  • [Docs] Improve Console Sink document (#5230)
  • [Docs] Add how to change logging configuration of e2e test (#5589)
  • [Docs] Add RocketMq connector (#5361)
  • [Docs] Fix build status in README.md not update (#5574)
  • [Docs] hdfsFile file_format changed to file_format_type (#5653)
  • [Docs] Improved README.md (#5662)
  • [Docs] Add FakeSource connector documentation (#5255)
  • [Docs] Introduce SeaTunnel web project in README.md (#5634)
  • [Docs] Added Table of Contents and FAQs to README (#5693)
  • [Docs] Update quick-start-spark.md (#5795)
  • [Docs] Add Socket connector doc #5255 (#5287)
  • [Docs] Improve file sink doc (#5799)
  • [Docs] Add SqlServer connector documentation (#5498)
  • [Docs] update (#5808)
  • [Docs] Add hive jdbc reference value (#5882)
  • [Docs] Checkpoint-Storage description is incorrect. (#5883)
  • [Docs] Reconstruct the OssFile connector document (#5233)
  • [Docs] Fix oss connector can not run bug (#6010)
  • [Docs] update doc for jdbc-connector (#5765)
  • [Docs] Add V2 connector jdbc document parameter can speed up data import PR (#6176)
  • [Docs] Modify some document title specifications (#6237)
  • [Docs] Reconstruct the Socket Source and SftpFile connector document (#5386)
  • [Docs] Improve doc of driver put path
  • [Docs] Correct the introduction of array element types and map key types (#6261)
Assets 2
Loading