April Recap: Star Contributors and Technological Breakthroughs

Dear SeaTunnel enthusiasts, the community monthly update of April is here! This document will capture the significant updates within the SeaTunnel community each month. Stay tuned!

SeaTunnel Monthly Merge Stars

Thanks to the following contributors who made outstanding contributions to Apache SeaTunnel in April (in no particular order):

@taohaozhi1129,@lightzhao,@xxzuo,@LeonYoah,@sunxiaojian,@haneeshmv,@hailin0,@gitfortian,@xiaochen-zhou,@Hisoka-X,@YalikWang,@EricJoy2048,@baicie,@TyrantLucifer,@liunaijie,@dailai,@nianhua99,@liugddx,@dzygoon,@L-Gryps,@shangeyao,@corgy-w,@ruanwenjun,@CosmosNi,@litiliu

apache/seatunnel

fix

• [fix][doc]fix dead link @liunaijie
• [fix][zeta]fix can’t release resource issue @liunaijie
• [Fix]Fix Oracle type converter handle negative scale in number type @Hisoka-X
• [Bug Fix]Sink Doris error status(#6753) @taohaozhi1129
• [bigfix][S3 File]:Change the [SCHEMA] attribute of the [S3CONF class]to be non-static to avoid being reassigned after deserialization @LeonYoah
• [Hotfix][S3 Connector]update aws-java-sdk-budle version to fix job can not run bug @EricJoy2048
• [Fix][Script]Fix lose jvm option when jvm_options file not end with \n@Hisoka-X
• [fix]fix get seatunnel row size npe issue @liunaijie
• [Fix][Connector-v2]Fix the sql statement error of create table for doris and starrocks @dailai
• [Fix][Doc]Fixed links in some documents @xxzuo
• [Fix][connector-rocketmq]commit a correct offset to broker & reduce ThreadInterruptedException log @YalikWang
• [Fix][Kafka-Sink]fix kafka sink factory option rule @liunaijie
• [Fix][Doc]Fix some spell errors @xiaochen-zhou
• [Fix][Doc]Fix FTP sink config key username to user @Hisoka-X
• [fix][connector-rocketmq]Fix a NPE problem when checkpoint.interval is set too small(#6624) @YalikWang
• [Hotfix]fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils @EricJoy2048
• [Bug] [formats]Fix fail to parse line when content contains the file delimiter @litiliu
• [Fix][Connector-V2]Fix add hive partition error when partition already existed @Hisoka-X
• [Fix][Zeta]Fix the thread stuck problem caused by savepoint checking mechanism @Hisoka-X
• [Bug]Fix OrcWriteStrategy/ParquetWriteStrategy doesn’t login with kerberos @ruanwenjun
• [Bug][Improve][Connector-v2][ElasticsearchSource]Fix behavior when source empty，Support SourceConfig.SOURCE field empty. @CosmosNi
• [Hotfix]Fix DEFAULT TABLE problem @EricJoy2048

improve

• [Improve][Zeta]add document for Minio as checkpoint storage for zeta tasks @gitfortian
• [Improve] [Clickhouse]Remove check when set allow_experimental_lightweight_delete false(#6727) @shangeyao
• [Improve][HiveSink]Fix the risk of resource leakage. @lightzhao
• [Improve][Zeta]Disable hdfs filesystem cache of checkpoint @LeonYoah
• [Doc][Improvement]Add Support Chinese for Config-Encryption-Decryption.md @xxzuo
• [Doc][Improve]Intro the multi-line text feature in document @nianhua99
• [Feature][connector-v2]Enabled iceberg-sink schema change test @sunxiaojian
• [Improve][mysql-cdc/jdbc]Support mysql 5.5 versions @hailin0
• [Improve]Improve read table schema in cdc connector @Hisoka-X
• [Improve][mysql-cdc]Fallback to desc table when show create table failed @hailin0
• [Improve][Hive]udpate hive3 version @EricJoy2048
• [Feature][Connector-V2]Iceberg-sink supports writing data to branches @sunxiaojian
• [Improve][Transform]Remove can’t find field exception @xiaochen-zhou
• [Feature][Zeta]Support config job retry times in job config @Hisoka-X
• [Improve]Improve doris stream load client side error message @Hisoka-X
• [Improve]Improve read with parquet type convert error @Hisoka-X
• [Improve][Zeta]when job finished, the checkpoint won’t write to file @liunaijie
• [Improve][Jdbc]Add quote identifier for sql @hailin0
• [Improve][Zeta]Optimize the logic of RestHttpGetCommandProcessor#getSeaTunnelServer() @xiaochen-zhou
• [Doc][Improve]Support chinese for sinks @corgy-w
• [Doc][Improve]Add Support Kerberos Auth For Kafka Connector #6653 @gitfortian
• [Doc][Improve]Add Support Chinese for seatunnel-engine @xxzuo
• [Improve][Connector-v2]The hive connector support multiple filesystem @dailai
• [Improve][Transform]Remove Fallback during parsing Transform process @xiaochen-zhou
• [Feature][Tool]Add connector check script for issue 6199 @dailai
• [Feature][CDC]Support listening for message delayed events in cdc source @hailin0
• [Improve][Test]Fix test unstable on ResourceManger and EventReportmodule @Hisoka-X
• [Improve][Jdbc]Increase type converter when auto creating tables @hailin0
• [Improve][Connector-V2]Support hadoop ha and kerberos for paimon sink @dailai
• [Improve][CDC]Improve read performance when record not contains schema field @Hisoka-X
• [feature][connector-v2]add xugudb connector @L-Gryps
• [Improve][CDC]Optimize split state memory allocation in increment phase @hailin0
• [Improve][Zeta][storage]update hdfs configuration, support more parameters @liunaijie
• [Doc][Improve]Add Support Chinese for start-v2/locally/quick-start-flink.md and start-v2/locally/quick-start-spark.md @dzygoon
• [Feature][starter]support user define parameter on spark/flink engine @liunaijie
• [Feature]Hive Source/Sink support multiple table @ruanwenjun

others

• [Chore]remove useless interface @TyrantLucifer
• 2.3.5 release @liugddx
• [Release][2.3.5][release-note]Add release-note @liugddx
• [Docs]update debezium json document @liunaijie
• [E2E]Fix AmazondynamodbIT unstable @hailin0
• [Docs]fix kafka format doc @liunaijie
• [E2E]Enable StarRocksCDCSinkIT @liunaijie

apache/seatunnel-website

others

• [Docs]update & support select language @baicie

apache/seatunnel-web

improve

• [feature][datasource]Main add datasource-jdbc-db2 @haneeshmv