Community Recap of June: Star Contributors and Technological Breakthroughs

Dear SeaTunnel enthusiasts, the Apache SeaTunnel community monthly update for June is here! This document will capture the significant updates within the SeaTunnel community each month. Stay tuned!

SeaTunnel Monthly Merge Stars

Thanks to the following contributors who made outstanding contributions to Apache SeaTunnel in June (in no particular order):

@TaoZex,@wuchunfu,@raboof,@liugddx,@dailai,@litiliu,@somnmos,@15810785091,@hailin0,@EricJoy2048,@liunaijie,@ddna1021,@MRYOG,@rtyuy,@chl-wxp,@loustler,@Hisoka-X,@zhangshenghang,@baicie,@zhilinli123,@4chicat,@CosmosNi,@kim-up

apache/seatunnel

fix

• [Hotfix][MySQL-CDC]Fix read gbk varchar chinese garbled characters @hailin0
• [Fix][Connector-V2]Fix starrocks Content-Length header already present error @Hisoka-X
• [connector-jdbc][bugfix]fix sqlServer create table comment special string bug @chl-wxp
• [connector-jdbc][bugfix]fix pgsql create table comment special string bug @chl-wxp
• [Hotfix][DOC]Fix invalid links @wuchunfu
• [Hotfix][Hive]Fix hive load hive_site_path and hdfs_site_path too late @EricJoy2048
• [connector-jdbc][bugfix]fix oracle create table comment special string bug @chl-wxp
• [Hotfix][CDC]Fix split schema change stream @hailin0
• [fix]revert IMAP cache data field type to compatible with old version @liunaijie
• [connector-jdbc][bugfix]fix mysql create table comment special string bug @chl-wxp
• [Hotfix][Zeta]Fix generate_client_protocol.sh@hailin0
• [Hotfix][Zeta]Fix job crash when schema changing on multiple parallel readers @dailai
• [Hotfix][Zeta]Fix Metrics lost data bug @EricJoy2048
• [bugfix][connector-mongodb]fix mongodb null value write @chl-wxp
• [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix @zhangshenghang
• [Hotfix][Zeta]Fix okhttp connection leak in event reporter @hailin0

improve

• [Improve][Zeta]Fix JobMaster reset app classloader twice @Hisoka-X
• [improve][Doc]Add engine start parameter explanation @MRYOG
• [Improve][Doc]Fix snowflake jdbc url with emoji @Hisoka-X
• [Improve][Engine]Support custom job id for rest-api named submit-job @dailai
• [Feature][Elasticsearch]Support multi-table sink write #7041 @CosmosNi
• [Feature][Zeta]Add tag to node used to filter worker when submit job @liunaijie
• [Feature][Druid]Support multi table for druid sink @TaoZex
• [Improve][Transform-V2]Remove SQL query validation on table name @Hisoka-X
• [Improve][Connector-V2][MongoDB]Support to convert to double from any numeric type @loustler
• [Feature][Jdbc]Support redshift catalog @hailin0
• [improve]delete log for protect user privacy @chl-wxp
• [Improve][File-Connector]Support write fixed/timestamp as int96 of parquet @hailin0
• [Feature][Transforms]Support is_date function of sql @hailin0
• [Feature][Transform-V2 Filter]support exclude columns in the filter transform @litiliu
• [Improve]Make ClickhouseFileSinker support tables containing materialized columns @ddna1021
• [Improve][Paimon]Add check for the base type between source and sink before write. @dailai
• [Improve][Jdbc]Quotes the identifier for table path @hailin0
• [Improve]Add custom job id arg in client @Hisoka-X
• [Improve][Connector-V2]Clean key name in catalog table @Hisoka-X
• [Improve][Zeta]Clean checkpoint file when job FINISHED/CANCELED @Hisoka-X
• [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option @EricJoy2048
• [Improve][Connector-V2]Improve the paimon source @dailai
• [Feature][RestAPI]Add overview api @liugddx
• [Improve][Zeta]Support close idle task for multiple sinks @hailin0
• [Improve][Zeta]Move SaveMode behavior to master @Hisoka-X
• [Feature][Connector-V2]Supports the transfer of any file @Hisoka-X
• [ [Improve][Jdbc]sink sql support custom field.(#6515) @rtyuy
• [Feature][Connector]Add druid sink connector @TaoZex
• [Improve][Connector-V2][Iceberg]Add hadoop s3 catalog e2e testcase @4chicat
• [Feature][doc][Connector-V2][Common]Add Common connector documentation @zhilinli123
• [Feature][Connector-V2]Add Huawei Cloud OBS connector @kim-up

others

• [E2E][HBase]Refactor hbase e2e @TaoZex
• Missing parameter for jdbc sink savemode case #6458 @15810785091
• [Paimon]support projection for paimon source @TaoZex

apache/seatunnel-website

others

• [Teams]Update team list @liugddx
• [Doc]Add seatunnel web doc 1.0.1 @Hisoka-X
• [NOTICE]Update security notice @Hisoka-X
• Remove link to ASF-wide security page from the menu @raboof
• remove seatunnel-web url link from website @baicie
• [Teams]Update team list @liugddx

apache/seatunnel-web

fix

• [Hotfix]Fix arbitrary file readvulnerability on mysql jdbc(starrocks/tidb) @hailin0
• [Hotfix]Fix arbitrary file readvulnerability on mysql cdc @hailin0
• [Hotfix]Fix arbitrary file readvulnerability on mysql jdbc @hailin0
• [Fix]Remove secretKey in application.yml @Hisoka-X

others

• Update doc of jwt.secretKey @Hisoka-X
• fix ts problems with mvn clean package @somnmos

About Apache SeaTunnel

Apache SeaTunnel is an easy-to-use, ultra-high-performance distributed data integration platform that supports real-time synchronization of massive amounts of data and can synchronize hundreds of billions of data per day stably and efficiently.

.

Welcome to fill out this form to be a speaker of Apache SeaTunnel: https://forms.gle/vtpQS6ZuxqXMt6DT6 :)

Why do we need Apache SeaTunnel?

Apache SeaTunnel does everything possible to solve the problems you may encounter by synchronizing massive amounts of data.

• Data loss and duplication
• Task buildup and latency
• Low throughput
• Long application-to-production cycle time
• Lack of application status monitoring

Apache SeaTunnel Usage Scenarios

• Massive data synchronization
• Massive data integration
• ETL of large volumes of data
• Massive data aggregation
• Multi-source data processing

Features of Apache SeaTunnel

• Rich components
• High scalability
• Easy to use
• Mature and stable

How to get started with Apache SeaTunnel quickly?

Want to experience Apache SeaTunnel quickly? SeaTunnel 2.1.0 takes 10 seconds to get you up and running.

https://seatunnel.apache.org/docs/2.1.0/developement/setup

How can I contribute?

We invite all partners who are interested in making local open-source global to join the Apache SeaTunnel contributors family and foster open-source together!

Submit an issue:

https://github.com/apache/seatunnel/issues

Contribute code to:

https://github.com/apache/seatunnel/pulls

Subscribe to the community development mailing list :

dev-subscribe@seatunnel.apache.org

Development Mailing List :

dev@seatunnel.apache.org

Join Slack:

https://join.slack.com/t/apacheseatunnel/shared_invite/zt-1kcxzyrxz-lKcF3BAyzHEmpcc4OSaCjQ

Follow Twitter:

https://twitter.com/ASFSeaTunnel

Join us now!❤️❤️