Apache SeaTunnel January 2025 Monthly Community Report
January 2025 Edition
“Dear Apache SeaTunnel enthusiasts, welcome to this month’s community report!”
The Apache SeaTunnel project is rapidly evolving, focused on enhancing the scalability, performance, and reliability of data synchronization. We are deeply grateful to every community member who has contributed to this progress. Together, let’s continue to witness the growth of SeaTunnel.
SeaTunnel Monthly Merge Stars
A special thank you to the following contributors for their outstanding contributions to the Apache SeaTunnel project in the past month! (Order does not indicate ranking)
Recent Fixes and Improvements
Fixes
- [Fix][doris-e2e] Fixed flaky Doris end-to-end tests](https://github.com/apache/seatunnel/pull/8596) — @jw-itq
- [Fix][Connector-Mongodb] Ensure MongoDB client is closed when MongoDB reader is shut down](https://github.com/apache/seatunnel/pull/8592) — @sohurdc
- [Bugfix][example] Fixed Spark test case](https://github.com/apache/seatunnel/pull/8589) — @liugddx
- [Fix][Connector-V2] Fixed issue with table comments when automatically creating tables in StarRocks](https://github.com/apache/seatunnel/pull/8568) — @corgy-w
- [Doc][Fix] Fixed broken links in documentation](https://github.com/apache/seatunnel/pull/8555) — @litiliu
- [Fix][File] Resolved issue with multi-file binary format synchronization failure](https://github.com/apache/seatunnel/pull/8546) — @taohaozhi1129
- [Fix] Updated table-merge.md documentation](https://github.com/apache/seatunnel/pull/8535) — @JesseAtSZ
- [Fix] Updated table-merge.md file](https://github.com/apache/seatunnel/pull/8532) — @JesseAtSZ
- [Fix][Connector-V2] Postgres multi-primary key support](https://github.com/apache/seatunnel/pull/8526) — @shirukai
- [Fix][Doc] Fixed broken links in documentation](https://github.com/apache/seatunnel/pull/8525) — @Hisoka-X
- [Fix][Connector-V2] Fixed issue with adding table comments](https://github.com/apache/seatunnel/pull/8514) — @corgy-w
- [Fix][Doc] Fixed broken links in Kubernetes documentation](https://github.com/apache/seatunnel/pull/8510) — @Hisoka-X
- [Fix][Hive] Supported optional timestamp int96 format for Parquet file writes](https://github.com/apache/seatunnel/pull/8509) — @corgy-w
- [Hotfix][Connector-V2][SFTP] Added wildcard characters to SFTP filenames](https://github.com/apache/seatunnel/pull/8501) — @e-mhui
- [Fix][Connector-V2] Fixed CSV string type write issue](https://github.com/apache/seatunnel/pull/8499) — @corgy-w
- [Fix][connector-elasticsearch] Supported Elasticsearch NEST types and Spark with Array<map>](https://github.com/apache/seatunnel/pull/8492) — @CosmosNi
- [Fix][Doc] Fixed incorrect links in about/index.html](https://github.com/apache/seatunnel/pull/8486) — @B1F030
- [Fix][docs] Fixed misconfigurations in setup.md](https://github.com/apache/seatunnel/pull/8483) — @daigoopautoy
- [Fix][Flink] Fixed NPE when getting null rows from upstream conversion](https://github.com/apache/seatunnel/pull/8469) — @litiliu
- [Bug][Kafka] Fixed repeated Kafka reads issue](https://github.com/apache/seatunnel/pull/8465) — @hawk9821
- [Bug][Avro] Fixed Avro conversion of short type to integer type](https://github.com/apache/seatunnel/pull/8459) — @hawk9821
- [Hotfix][Zeta][Log] Fixed Zeta parallel stream logging for job tracking](https://github.com/apache/seatunnel/pull/8456) — @hailin0
- [Fix][Zeta] Introduced SeaTunnel CompletableFuture to prevent ForkJoinPool thread shortages](https://github.com/apache/seatunnel/pull/8445) — @Hisoka-X
- [Hotfix][connector-elasticsearch-sink] Converted index names to lowercase](https://github.com/apache/seatunnel/pull/8429) — @zhangshenghang
- [Fix][Doc] Updated Elasticsearch Sink and Oracle CDC Source example configurations](https://github.com/apache/seatunnel/pull/8425) — @bwcxyk
- [BUG] Fixed support for storing nulls in Avro format](https://github.com/apache/seatunnel/pull/8424) — @Tu-maimes
- [Fix] Unified Snappy dependency versions](https://github.com/apache/seatunnel/pull/8423) — @Hisoka-X
- [fix][docker] Updated Dockerfile](https://github.com/apache/seatunnel/pull/8421) — @liunaijie
- [Fix][Doris] Fixed unclosed directories](https://github.com/apache/seatunnel/pull/8415) — @hailin0
- [Fix][Connector][TDEngine] Added support for NCHAR type in TDEngine](https://github.com/apache/seatunnel/pull/8411) — @zhangshenghang
- [Fix] [Kafka Source] Used topic name as table name instead of full name](https://github.com/apache/seatunnel/pull/8401) — @Cheun99
- [Bug] [connector-file] Fixed NullPointerException when source fields are smaller than target fields (Hive)](https://github.com/apache/seatunnel/pull/8200) — @linjianchang
- [Hotfix] Fixed operator precedence exception with shard keys in connector-clickhouse](https://github.com/apache/seatunnel/pull/8162) — @supernovaYe
Improvements
- [Improve] Updated snapshot version to 2.3.10](https://github.com/apache/seatunnel/pull/8578) — @Hisoka-X
- [Improve][Jdbc] Removed Oracle ‘v$database’ query](https://github.com/apache/seatunnel/pull/8571) — @hailin0
- [Feature] [Postgre CDC] Supported array types](https://github.com/apache/seatunnel/pull/8560) — @litiliu
- [Doc][Improve] Translated PostgreSQL-related Chinese documentation into English](https://github.com/apache/seatunnel/pull/8552) — @ahuljh
- [Doc][Improve] Translated Neo4j and StarRocks-related Chinese documentation](https://github.com/apache/seatunnel/pull/8549) — @Cheun99
- [Improve][Connector-v2] Added comments for StarRocks test](https://github.com/apache/seatunnel/pull/8545) — @corgy-w
- [Feature][Transform-V2] Added deepseek to LLM](https://github.com/apache/seatunnel/pull/8544) — @corgy-w
- [Feature][Connector-V2] Supported creation of empty files when no data is present](https://github.com/apache/seatunnel/pull/8543) — @Hisoka-X
- [Feature][Core] Unified engine connector initialization logic](https://github.com/apache/seatunnel/pull/8536) — @liugddx
- [Feature][Iceberg] Supported reading multiple tables](https://github.com/apache/seatunnel/pull/8524) — @hailin0
- [Feature][Connector-V2] Supported single file mode in file receivers](https://github.com/apache/seatunnel/pull/8518) — @Hisoka-X
- [Improve][Doc] Added remote_user parameter in HdfsFile.md](https://github.com/apache/seatunnel/pull/8507) — @JesseAtSZ
- [Feature] [Clickhouse] Supported large volumes of data writing](https://github.com/apache/seatunnel/pull/8504) — @sohurdc
- [Improve] [Kafka] Supported batch sends with multiple producers](https://github.com/apache/seatunnel/pull/8491) — @Cheun99
- [Feature][Clickhouse] Supported multi-query requests in batch writes](https://github.com/apache/seatunnel/pull/8481) — @Zhengaisheng
- [Feature] [Doris] Supported multi-threaded read](https://github.com/apache/seatunnel/pull/8454) — @Hisoka-X
others
- [ [Doc][Mysql-cdc]Update doc to support mysql 8.0 ]( https://github.com/apache/seatunnel/pull/8579 “ [Doc][Mysql-cdc]Update doc to support mysql 8.0 “) @litiliu
- [ [config][enhance]support use properties when encrypt/decrypt config ]( https://github.com/apache/seatunnel/pull/8527 “ [config][enhance]support use properties when encrypt/decrypt config “) @litiliu
- [ [config][doc]add sensitive columns and enhance the doc ]( https://github.com/apache/seatunnel/pull/8523 “ [config][doc]add sensitive columns and enhance the doc “) @litiliu
- [ [Docs][Iceberg]translate connector-v2/sink/Iceberg.md to Chinese #8497 ]( https://github.com/apache/seatunnel/pull/8520 “ [Docs][Iceberg]translate connector-v2/sink/Iceberg.md to Chinese #8497 “) @Polaris-XLY
- [ [Doc][Translate]translated and corrected the error in the original document ]( https://github.com/apache/seatunnel/pull/8505 “ [Doc][Translate]translated and corrected the error in the original document “) @iamadamnBoy
- [ [Imporve][ClickhouseFile]Directly connect to each shard node to obtain the corresponding path ]( https://github.com/apache/seatunnel/pull/8449 “ [Imporve][ClickhouseFile]Directly connect to each shard node to obtain the corresponding path “) @caicancai
- [ fix transforms-v2 nlpmodel typo ]( https://github.com/apache/seatunnel/pull/8430 “ fix transforms-v2 nlpmodel typo “) @SEZ9
- [ [Doc][Transform-v2]Update doc for Array function ]( https://github.com/apache/seatunnel/pull/8419 “ [Doc][Transform-v2]Update doc for Array function “) @CosmosNi
# apache/seatunnel-website
fix
- [ [Fix][Doc]Ensure the consistency of source_table_name and result_tab… ]( https://github.com/apache/seatunnel-website/pull/355 “ [Fix][Doc]Ensure the consistency of source_table_name and result_tab… “) @Shlpeng
others
- [ [Release][2.3.9]update docs for seatunnel website ]( https://github.com/apache/seatunnel-website/pull/357 “ [Release][2.3.9]update docs for seatunnel website “) @TyrantLucifer
- [ Update HdfsFile.md ]( https://github.com/apache/seatunnel-website/pull/354 “ Update HdfsFile.md “) @JeremyXin
- [ Update Oracle.md ]( https://github.com/apache/seatunnel-website/pull/353 “ Update Oracle.md “) @chenyz1984
- [ Update setup.md ]( https://github.com/apache/seatunnel-website/pull/347 “ Update setup.md “) @daigoopautoy
# apache/seatunnel-website
fix
- [ [Fix][Doc]Ensure the consistency of source_table_name and result_tab… ]( https://github.com/apache/seatunnel-website/pull/355 “ [Fix][Doc]Ensure the consistency of source_table_name and result_tab… “) @Shlpeng
others
- [ [Release][2.3.9]update docs for seatunnel website ]( https://github.com/apache/seatunnel-website/pull/357 “ [Release][2.3.9]update docs for seatunnel website “) @TyrantLucifer
- [ Update HdfsFile.md ]( https://github.com/apache/seatunnel-website/pull/354 “ Update HdfsFile.md “) @JeremyXin
- [ Update Oracle.md ]( https://github.com/apache/seatunnel-website/pull/353 “ Update Oracle.md “) @chenyz1984
- [ Update setup.md ]( https://github.com/apache/seatunnel-website/pull/347 “ Update setup.md “) @daigoopautoy
Get Involved
If you’re interested in contributing to SeaTunnel, don’t hesitate to reach out! We welcome new contributors from all backgrounds, whether you’re a developer or just want to help improve the documentation. For more info, please check out our contribution guidelines on GitHub.
We look forward to your involvement!
