[Issue 4]Apache SeaTunnel(Incubating) Weekly FAQ

Apache SeaTunnel
2 min readMay 15, 2023

--

Q: Why does Metaspace accumulation occur after execution without release?

A: It is cleared during full garbage collection (GC).

Q: Sometimes, when executing SeaTunnel 2.3.1, it operates in streaming mode despite specifying “job.mode” as “BATCH.” Why?

A: Append “rewriteBatchedStatements=true” as a parameter after JDBC.

Q: How to use the row type in Schema?

A: Check the job configuration examples under the e2e module.

Q: What to do if real-time tasks occur during offline task execution?

A: The bug has been fixed in the dev branch.

Q: Does SeaTunnel support CDC from PostgreSQL and MongoDB to Kafka?

A: Yes, it supports.

Q: Is there a release plan for SeaTunnel-web?

A: A release is expected around June.

Q: Can SeaTunnel handle real-time synchronization of individual tables in MySQL, including DDL changes?

A: Real-time synchronization is possible, but not DDL changes.

Q: Why can’t variables be passed in SeaTunnel 2.3.1?

A: You can pass parameters using the Shell approach.

Q: Can SeaTunnel handle data from HTTP interfaces?

A: Yes, it supports.

Q: How to use the SeaTunnel Zeta engine?

A: Refer to the documentation:

  • seatunnel.apache.org/docs/2.3.1/seatunnel-engine/local-mode
  • seatunnel.apache.org/docs/2.3.1/seatunnel-engine/cluster-mode

About Apache SeaTunnel

Apache SeaTunnel (formerly Waterdrop) is an easy-to-use, ultra-high-performance distributed data integration platform that supports real-time synchronization of massive amounts of data and can synchronize hundreds of billions of data per day in a stable and efficient manner.

Why do we need Apache SeaTunnel?

Apache SeaTunnel does everything it can to solve the problems you may encounter in synchronizing massive amounts of data.

  • Data loss and duplication
  • Task buildup and latency
  • Low throughput
  • Long application-to-production cycle time
  • Lack of application status monitoring

Apache SeaTunnel Usage Scenarios

  • Massive data synchronization
  • Massive data integration
  • ETL of large volumes of data
  • Massive data aggregation
  • Multi-source data processing

Features of Apache SeaTunnel

  • Rich components
  • High scalability
  • Easy to use
  • Mature and stable

How to get started with Apache SeaTunnel quickly?

Want to experience Apache SeaTunnel quickly? SeaTunnel 2.1.0 takes 10 seconds to get you up and running.

https://seatunnel.apache.org/docs/2.1.0/developement/setup

How can I contribute?

We invite all partners who are interested in making local open-source global to join the Apache SeaTunnel contributors family and foster open-source together!

Submit an issue:

https://github.com/apache/incubator-seatunnel/issues

Contribute code to:

https://github.com/apache/incubator-seatunnel/pulls

Subscribe to the community development mailing list :

dev-subscribe@seatunnel.apache.org

Development Mailing List :

dev@seatunnel.apache.org

Join Slack:

https://join.slack.com/t/apacheseatunnel/shared_invite/zt-1kcxzyrxz-lKcF3BAyzHEmpcc4OSaCjQ

Follow Twitter:

https://twitter.com/ASFSeaTunnel

Come and join us!

--

--

Apache SeaTunnel
Apache SeaTunnel

Written by Apache SeaTunnel

The next-generation high-performance, distributed, massive data integration tool.

No responses yet