Talk With Overseas Contributors | Why do I contribute to Apache SeaTunnel(Incubating)?
As Apache SeaTunnel gets popular around the world, it is attracting more and more contributors from overseas to join the open-source career. Among them, a big data platform engineer at Kakao enterprise corp., Namgung Chan has recently contributed the Neo4j Sink Connector for the Apache SeaTunnel. We have a talk with him to know why Apache SeaTunnel is attractive to him, and how he thinks Apache SeaTunnel should gain popularity in the South Korean market.
Personal Profile
Namgung Chan, South Korea, Big Data Platform Engineer at Kakao enterprise corp.
- Blog (written in Korean): https://getchan.github.io/
- GitHub ID: https://github.com/getChan
- LinkedIn: https://www.linkedin.com/in/namgung-chan-6a06441b6/
Contributions to the community
He writes the Neo4j Sink Connector code for the new Apache SeaTunnel Connector API.
How to know Apache SeaTunnel for the first time?
It’s the first time Namgung Chan to engage in open source. He wants to learn technical skills by contributing, at the same time experience the open-source culture.
For him, an open source project which is written in java lang, and made for data engineering, has many issues of ‘help wanted’ or ‘good first issue’ is quite suitable. Then he found Apache SeaTunnel on the Apache Software Foundation project webpage.
The first impression of Apache SeaTunnel Community
Though it was his first open-source experience, he felt it was comfortable and interesting to go to the community. He also felt very welcome, because there are many ‘good first issues, and ‘volunteer wanted’ tagged issues and will get a quick response of code review.
With gaining knowledge of Neo4j, he grows much more confident in open source contribution.
Research and comparison
Before knowing about Apache SeaTunnel, Namgung Chan used Spring Cloud Data Flow for data integration. While after experiencing Apache SeaTunnel, he thinks the latter is more lightweight than SCDF, because in SCDF, every source, processor, and sink component are individual applications, but Apache SeaTunnel is not.
Though hasn’t used Apache SeaTunnel in his working environment yet, Namgung Chan said he would like to use it positively when he is in need, especially for data integration for various data storage.
Expectations for Apache SeaTunnel
The most exciting new features or optimizations for Namgung Chan are:
- Data Integration for various data storage.
- Strict data validation. monitoring extension
- Low computing resource
- exactly-once data processing
In the future, Namgung Chan plans to keep contributing from light issues to heavy ones, and we hope he will have a good time here!
About Apache SeaTunnel
Apache SeaTunnel (formerly Waterdrop) is an easy-to-use, ultra-high-performance distributed data integration platform that supports real-time synchronization of massive amounts of data and can synchronize hundreds of billions of data per day in a stable and efficient manner.
Why do we need Apache SeaTunnel?
Apache SeaTunnel does everything it can to solve the problems you may encounter in synchronizing massive amounts of data.
- Data loss and duplication
- Task buildup and latency
- Low throughput
- Long application-to-production cycle time
- Lack of application status monitoring
Apache SeaTunnel Usage Scenarios
- Massive data synchronization
- Massive data integration
- ETL of large volumes of data
- Massive data aggregation
- Multi-source data processing
Features of Apache SeaTunnel
- Rich components
- High scalability
- Easy to use
- Mature and stable
How to get started with Apache SeaTunnel quickly?
Want to experience Apache SeaTunnel quickly? SeaTunnel 2.1.0 takes 10 seconds to get you up and running.
https://seatunnel.apache.org/docs/2.1.0/developement/setup
How can I contribute?
We invite all partners who are interested in making local open-source global to join the Apache SeaTunnel contributors family and foster open-source together!
Submit an issue:
https://github.com/apache/incubator-seatunnel/issues
Contribute code to:
https://github.com/apache/incubator-seatunnel/pulls
Subscribe to the community development mailing list :
dev-subscribe@seatunnel.apache.org
Development Mailing List :
dev@seatunnel.apache.org
Join Slack:
https://join.slack.com/t/apacheseatunnel/shared_invite/zt-1kcxzyrxz-lKcF3BAyzHEmpcc4OSaCjQ
Follow Twitter:
https://twitter.com/ASFSeaTunnel
Come and join us!
