Apache SeaTunnel Chengdu Station Offline Meetup Successfully Held! Technical elites gather to share a new chapter in big data
On April 15, 2023, a unique big data event was successfully concluded in the spring sunshine of Chengdu. Co-hosted by the Apache DolphinScheduler and Apache SeaTunnel communities, the event focused on the theme of “Batch-Stream Integrated Best Practices in Big Data” and brought together more than 50 technical enthusiasts, industry elites, and experts in the big data field to explore cutting-edge technologies and best practices in data scheduling and integration.
The event kicked off with an opening speech by Zeng Hui, the Senior Community Manager of Whaleops Open Source. He warmly welcomed the audience and speakers who attended the event and expressed his gratitude to the community for the prosperous development of the Apache DolphinScheduler since its open-source release. He emphasized that the community not only prioritizes code but also community engagement and that through the event, he could feel the warmth that the community conveyed. He hopes that the community will soon grow into a world-class open-source community.
During the event, Fan Jia, the Apache SeaTunnel PPMC, introduced the audience to the background, key features, and applicable scenarios of Apache SeaTunnel. She also delved into the core components and logical structure of the tool, allowing attendees to better understand its internal workings and optimization design. Additionally, Fan Jia provided a tutorial on how to use Apache SeaTunnel and its core logic to help those who are not familiar with the tool get started.
Duan Chunyin, the manager of the Vipshop Fubon Big Data Center, shared his experiences on how the company selected Apache DolpinScheduler as their scheduling tool and detailed the deployment, transformation, and integration of applications in the consumer finance industry. He provided practical insights on how to create a unified scheduling platform for big data.
Wang Hailin, a Whaleops Open Source R&D Engineer, presented on the topic of “Synchronization and Design of Apache SeaTunnel CDC,” in which he compared common CDC data synchronization solutions and outlined the selection and design of Apache SeaTunnel CDC. He also provided a detailed explanation of the implementation details of CDC functionality, demonstrated typical use cases and scenarios, and discussed the community’s plans for Apache SeaTunnel CDC’s future development and how newcomers can contribute.
Hou Shitao, a personal contributor, shared DolphinScheduler’s automatic data replenishment feature, detailing how to use it to automate the data handling process and eliminate the tedious manual execution of scripts to fix data. He also provided a source code analysis and demonstrated DolphinScheduler’s powerful functionality and flexibility.
After the event, many participants expressed that they gained a lot from the meetup. They not only deepened their understanding of outstanding open-source projects like DolphinScheduler and SeaTunnel but also made many like-minded industry peers, expanding their network resources. They expressed their expectations for more technical exchange events in the future to jointly explore the development and application of big data technology.
The Apache SeaTunnel community will continue to work hard to provide valuable technical exchange and learning opportunities. Let us work together to promote the development and innovation of the big data field! It is worth mentioning that on April 22, we will bring more exciting sharing sessions in Shanghai. Stay tuned!
