Data Engineer

VNGGames

Z06 Street No. 13, Tan Thuan Dong Ward, Tân Thuận, TP Hồ Chí Minh

Tại văn phòng

Đăng 6 giờ trước

Kỹ năng:

Chuyên môn:

Lĩnh vực:

Trò Chơi

3 Lý do để gia nhập công ty

Designing and developing data pipelines for processing game logs and extracting customer/player relevant information
Optimize data processing workflows to handle large-scale log data efficiently
Design, develop, and maintain high performance Golang applications for serving Customer Data
Contribute to architectural discussions and assist in the design and implementation of the Customer Data Platform

Bachelor in Computer Sciences or equivalent.
Experience in building mid/complex data pipelines, optimizing code, and handling large datasets efficiently.
Strong understanding of Apache Spark, including working with RDDs, DataFrames, and Spark SQL
Strong with Apache Airflow for managing and orchestrating complex data pipelines, including dependency management, scheduling, and error handling.
Knowledge of data validation techniques, data quality frameworks, and experience with testing data pipelines to ensure accuracy and reliability.
Understanding of RESTful APIs and microservices concepts
Familar with CI/CD tools and practices, such as Jenkins, GitLab CI/CD. Understanding of automating build, test, and deployment processes.
Experience with Golang is a big plus
Have ownership of one own's project: taking pro-active actions to remove road blocks when arisedCommunication and collaboration skills: strong with a proven ability to work effectively in cross-functional teams