Data Engineer

Mô tả công việc

Who we are..

• We are ABC Studio Co. Ltd, which stands for Ai Bigdata Content Studio.
• We are a Korean-Vietnamese start-up, focusing on Bigdata, AI.
• Our visions are
  • The company who has the biggest market data in the world.
  • The company who make the first Virtual fitting & shopping platform in the world.

What ABC Studio does

• Data-mining of global e-commerce and SNS platforms, such as, Shopee, Coupang, LAZADA, Douyin, Musinsa, instagram, Youtube, Tiktok, Naver and others
• Data-transforming and building up data-pipelines with python, AI and others, under a partnership with mainly Korean marketing companies and fashion/Beauty/food big brands
• building sLLM/LLM chatbots, with generatvie AI solutions, chatGPT, langchain, stable diffusion and 3D graphics technologies

Job Description:

• We are seeking an experienced Data Engineer with 3-5 years of expertise in data engineering, data mining, data scraping, data transforming, pipeline management, data lake and warehouse and Cloud. The ideal candidate will excel in building scalable data pipelines and optimizing data infrastructure using tools like Apache Airflow.

Yêu cầu công việc

Key Responsibilities:

• Design, develop, and maintain robust data pipelines for large-scale data processing.
• Implement ETL processes to ensure data accuracy and integrity.
• Perform data mining and data scraping to gather and analyze data from various sources.
• Optimize data storage solutions, including data lakes and data warehouses.
• Use Apache Airflow for workflow management and scheduling.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or related field.
• 3-5 years of experience as a Data Engineer or similar role.
• Proficiency in programming languages such as Python.
• Strong SQL skills and experience with database systems (e.g., MySQL, PostgreSQL).
• Experience with data mining and data scraping techniques.
• Experience with data processing frameworks like Apache Spark.
• Familiarity with Google Cloud platform and their data services.
• Knowledge of data modeling, data warehousing, and ETL best practices.
• Proficiency with Apache Airflow for managing workflows.
• Effective English communication is essential.

Tại sao bạn sẽ yêu thích làm việc tại đây

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• Collaborative and inclusive work environment.
• Access to the latest technologies and tools.