Data Engineer - Python, Data Processing & Acquisition

Mô tả công việc

We are hiring a hands-on Data Engineer with 5+ years of experience to develop and maintain data acquisition, processing, and delivery workflows for our global clients. The role focuses on acquiring data from multiple sources — Excel files, APIs, databases, and websites — and transforming that data into reliable, high-quality datasets for business use. The ideal candidate is highly proficient in Python and Pandas, comfortable working with imperfect real-world data, and capable of building maintainable automation solutions that support ongoing business operations. This role emphasizes practical data processing, data quality, workflow automation, and troubleshooting over large-scale distributed data engineering technologies.

• Develop and maintain Python-based data processing workflows.

• Clean, validate, normalize, enrich, and transform structured and semi-structured datasets.

• Implement business rules, tagging, classification, and data standardization processes.

• Handle missing values, duplicate records, inconsistent formats, and other data quality challenges.

• Build reusable and maintainable data transformation components.

• Automate ingestion and processing of Excel, CSV, JSON, and other file-based data sources.

• Handle varying file structures, multiple worksheets, inconsistent schemas, and formatting issues.

• Generate standardized output datasets and reports.

• Integrate with internal and third-party APIs to extract and load data from external systems.

• Handle authentication, pagination, rate limiting, retries, and error recovery.

• Monitor and troubleshoot data acquisition workflows.

• Develop and maintain web scraping and data extraction solutions when required.

• Analyze website structures and network requests to identify efficient extraction methods.

• Support collection of external data from public and third-party sources, and maintain existing scraping workflows as source websites evolve.

• Debug and maintain existing Python-based data workflows; investigate production issues and data discrepancies.

• Improve reliability, performance, and maintainability of existing processes.

• Develop logging, monitoring, and operational support mechanisms.

• Support deployment and operation of data workflows within AWS — working with Amazon S3, AWS Lambda, Amazon RDS, Amazon SQS, and Amazon CloudWatch.

• Participate in automation and cloud-based operational improvements.

• Working time: Monday to Friday, 14:00-23:00 

• Start date: ASAP

• Engagement: Long-term

• Language: English professional mandatory

Yêu cầu công việc

• 5+ years of professional experience in data engineering or Python-based data processing.

• Strong Python programming skills.

• Strong experience with Pandas for data processing and transformation.

• Experience working with Excel, CSV, JSON, and other structured data formats.

• Experience consuming and integrating REST APIs.

• Experience with SQL and relational databases.

• Experience with web scraping using tools such as BeautifulSoup, and the ability to fetch data from dynamic websites.

• Experience building automated data processing workflows.

• Hands-on experience with AWS services — S3, Lambda, RDS, SQS, CloudWatch.

• Strong debugging and troubleshooting skills.

• Ability to work effectively with messy and imperfect datasets.

• Strong version control practices using Git.

• Excellent analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with additional web scraping and data extraction technologies such as Selenium or Scrapy.

• Experience with Excel automation.

• Experience consuming GraphQL APIs.

• Experience with workflow orchestration tools.

• Experience with data mining and automation projects.

• Ability to leverage LLMs or other AI models (e.g., Hugging Face models, LLM APIs) to improve existing workflows.

Education

• Bachelor's degree in Computer Science, Information Technology, or a related discipline (required).

Tại sao bạn sẽ yêu thích làm việc tại đây

• Join a French tech company in Vietnam, combining European standards with local agility 

• Work in a truly international environment, with 13+ nationalities collaborating daily 

• Contribute to projects serving clients in 32 countries worldwide 

• Be part of long term, meaningful SaaS projects with real business impact 

• Grow your skills through mentoring, code reviews, and collaboration with experienced teams 

• Enjoy a professional, supportive, and people focused work culture 

• Visa, resident card, and work permit provided for expat profiles working in Vietnam