Data Engineer

Our client, one of Asia-Pacific’s leading organizations is looking for: Data Engineer

Design, develop and maintain efficient and reliable ETL processes and data pipelines for the ingestion, transformation, and integration of data from multiple source agencies. Develop and maintain modular, production-quality code for statistical production processes, including optimising legacy processes while preserving business logic and reconciling outputs against existing results. Design and maintain database schemas, data models and storage structures to support efficient ingestion, validation, transformation and retrieval of large datasets.

Build reusable data engineering components such as common libraries, configuration frameworks, logging standards, and utilities to streamline production workflows. Implement and maintain CI/CD pipelines for data engineering workflows, including automated testing and deployment, and establish workflows to safely isolate and synchronise Development, UAT, and Production environments. Design and configure complex pipeline workflows and schedules using enterprise tools, including dependencies, failure handling, recovery and operational monitoring.

Establish version control structures using GitLab, set up code review frameworks, and produce technical documentation. Monitor and troubleshoot pipelines, perform root-case analysis and continuously improve operational reliability and system performance for large-scale datasets. Collaborate wit