Senior Data Engineer

Our client, one of Asia-Pacific’s leading organizations is looking for: Senior Data Engineer

Leads the architecture, design, and implementation of ETL processes, workflows, and data pipelines for the ingestion, transformation, and integration of data from multiple source agencies. Build and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks, including dependency management, failure handling, recovery, and operational monitoring. Develop and maintain modular, production-quality code for statistical production processes, including uplifting of legacy processes while preserving business logic and reconciling outputs against existing results.

Review complex business logic and provide technical direction for migration and modernisation activities. Lead database and data model design, including schema design, storage patterns and performance optimisation for large-scale statistical datasets. Design and drive the adoption of reusable data engineering components such as common libraries, configuration frameworks, logging standards, and utilities to streamline production workflows and promote consistent engineering practices across the team.

Design and implement CI/CD for data engineering workflows to automate testing and deployment, and establish workflows to safely isolate and synchronise Development, UAT, and Production environments. Lead the design and configuration of complex pipeline workflows and sche