Mid Level Data Engineer - KT

Role Overview The Data Engineer works closely with statisticians, analytical teams, and business stakeholders to design, build, and maintain the data infrastructure needed to support rigorous statistical production processes.

centres on building reliable and maintainable data pipelines, validation and frameworks that support statistical production processes. You will contribute to the migration and modernisation of legacy processes, ensuring that existing business logic is preserved and that outputs are accurately reconciled against current production results. You will also contribute to the engineering practices required to operate the platform reliably in production.

Key

• Design, develop and maintain efficient and reliable ETL processes and data pipelines for the ingestion, transformation, and integration of data from multiple source agencies. · Develop and maintain modular, production-quality code for statistical production processes, including optimising legacy processes while preserving business logic and reconciling outputs against existing results. · Design and maintain database schemas, data models and storage structures to support efficient ingestion, validation, transformation and retrieval of large datasets. · Build reusable data engineering components such as common libraries, configuration frameworks, logging standards, and utilities to streamline production workflows. · Implement and maintain CI/CD pipelines for data engineering workfl