M28 - Data Engineer

Analisi del mercato

Stack

Dettagli

Gratis, dopo l'accesso.

Candidati

Carica il tuo CV: datori di lavoro e recruiter di diversi paesi che cercano il tuo profilo potranno contattarti direttamente.

Descrizione

Role Overview We are seeking an experienced Data Engineer to design, build, and deploy a scalable and reliable data lakehouse platform on AWS. The role will focus on developing end-to-end data pipelines, establishing robust data quality frameworks, and delivering production-ready solutions that form the foundation of the organisation's data infrastructure. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services such as Glue, Step Functions, Lambda, and S3. Architect and implement data lakehouse solutions using Apache Iceberg, S3 Tables, or similar open table formats. Implement lakehouse capabilities including schema evolution, partition evolution, and ACID transactions. Optimise data pipelines and storage solutions for performance, scalability, reliability, and cost efficiency. Define and implement automated data quality validation frameworks to ensure data accuracy, completeness, and consistency. Establish data quality metrics, monitoring, and alerting mechanisms across the data platform. Implement and maintain data governance standards and ensure compliance with relevant policies and requirements. Develop production-quality code and deploy solutions on AWS cloud infrastructure. Implement CI/CD practices to support automated, repeatable, and reliable deployments. Use infrastructure-as-code tools such as Terraform or CloudFormation to provision and manage cloud infrastructure. Work closely with cross-functional teams to design and

Descrizione completa, azienda e link per candidarti: dopo l'accesso. Accedi

I contatti del datore di lavoro (email/telefono/telegram) sono nascosti nell'anteprima pubblica. Invia il tuo CV così i datori di lavoro possono contattarti direttamente.