M28 - Data Engineer

Analityka rynku

Stack

Szczegóły

Bezpłatnie, po zalogowaniu.

Aplikuj

Prześlij CV — pracodawcy i rekruterzy z różnych krajów, którzy szukają takiego profilu, będą mogli napisać do Ciebie bezpośrednio.

Opis

Role Overview We are seeking an experienced Data Engineer to design, build, and deploy a scalable and reliable data lakehouse platform on AWS. The role will focus on developing end-to-end data pipelines, establishing robust data quality frameworks, and delivering production-ready solutions that form the foundation of the organisation's data infrastructure. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services such as Glue, Step Functions, Lambda, and S3. Architect and implement data lakehouse solutions using Apache Iceberg, S3 Tables, or similar open table formats. Implement lakehouse capabilities including schema evolution, partition evolution, and ACID transactions. Optimise data pipelines and storage solutions for performance, scalability, reliability, and cost efficiency. Define and implement automated data quality validation frameworks to ensure data accuracy, completeness, and consistency. Establish data quality metrics, monitoring, and alerting mechanisms across the data platform. Implement and maintain data governance standards and ensure compliance with relevant policies and requirements. Develop production-quality code and deploy solutions on AWS cloud infrastructure. Implement CI/CD practices to support automated, repeatable, and reliable deployments. Use infrastructure-as-code tools such as Terraform or CloudFormation to provision and manage cloud infrastructure. Work closely with cross-functional teams to design and

Pełny opis, firma i link do aplikacji — po zalogowaniu. Zaloguj się

Kontakty pracodawcy (e-mail/telefon/Telegram) są ukryte w publicznym podglądzie. Wyślij CV — a pracodawcy będą mogli napisać do Ciebie sami.