Data Engineer

Analityka rynku

Stack

Szczegóły

Bezpłatnie, po zalogowaniu.

Aplikuj

Prześlij CV — pracodawcy i rekruterzy z różnych krajów, którzy szukają takiego profilu, będą mogli napisać do Ciebie bezpośrednio.

Opis

Role Overview This role is responsible for designing, building, and deploying a scalable and reliable data lakehouse platform on AWS . The Data Engineer will architect end-to-end data pipelines, establish data quality frameworks, and deliver production-ready solutions that form the foundation of the organisation's data infrastructure. Key Responsibilities Data Pipeline & Architecture Design Design and implement scalable ETL/ELT pipelines using AWS services including Glue, Step Functions, Lambda, and S3. Architect and build data lakehouse solutions leveraging Apache Iceberg or S3 tables, incorporating features such as schema evolution, partition evolution, and ACID transactions. Ensure pipelines are optimised for performance, cost, and reliability at scale. Data Quality & Governance Define, implement, and maintain automated data quality validation frameworks, establishing metrics and monitoring to ensure data accuracy, completeness, and consistency. Enforce data governance standards and ensure compliance across the data platform. Application Development & Deployment Write production-quality code and deploy solutions on AWS cloud infrastructure. Work with DevOps practices including CI/CD pipelines and infrastructure-as-code tools such as Terraform or CloudFormation to ensure repeatable and auditable deployments. Collaboration & Handover Work closely with cross-functional teams and communicate technical designs clearly to non-technical stakeholders. Produce thorough technical do

Pełny opis, firma i link do aplikacji — po zalogowaniu. Zaloguj się

Kontakty pracodawcy (e-mail/telefon/Telegram) są ukryte w publicznym podglądzie. Wyślij CV — a pracodawcy będą mogli napisać do Ciebie sami.