M28 - Data Engineer

Markteinblicke

Stack

Details

Kostenlos, nach der Anmeldung.

Bewerben

Laden Sie Ihren Lebenslauf hoch — Arbeitgeber und Recruiter aus verschiedenen Ländern, die Ihr Profil suchen, können Sie direkt kontaktieren.

Beschreibung

Role Overview We are seeking an experienced Data Engineer to design, build, and deploy a scalable and reliable data lakehouse platform on AWS. The role will focus on developing end-to-end data pipelines, establishing robust data quality frameworks, and delivering production-ready solutions that form the foundation of the organisation's data infrastructure. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services such as Glue, Step Functions, Lambda, and S3. Architect and implement data lakehouse solutions using Apache Iceberg, S3 Tables, or similar open table formats. Implement lakehouse capabilities including schema evolution, partition evolution, and ACID transactions. Optimise data pipelines and storage solutions for performance, scalability, reliability, and cost efficiency. Define and implement automated data quality validation frameworks to ensure data accuracy, completeness, and consistency. Establish data quality metrics, monitoring, and alerting mechanisms across the data platform. Implement and maintain data governance standards and ensure compliance with relevant policies and requirements. Develop production-quality code and deploy solutions on AWS cloud infrastructure. Implement CI/CD practices to support automated, repeatable, and reliable deployments. Use infrastructure-as-code tools such as Terraform or CloudFormation to provision and manage cloud infrastructure. Work closely with cross-functional teams to design and

Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung. Anmelden

Kontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet. Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.