DE&A -Data Engineering Apache

Markteinblicke

Stack

Details

Kostenlos, nach der Anmeldung.

Bewerben

Laden Sie Ihren Lebenslauf hoch — Arbeitgeber und Recruiter aus verschiedenen Ländern, die Ihr Profil suchen, können Sie direkt kontaktieren.

Beschreibung

Design, develop, and implement scalable, resilient, and high-performance data pipelines and data architecturesfor enterprise data platforms. ·      Build and optimize ETL/ELT pipelines supporting batch, near-real-time, and streaming data processing requirements. ·      Design and implement enterprise data ingestion and integration workflows using Apache NiFi, including data routing, transformation, orchestration, monitoring, and integration across heterogeneous data sources and platforms. ·      Develop distributed data processing solutions using Apache Spark with Scala and/or Python (PySpark). ·      Design and implement data solutions across relational database management systems (RDBMS) and modern data lakehouse technologies such as Apache Iceberg. ·      Build and optimize federated and distributed SQL capabilities using Starburst and Trino query engines. ·      Develop event-driven and real-time data processing solutions using Apache Kafka and Spark Streaming / Structured Streaming. ·      Lead end-to-end delivery of enterprise-scale data engineering initiatives involving multiple engineering, product, architecture, and business teams. ·      Strengthen platform reliability through automation, CI/CD, testing, monitoring, observability, documentation, and operational excellence. ·      Improve data quality, performance, scalability, resiliency, and cost efficiency across data platforms and pipelines. ·      Support enterprise data governance by maintai

Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung. Anmelden

Kontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet. Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.