Data Engineering Consultant

Markteinblicke

Stack

Details

Kostenlos, nach der Anmeldung.

Bewerben

Laden Sie Ihren Lebenslauf hoch — Arbeitgeber und Recruiter aus verschiedenen Ländern, die Ihr Profil suchen, können Sie direkt kontaktieren.

Beschreibung

Job Summary We are seeking a Senior Data Engineer to design, develop, and optimize scalable data pipelines and processing solutions using Big Data, cloud, and AI technologies. Collaborate with architects, data scientists, and engineering teams to deliver high-performance, production-ready data systems. Responsibilities Design, develop, and maintain scalable batch and real-time data pipelines using Apache Spark/PySpark, SQL, and Python to support large-scale data processing Develop and optimize ETL/ELT pipelines for efficient data ingestion and transformation Build data ingestion solutions integrating databases, APIs, files, and streaming platforms to ensure reliable data flow Utilize AWS services including S3, Glue, EMR, Redshift, Kinesis, Lambda, and DynamoDB to deploy and manage cloud-based data solutions Develop and optimize data processing workflows using Hadoop, Hive, Spark, Kafka, Cloudera, and Databricks for high throughput and low latency Perform SQL and Spark performance tuning to enhance large-scale data workload efficiency Design and implement data models, data warehouses, and data lake architectures to support analytics and reporting needs Develop CI/CD pipelines and support containerized deployments using Docker, Kubernetes, and OpenShift to automate delivery and scaling Integrate Generative AI and NLP capabilities into enterprise data applications to enhance data insights and automation Develop solutions leveraging LLM frameworks, RAG, vector databases, and AI A

Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung. Anmelden

Kontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet. Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.