Data Engineer

🎯 Job Summary

We are looking for an experienced Data Engineer with 7+ years of experience in designing, developing, and maintaining scalable data pipelines and data infrastructure. The candidate will be responsible for building ETL/ELT processes, managing large datasets, optimising data workflows, and supporting data analytics and business intelligence initiatives.

🔧 Key Responsibilities

Design, develop, and maintain scalable data pipelines and data integration solutions.

Build and manage ETL/ELT workflows for structured and unstructured data.

Develop data models and optimise data warehouse solutions.

Integrate data from multiple sources, including databases, APIs, and cloud platforms.

Implement data processing solutions using batch and real-time streaming technologies.

Ensure data quality, accuracy, consistency, and reliability.

Work with data scientists, analysts, architects, and business stakeholders.

Develop and optimise SQL queries and database performance.

Implement data governance, security, and access control practices.

Monitor, troubleshoot, and resolve data pipeline failures and performance issues.

Work with cloud-based data platforms and distributed processing frameworks.

Maintain technical documentation and follow software development best practices.

💻 Technical Skills & Requirements Strong proficiency in SQL and Python.

Hands-on experience with ETL/ELT tools and data pipeline development.

Experience with Apache Spark, PySpark, and Hadoop.

Knowledg