Data Engineer

Role: Senior Data Engineer Role Overview : Experienced Data Engineer to analyze, design and develop enterprise-scale data pipelines across legacy and strategic cloud data platforms. A key component of the position is analyzing existing data pipelines, particularly Omnia-based Spark pipelines, understanding the underlying business and transformation logic, and translating that logic into scalable data solutions on modern cloud platforms.

requires strong hands-on experience with AWS, Snowflake, dbt, Airflow, PySpark, Python and advanced SQL. Technical Expertise : Strong hands-on experience designing, developing and supporting scalable enterprise data pipelines. Strong Spark-etl experience, including the ability to analyze existing Omnia pipelines, understand their processing logic and derive new transformation and business rules.

Strong working knowledge of AWS services, including S3, Glue, EMR, Lambda, Athena, Step Functions, SQS, IAM, Secrets Manager and CloudWatch, combined with hands-on experience in orchestrating data pipelines using Apache Airflow. Practical experience with Snowflake, covering data ingestion, data modelling, transformation and performance optimization. Experience using dbt to develop data models, incremental processing, reusable macros, automated tests, documentation and dependency management.

Excellent SQL skills, with experience in complex data transformations, query optimization, reconciliation and understanding existing business logic. Famili