Описание
Svitla Systems Inc. is looking for a Data Engineer for a full-time position (40 hours per week) in Europe. Our client is one of the world’s largest and fastest-growing job sites.
We are looking for a Data Engineer to work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
The role
centers on migrating approximately 1,000 datasets to Snowflake, with Apache Airflow 3 handling orchestration. The core architecture and technical approach are already defined by the client's team, so the focus is on execution rather than design. The overarching objective is to accelerate a set of time-sensitive migrations (Airflow 2 to 3, Confluent region migration, and the move to Iceberg), targeted for completion by the end of March 2027.
Coverage until 12:00 PM PT
Requirements
3+ years of industry experience working with large-scale datasets, including Airflow and Spark. Strong software engineering fundamentals. Hands-on Python development experience.
Advanced SQL, including complex joins, CTEs, window functions, and performance tuning. Snowflake data modeling experience. Experience developing and testing pipelines in Apache Airflow and Python.
Experience with Apache Kafka. Experience with Apache Spark, including hands-on PySpark. Experience with Iceberg and Parquet data formats.
AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies). Testing strategy experience, wit
Полное описание, компания и ссылка на вакансию — после входа.
ВойтиКонтакты работодателя (email/phone/telegram) скрыты из публичного превью —
отправьте резюме, чтобы мы связали вас напрямую.