Data Engineer

Аналитика рынка

Стек

Бесплатно. Вход по почте.

Откликнуться

Загрузите резюме — мы свяжем вас с работодателем напрямую через нашу базу.

Описание

Position : Data Engineer Migrate data pipelines from existing data acquisition framework to the new GDP data acquisition framework Configure,develop and deliver data ingestion scripts for loading data into T1 data layer Develop and manage ETL/ELT workflows, ensuring data quality, integrity, and reliability. Integrate and automate data quality checks and validation processes within data pipelines. Deploy and manage containerized applications using Docker and orchestrate workloads on Kubernetes. Work with modern data lake and warehouse technologies such as Iceberg Implement real-time data streaming solutions using Kafka. Orchestrate complex workflows using Airflow. Integrate with data catalog and governance tools such as Datahub and Ranger. Collaborate with cross-functional teams to understand business requirements and deliver data solutions. Ensure security, compliance, and best practices in data management and governance. Strong proficiency in Linux, Python, and Shell scripting. Hands-on experience with Docker, Kubernetes, and container orchestration. Hands-on experience with Minio and Azure Data Lake Storage (ADLS) using S3 protocols. Experience with Apache Iceberg, Kafka, Airflow, Datahub, Trino, and Ranger . Work Location : Singapore. Interested applicants- Please send us resume at [email]

Компания и ссылка на вакансию — после входа. Войти

Контакты работодателя (email/phone/telegram) скрыты из публичного превью — отправьте резюме, чтобы мы связали вас напрямую.