Descripción
Position: Data Engineer (Platform Modernization & Migration) Location: Fully Remote (EMEA & APAC Preferred) Contract Type: Full-time, Permanent Time Zone Alignment: Requires overlap until at least 12:00 PM Pacific Time (PT) 🧭 About Inallmedia.com Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation. 🚀 Project Overview You will join a core Data Engineering organization, working in close partnership with the Data Platform team to drive a major data platform modernization initiative.
The primary focus of this project is executing pre-designed migration blueprints for approximately 1,000 datasets to Snowflake with Airflow 3 orchestration. You will play a crucial role in accelerating time-sensitive infrastructure goals by evolving legacy Lakehouse formats to Apache Iceberg, modernizing streaming infrastructure across cloud regions, and adapting existing pipelines to uphold strict data quality and performance standards. 🔍 Key
Responsibilities
Pipeline Migration & Upgrades: Execute the end-to-end migration of approximately 1,000 datasets to Snowflake, including upgrading orchestration workflows from Apache Airflow 2 to Airflow 3. Storage & Data Lake Modernization: Migrate legacy Hive data structures and datasets to Apache Iceberg format using the Snowpark Connect
Descripción completa, empresa y enlace para postular: después de iniciar sesión.
Iniciar sesiónLos contactos del empleador (correo/teléfono/telegram) están ocultos en la vista previa pública.
Envía tu CV para que los empleadores puedan contactarte directamente.