We're hiring a Senior Data Engineer to shape the data foundation behind […]'s product analytics, personalization, and AI initiatives. You'll own and evolve our event data platform, from app instrumentation through streaming and batch ingestion to the warehouse. You'll also build the pipelines and feature infrastructure that feed our recommendation systems and machine learning models.
This role sits where data engineering meets ML. You'll work closely with product engineering, data science, ML engineering, analytics, and experimentation teams. Together you'll make sure our data is reliable, well-modeled, and ready for both decision-making and production models.
What You'll Do Design, build, and operate scalable batch and streaming pipelines on AWS using Airflow (MWAA), Glue, Kafka, S3, and Redshift Lead the evolution of our product event platform, including schema design, event taxonomy, versioning, and migrations to next-generation event architecture Build event data quality and observability: schema validation, instrumentation testing, anomaly detection, freshness and completeness monitoring, and lineage across pipelines Handle late-arriving and out-of-order data correctly, using lookback reprocessing and idempotent, incremental loads that keep business metrics accurate Build and maintain the data foundations for personalization and recommendation systems, including the interaction, content, and project datasets used for model training and inference Partner with ML engine