Opis
Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world. As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry. For more information, visit [link] Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse.
Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves. This is a hands-on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will help ensure data is delivered accurately, reliably, and on time as our data platform grows.
Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 way.
Responsibilities
Operate, tune, and scale the ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead-letter handling Own pipeline reliability: define SLOs for freshness and lag, build alerting a
Pełny opis, firma i link do aplikacji — po zalogowaniu.
Zaloguj sięKontakty pracodawcy (e-mail/telefon/Telegram) są ukryte w publicznym podglądzie.
Wyślij CV — a pracodawcy będą mogli napisać do Ciebie sami.