Описание
We are seeking an experienced Senior Data Engineer to join our fast-growing global team. In this role, you will lead the end-to-end design, construction, and iteration of our real-time business data ingestion systems and streaming data warehouse architecture. You will work at the intersection of high-scale real-time data streaming, cloud analytics platforms, and business-critical analytics engines to support real-time dashboards, user profiling platforms, and business monitoring systems.
Key
Responsibilities
Ingestion Pipeline Ownership: Own the lifecycle development of real-time collection, cleaning, and warehousing of business logs, user behavior data, and database operational logs to guarantee pipeline stability, completeness, and low latency. Real-Time Data Warehouse Architecture: Design multi-layer real-time data models, build and tune streaming ETL pipelines, and support continuous delivery of real-time business metrics and analytics. Kafka & Streaming Optimization: Maintain and optimize core Kafka streaming infrastructure.
Diagnose and resolve online challenges including message backlogs, data skew, message loss, duplication, and partition tuning. Spark & Flink Operations: Develop, tune, and operate real-time Spark/Flink tasks to maximize computing resource utilization, throughput, and sub-second latency. Cross-Functional Collaboration: Partner with data product managers, analysts, and business stakeholders to translate complex business requirements into scalable, prod
Полное описание, компания и ссылка на вакансию — после входа.
ВойтиКонтакты работодателя (email/phone/telegram) скрыты из публичного превью —
отправьте резюме, чтобы мы связали вас напрямую.