Senior Data Engineer (Databricks & PySpark)

Аналитика рынка

Стек

Бесплатно. Вход по почте.

Откликнуться

Загрузите резюме — мы свяжем вас с работодателем напрямую через нашу базу.

Описание

Обязанности: Data Engineering & Product Development: Design and implement scalable data products using Databricks, Delta Lake, and PySpark. Build and maintain data pipelines processing complex datasets from ERP, procurement, sustainability, and external systems., Performance Optimization: Optimize workloads for performance, scalability, and cost efficiency, building reusable engineering patterns., Data Quality & Governance: Implement automated data quality controls throughout the data lifecycle. Proactively identify and resolve data issues before they impact reporting., Platform Engineering & DevOps: Implement CI/CD pipelines, automated deployments, testing frameworks, and Infrastructure as Code (IaC). Support platform security controls and access management., Stakeholder Collaboration: Partner with sustainability experts, business analysts, and reporting teams to support requirements gathering, solution design, and production releases. Опыт: 5–7 years of experience designing, developing, and operating data platforms and pipelines., Extensive hands-on experience with Databricks (including Azure Databricks and Databricks Workflows) in production environments., Expert-level proficiency in PySpark, Python, Spark SQL, Data Modelling, and Data Pipeline Design., Experience implementing CI/CD pipelines for data engineering workloads, Git-based development, and version control., Solid understanding of data lineage, metadata management, governance, auditing, and validation frameworks.

Полное описание, компания и ссылка на вакансию — после входа. Войти

Контакты работодателя (email/phone/telegram) скрыты из публичного превью — отправьте резюме, чтобы мы связали вас напрямую.