We are looking for a Senior Data Engineer with strong hands-on experience in Databricks and a solid understanding of Data Governance concepts. The ideal candidate should have 7+ years of overall experience, including a minimum of 5 years of Databricks experience, covering data engineering and/or Databricks infrastructure, along with knowledge of data governance principles and practices.
[…] is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
Work on Databricks infrastructure, including workspace configuration, clusters, compute resources, access controls, and performance optimization.
Apply Data Governance principles, including data quality, data lineage, metadata management, data cataloging, and access controls.
Work with Unity Catalog to manage data permissions, governance policies, and data assets.
Develop and manage Delta Lake tables using Medallion Architecture (Bronze, Silver, and Gold).
Integrate data from multiple sources, including databases, Amazon S3, files, and REST APIs.
Create, schedule, monitor, and optimize Databricks Jobs and Workflows.
Implement data validation, error handling, logging, monito