Senior QA Engineer – Data (Databricks)
About the Role
The Senior QA Engineer for Data will test and validate the data platform behind our internal back-office systems, including Databricks pipelines and the Power BI reports that business users rely on. This is a hands-on senior role: you'll make sure our data is accurate, complete, and timely, build automated data tests, and mentor onshore and nearshore QA testers. You'll partner closely with data engineers and business stakeholders and work within an agile environment.
Responsibilities
Design and carry out test strategies for data pipelines built in Databricks, covering ingestion, transformation, and output.
Validate data accuracy, completeness, and consistency between sources and targets, including reconciliation and data comparison processes.
Build and maintain automated data tests in Python and Pytest, using SQL and PySpark to validate tables and transformations.
Test and validate Power BI reports against source data.
Define and implement data quality checks, and help set QA standards for the data platform.
Integrate data tests into CI/CD pipelines.
Investigate data defects and pipeline performance issues, and coordinate fixes with data engineering.
Work with business users to understand how they use data and reports, and propose technical and non-technical solutions to business problems.
Mentor onshore and nearshore QA testers, and review their test code against coding standards.
Track and report on data qu