The Role:
The Data Engineering Lead is a pivotal hybrid role within the Data Engineering team, combining hands-on development with leadership responsibilities. This individual will lead a squad of Data Engineers to deliver high-quality, high-velocity customer data pipelines while maintaining existing ones. The Data Engineering Lead owns end-to-end delivery including project management, data quality, and timelines and is accountable for both team output and their own individual contributions.
This role requires consistently high standards in both coding and execution.
What You’ll be Doing:
- Collaborate with the Implementation team and Data Analyst to review and own DE requirement writeups, ensuring they fully address data needs discussed in implementation calls.
- Communicate timelines for deliverables to unblock Data Engineers for ETL pipeline development.
- Proactively flag risks to timelines or quality to stakeholders and project managers.
- Lead backlog grooming for implementation-related tickets.
- Ensure team cross-coverage: both the DE Lead and assigned Data Engineer should understand the full ETL flow, with at least two additional engineers familiar at a high level.
- Conduct thorough peer reviews and DE UATs after initial UAT completion.
- Designing and maintaining data transformation pipelines using dbt, including utilizing core concepts like macros, incremental models and dbt tests
- Work with QA and CSA teams to resolve post-UAT issues and update the DE UAT ch