Location: Hybrid, Pittsburgh, PAJob Type: Full Time / PermanentWork Authorization: No C2C or Sponsorship
The A.C.Coy company has an immediate opening for a Data Platform Manager. This role will be responsible for designing, building, and optimizing enterprise wide data platforms within the Data Warehouse.
Lead and mentor a team of data engineers, conducting code reviews and ensuring development standards
Support troubleshooting and incident management for data-related issues in production
Collaborate with business stakeholders, data scientists, and other team members to gather requirements and translate them into technical specifications
Lead the design, development and deployment of scalable and high-performance data pipelines using Azure Databricks; ensuring the data integrity, availability, efficient extraction, transformation, and loading of data from various sources into the Azure Databricks Data Warehouse
Collaborate with data scientists, analysts, and other engineering teams to deliver business-critical insights. Optimize pipeline performance, cost, and scalability in the Azure cloud environment
Define best practices for data ingestion, processing, storage, and governance. Implement data quality checks and validation procedures to ensure the accuracy and integrity of data between various sources, including APIs, databases and streaming platforms
Collaborate with data scientists and analysts to operationalize and deploy machine lea