Senior Azure Data Engineer

[…] is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.

Design and construct data structures, DDLs, tables, and views across MS Cloud SQL Server and Data Lake environments. Develop Azure Databricks notebooks and PySpark/Spark SQL jobs to aggregate, join, and output standardized data formats (SFFs). Configure automated Ingestion Frameworks to streamline data loading across staging and Data Lake Core (DLC) layers.

Build, optimize, and maintain large-scale batch and real-time data pipelines using Azure Data Factory and Databricks. Monitor performance, tune complex SQL queries, and implement automation across data integration workflows. Support data governance, tracking data consumption patterns, testing pipeline outputs, and promoting curated datasets to the data catalog.

Apply CI/CD practices and collaborate within cross-functional Agile/Scrum teams to deliver project estimates and technical solutions. Skills: 5+ years of data engineering experience with a focus on enterprise ETL/ELT pipelines and cloud data platforms. Mandatory certifications: Certified Azure Data Engineer and Databricks Certified Data Engineer .

Core Azure expertise: Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage (ADLS), and MS Cloud SQL Server. Strong programming proficiency in Python, PySpark, Spark SQL, or Scala/Java. Advanced SQL skills for data manipulation, query opti