Databricks Engineer

3 or more years of experience in data engineering with scalable pipelines Strong experience designing data solutions including data modelling and distributed computing architectures Hands-on experience with data processing jobs using PySpark, Spark SQL, and Databricks notebooks/jobs Experience orchestrating data pipelines with ADF, Airflow, or similar tools Experience with both real-time and batch data processing Experience building pipelines on Azure, with AWS experience beneficial Proficiency in SQL including window functions and performance optimization Understanding of DevOps tools , Git workflows, and CI/CD pipelines Familiarity with Scrum methodology and experience working in Scrum teams Ability to apply Scrum practices in a practical project context Strong problem-solving and collaborative mindset Experience with streaming technologies such as Apache Kafka, Apache Flink, or AWS Kinesis Ability to design and implement real-time data processing pipelines Certification: Databricks Certified Data Engineer Associate and Databricks Certified Data Engineer Professional ( Nice to Have NOT Mandatory) Job Description The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines on Databricks and cloud platforms.

requires integrating diverse data sources, ensuring high-quality data processing, and supporting analytics, reporting, and machine learning workloads. The ro