data engineer

<b>Job Description</b><br><span id="spandesc"><h1 class="x1ll2q23 x1a4oops x132q4wb">Job Description:

Big Data Engineer (PySpark / Spark / Kafka)<br/></h1><p class="x12ofw9d"></p><div><b>Work Mode:</b> Hybrid ? 3 Days a Week in Office<br/></div><p></p><h2 class="x1ll2q23 x1a4oops x132q4wb">Job Overview<br/></h2><p class="x12ofw9d">We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.<br/></p><h2 class="x1ll2q23 x1a4oops x132q4wb">Key Responsibilities<br/></h2><ul class="x12ofw9d"><li>Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.<br/></li><li>Build and maintain batch and real-time data processing solutions.<br/></li><li>Develop and support Kafka-based streaming applications and event-driven architectures.<br/></li><li>Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.<br/></li><li>Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.<br/></li><li>Implement data ingestion solutions from databases, APIs, files, and streaming sources.<br/></li><li>Monitor, troubleshoot, and enhance the performance of Spar