Descrizione
What success looks like in this role: We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data platforms and data processing pipelines. The ideal candidate will have strong expertise in Python, PySpark, AWS, DynamoDB, and OpenSearch , along with exposure to Java . This role requires hands-on experience building cloud-native big data solutions, optimizing large-scale data processing workloads, and enabling data-driven decision-making across the organization.
Key
Responsibilities
Design, develop, and maintain large-scale data pipelines using Python and PySpark . Build and optimize batch and near real-time data processing solutions. Design scalable data architectures on AWS .
Develop ETL/ELT workflows for ingesting, transforming, and publishing datasets. Work with structured and semi-structured data from multiple sources. Design and maintain NoSQL database solutions using DynamoDB .
Implement search and analytics solutions using OpenSearch . Optimize data processing jobs for performance, scalability, and cost efficiency. Collaborate with product teams, architects, and software engineers to define data requirements.
Monitor, troubleshoot, and resolve data platform and pipeline issues. Implement data quality, governance, security, and observability best practices. Participate in code reviews and mentor junior engineers.
Required Technical Skills Data Engineering Strong expertise in Python . Extensive experience with PySpark and distributed da
Descrizione completa, azienda e link per candidarti: dopo l'accesso.
AccediI contatti del datore di lavoro (email/telefono/telegram) sono nascosti nell'anteprima pubblica.
Invia il tuo CV così i datori di lavoro possono contattarti direttamente.