Beschreibung
What success looks like in this role: We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data platforms and data processing pipelines. The ideal candidate will have strong expertise in Python, PySpark, AWS, DynamoDB, and OpenSearch , along with exposure to Java . This role requires hands-on experience building cloud-native big data solutions, optimizing large-scale data processing workloads, and enabling data-driven decision-making across the organization.
Key
Responsibilities
Design, develop, and maintain large-scale data pipelines using Python and PySpark . Build and optimize batch and near real-time data processing solutions. Design scalable data architectures on AWS .
Develop ETL/ELT workflows for ingesting, transforming, and publishing datasets. Work with structured and semi-structured data from multiple sources. Design and maintain NoSQL database solutions using DynamoDB .
Implement search and analytics solutions using OpenSearch . Optimize data processing jobs for performance, scalability, and cost efficiency. Collaborate with product teams, architects, and software engineers to define data requirements.
Monitor, troubleshoot, and resolve data platform and pipeline issues. Implement data quality, governance, security, and observability best practices. Participate in code reviews and mentor junior engineers.
Required Technical Skills Data Engineering Strong expertise in Python . Extensive experience with PySpark and distributed da
Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung.
AnmeldenKontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet.
Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.