Technical Lead Big Data Engineer (AWS) in Softserve
- Experiência
- 5+ anos
- Inglês
- B2, obrigatório
- Práticas
- CI/CD
SoftServe is a global digital services and consulting company with over 30 years of experience and more than 11,000 professionals across 16 countries, helping businesses worldwide solve complex challenges through technology.
Our Data & Analytics Center of Excellence (CoE) brings together data specialists to drive excellence in data, analytics, and business intelligence. We deliver solutions across Data Strategy & Governance, Data Platform Engineering, Data Migration, and Reporting & BI.
In this role, you’ll support and enhance a modern AWS-based data platform, focusing on data ingestion, processing, and platform reliability. You’ll use Python, PySpark, and Apache Spark to maintain and optimize existing data pipelines while collaborating with a distributed engineering team. You’ll work with healthcare data in a regulated environment, and the role includes a three-month business trip to the United States in Q1 2027.
Applications are only received at getonbrd.com.
- Support, maintain, and enhance an existing AWS-based data platform and data ingestion pipelines
- Develop and optimize data processing workflows using Python, PySpark, Apache Spark, and AWS Glue
- Monitor and troubleshoot data pipelines, ensuring reliability, performance, and data quality
- Work with AWS services such as S3, Aurora PostgreSQL, Athena, Lambda, SQS, SNS, and EventBridge
- Maintain and improve workflow orchestration using Apache Airflow
- Support infrastructure and deployment processes using Docker