Data Engineer - Iceberg/Snowflake
- Experiência
- 5+ anos
- Práticas
- CI/CD
Responsibilities Design, develop, and implement scalable data engineering solutions to support PIPL program requirements. Build and maintain end-to-end ETL/ELT pipelines using Python , SQL , and modern data engineering frameworks. Develop and manage data lakehouse architectures using Apache Iceberg and Snowflake .
Create and support a dedicated China data environment on Alibaba Cloud (AliCloud) for data processing, analytics, machine learning, and reporting workloads. Automate data ingestion, transformation, validation, and reporting processes to improve operational efficiency. Optimize data pipelines, storage, and query performance to ensure scalability and reliability.
Collaborate with architects, program leads, and business stakeholders to gather requirements and deliver data solutions. Monitor, troubleshoot, and resolve data platform and pipeline issues. Contribute to best practices in DataOps, CI/CD, automation Job
Requirements Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline. 5+ years of experience in Data Engineering, Data Warehousing, or Big Data environments. Strong hands-on experience with Apache Iceberg .
Proven experience working with Snowflake for datawarehousing and analytics. Advanced proficiency in Python and SQL development. Experience designing and building ETL/ELT pipelines and data integration solutions.
Solid understanding of data lake, lakehouse, and data warehouse architectures. Experience working wit