← Todas as vagas21. Data Engineer (Senior) - KT
Senior7.000 SGD · período não informadoSingapore, SGhoje
Detalhes
- Experiência
- 5+ anos
- Práticas
- CI/CD
Candidatar-se
Envie seu currículo: empregadores e recrutadores de vários países que procuram o seu perfil poderão falar com você diretamente.
Enviar seu currículo →Descrição
Mandatory
Requirements
- 5–8 years of data engineering experience, including building and deploying large-scale data systems • Strong hands-on experience designing batch and streaming pipelines using Apache Spark, Apache Flink and Apache Kafka • Proficiency in Java or Scala for distributed data processing, together with SQL • Experience deploying and scaling data workloads in containerised Kubernetes environments • Experience with S3-compatible object storage, data-quality controls, schema and lineage management, checkpointing and recovery, GitLab and CI/CD practices Preferred
Requirements
- Experience working within the SAFe framework • Experience developing data solutions for safety-critical and mission-critical systems • Experience with MinIO or equivalent S3-compatible object storage; schema and lineage design; data-quality checks; metadata preservation; bronze/silver/gold layered processing; and data-integrity controls including erasure coding, checksums, bit-rot protection, background healing and strong consistency • Experience implementing checkpointing and recovery across hot and cold reboots, retention and lifecycle controls for the contracted retention period, high availability, backup and recovery, and operational/disaster-recovery deployment with inter-site synchronisation Equivalent Technologies • Equivalent large-scale batch or stream-processing frameworks may be considered where the candidate demonstrates transferable distributed-data-system experience; Apache
Descrição completa, empresa e link para se candidatar: depois de entrar.
EntrarOs contatos do empregador (e-mail/telefone/telegram) ficam ocultos na prévia pública.
Envie seu currículo para que os empregadores possam falar com você diretamente.