You will be responsible for operating and evolving SP Group’s enterprise Data & AI platform to support mission-critical analytics, regulatory compliance, and AI-driven innovation. This role focuses on ensuring the platform is scalable, reliable, secure, and performant, while enabling data engineers, scientist and analysts to deliver business value efficiently. What You'll Do Ensure high availability and reliability of the enterprise data platform (Cloudera and Talend Big Data).
Deliver scalable and performant data infrastructure supporting batch and near real-time workloads. Enable secure and compliant data operations aligned with enterprise and regulatory requirements. Improve platform automation and operational efficiency through DevOps and Infrastructure-as-Code.
Provide strong platform support and partnership to data engineering, analytics, and business teams. Data Platform Engineering & Operations Design, deploy, and manage large-scale data platform environments (primarily Cloudera and Talend Big Data). Operate and optimize Hadoop ecosystem components (HDFS, Hive, Spark, H
Base, Impala, Iceberg, Ozone). Manage cluster lifecycle including provisioning, scaling, patching, and upgrades. Ensure platform uptime, stability, and service reliability through proactive monitoring and maintenance.
Performance, Scalability & Capacity Management Monitor workload performance and optimize data processing efficiency. Perform capacity planning to support increasing data volumes and usage.