Opis
Key
Responsibilities
Design, build, and operate end-to-end data pipelines (ingestion → transformation → serving) on Databricks and/or Snowflake, following medallion/layered architecture patterns Configure and administer workspaces/accounts — compute policies, resource sizing, environment setup, and access hierarchy — per the SDP reference architecture Implement data governance controls: catalogue and schema design, RBAC, row/column-level security, data masking, and lineage tracking Set up CI/CD and infrastructure-as-code for pipeline deployment and environment promotion (dev → test → prod) Configure monitoring, telemetry, and audit logging to meet SDP's central observability and security posture requirements Support UAT, integration testing, and parallel-run validation during migration and go-live Produce handover documentation (runbooks, access lists, escalation procedures) for agency operations teams Work directly with client, agency stakeholders, and Principal (Databricks/Snowflake) solution architects throughout delivery Required Technical Skills — Snowflake Virtual warehouse sizing, scaling, and cost/performance tuning Snowpipe and Snowpipe Streaming for continuous ingestion Snowpark (Python/Scala) for in-warehouse data engineering Role-based access control (RBAC), secure data sharing, and object tagging for governance Query profiling and performance optimization (clustering keys, materialized views, caching) Time Travel, zero-copy cloning, and Snowflake's native data pr
Pełny opis, firma i link do aplikacji — po zalogowaniu.
Zaloguj sięKontakty pracodawcy (e-mail/telefon/Telegram) są ukryte w publicznym podglądzie.
Wyślij CV — a pracodawcy będą mogli napisać do Ciebie sami.