Databricks Data Engineer

Markteinblicke

Stack

Details

Kostenlos, nach der Anmeldung.

Bewerben

Laden Sie Ihren Lebenslauf hoch — Arbeitgeber und Recruiter aus verschiedenen Ländern, die Ihr Profil suchen, können Sie direkt kontaktieren.

Beschreibung

Key Responsibilities Design, build, and operate end-to-end data pipelines (ingestion → transformation → serving) on Databricks and/or Snowflake, following medallion/layered architecture patterns Configure and administer workspaces/accounts — compute policies, resource sizing, environment setup, and access hierarchy — per the SDP reference architecture Implement data governance controls: catalogue and schema design, RBAC, row/column-level security, data masking, and lineage tracking Set up CI/CD and infrastructure-as-code for pipeline deployment and environment promotion (dev → test → prod) Configure monitoring, telemetry, and audit logging to meet SDP's central observability and security posture requirements Support UAT, integration testing, and parallel-run validation during migration and go-live Produce handover documentation (runbooks, access lists, escalation procedures) for agency operations teams Work directly with client, agency stakeholders, and Principal (Databricks/Snowflake) solution architects throughout delivery Required Technical Skills — Databricks Unity Catalog — catalogue/schema design, access control, and data lineage Lakeflow / Delta Live Tables for pipeline orchestration; Delta Lake table format Databricks SQL and cluster/workspace administration (compute policies, pools, cost management) Databricks Asset Bundles (DABs) and Databricks Repos for CI/CD PySpark / Spark SQL for large-scale data transformation Working knowledge of Databricks system tables (audi

Vollständige Beschreibung, Unternehmen und Bewerbungslink — nach der Anmeldung. Anmelden

Kontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet. Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.