Senior Data Engineer with Python and Databricks

Markteinblicke

Stack

Details

Kostenlos, nach der Anmeldung.

Bewerben

Laden Sie Ihren Lebenslauf hoch — Arbeitgeber und Recruiter aus verschiedenen Ländern, die Ihr Profil suchen, können Sie direkt kontaktieren.

Beschreibung

Work together with data scientists and analysts to understand the needs for data and create effective data pipelines Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Databricks/Spark, Polars/Pandas, Fabric Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data. Требования: Proficient in Python and SQL Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling. Strong experience with Relational and ideally NoSQL databases. Strong understanding of ETL/ELT processes. Exposure to data monitoring and observability tools. Relevant experience with Event-Driven Architecture Good understanding of Agile ways of working

Unternehmen und Bewerbungslink — nach der Anmeldung. Anmelden

Kontaktdaten des Arbeitgebers (E-Mail/Telefon/Telegram) sind in der öffentlichen Vorschau ausgeblendet. Senden Sie Ihren Lebenslauf — dann können Arbeitgeber Sie direkt kontaktieren.