Azure Databricks Engineer
- Employment
- Full-time
- Experience
- 8+ years
- English
- C1, required
- Practices
- DevOps
- Education
- Bachelor's degree
- To apply
- background check
Build batch and real-time data solutions in Azure Databricks (Delta Lake, PySpark, Kafka) for a leading global investment bank. Hybrid in Kraków; 135–160 PLN/h (B2B). Azure Databricks Engineer About the Offer We are currently looking for an Azure Databricks Engineer to join the team of one of the world's leading global investment banks.
The project is delivered together with a large international IT services company. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us. You will design and build big data solutions in Azure Databricks for batch and real-time analytics, working with Delta Lake, PySpark, Kafka streaming and the Lakehouse / Medallion architecture.
Key Details: Rate: 135–160 PLN/h (B2B), depending on experience Work Model: Hybrid, 3 days per week from the client's office (non-negotiable), full-time Location: Kraków (candidates must live in or near Kraków)
Design and implement big data solutions in Azure Databricks for batch and real-time analytics use cases Build Spark pipelines that populate downstream data marts for BI and generate feeds for Data Science Integrate real-time services that process business events from Kafka and persist them in ADLS Gen2 using Databricks Develop near real-time stream processing to derive features for ML model inference Optimise Databricks performance (liquid clustering, vacuum, Z-ordering etc.) Work with DevOps teams to drive operati