Databricks Data Developer
- Angielski
- B2, wymagany
- Praktyki
- CI/CD
- Wykształcenie
- Wykształcenie wyższe
Responsibilities We are looking for a Databricks Data Developer who wants to build and optimize scalable data pipelines and data architectures within an international digital commerce ecosystem. You will work on a central Databricks platform supporting both marketplace operations and OBI's own retail business , ensuring seamless data integration across both areas. You will contribute to the data engineering foundation of an international e-commerce platform operating across 8 countries , collaborating with Digital Business, Analytics, Product Management, and IT teams.
Your key responsibilities will include: Design, develop, and maintain scalable, production-grade ETL/ELT pipelines and data models processing high-volume e-commerce, marketplace, retail, and tracking data. Build and optimize data engineering solutions on Databricks and Apache Spark , using Python, PySpark, Scala, and SQL as appropriate. Implement and maintain Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog, Databricks Workflows, and Structured Streaming.
Develop robust data models that integrate marketplace and retail data, ensuring data consistency, quality, and availability across business domains. Automate complex data preparation and transformation processes to enable reliable data delivery and self-service analytics. Optimize, monitor, and troubleshoot distributed data jobs, ensuring pipeline performance, reliability, and scalability.
Integrate data pipelines with downstream