FBS - Elasticsearch Data Engineer (Medallion Architecture)
- Doświadczenie
- od 5 lat
- Angielski
- C1, wymagany
Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees.
Finally, our Client is part of one the largest Insurance Groups in the world.
The Data Engineer will architect, develop, and maintain scalable data pipelines within a medallion architecture (bronze, silver/base vault, business vault, gold layers). This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.
- Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.
- Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
- Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge)
BS in Computer Science, Data Engineering (Big Data,