Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)

Analisi del mercato

Stack

Dettagli

Gratis, dopo l'accesso.

Candidati

Carica il tuo CV: datori di lavoro e recruiter di diversi paesi che cercano il tuo profilo potranno contattarti direttamente.

Descrizione

We connect talented freelancers with cutting-edge projects, offering a platform for you to showcase your expertise and thrive in a collaborative environment. Currently we are looking for a Senior Data Engineer with architect skills to join an environmental monitoring platform for industry. You'll take over a working proof of concept of a streaming IoT measurement pipeline on Azure and bring it to production – from edge devices, through the raw layer, to read-optimised data and rollups in Azure Data Explorer. Location: Remote/Warsaw Office Salary (PLN): 160-200 net + VAT (B2B) Start: November What will you do? • Take over the PoC and bring it to production – the data semantics are already defined, so you can focus on the pipeline. • Build the stream processor from Event Hubs to Azure Data Explorer. • Design and schedule the cascade of rollups and time-window aggregations. • Implement reprocessing of data after configuration changes. • Model and optimise ADX tables, update policies, materialized views, retention policies and queries for large data volumes. • Work closely with our PM, our ADX specialist, the client's engineering team and our DevOps. What we're looking for: Must-have: • At least 2–3 data pipeline projects taken from zero to production in the role of architect or lead data engineer, with Azure Data Explorer in production in at least one of them. Experience: • Senior experience in data engineering (around 5+ years), including IoT streams and time-series data • Broa

Descrizione completa, azienda e link per candidarti: dopo l'accesso. Accedi

I contatti del datore di lavoro (email/telefono/telegram) sono nascosti nell'anteprima pubblica. Invia il tuo CV così i datori di lavoro possono contattarti direttamente.