Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)

Обязанности: Take over the PoC and bring it to production – the data semantics are already defined, so you can focus on the pipeline., Build the stream processor from Event Hubs to Azure Data Explorer., Design and schedule the cascade of rollups and time-window aggregations (raw/Bronze → Silver → aggregates)., Implement reprocessing of data after configuration changes., Model and optimise ADX tables, update policies, materialized views, retention policies and queries for large data volumes., Work closely with our PM, our ADX specialist, the client's engineering team and our DevOps.

Опыт: Must-have:, • At least 2–3 data pipeline projects taken from zero to production in the role of architect or lead data engineer, with Azure Data Explorer in production in at least one of them., Experience:, • Senior experience in data engineering (around 5+ years), including IoT streams and time-series data, • Broad, hands-on experience with Azure data services, , Tech skills:, • Azure Data Explorer (Kusto) and KQL: table modelling, update policies, materialized views, retention policies, query optimisation for large volumes, • Streaming ingestion on Azure: IoT Hub, Event Hubs, parsing functions (e.g. Azure Functions), Blob Storage, • Layered data architecture (raw/Bronze → Silver → aggregates), designing rollups and time-window aggregations, • Python, • Terraform, , Soft skills:, • Independence – you can own a production pipeline end to end without hand-holding, • At least B2 in English – we