Senior Cybersecurity Data Engineer – Azure

Обязанности: Design, implement, improve, and support data flows and data-related technologies for analytics initiatives., Build and maintain data pipelines and data buses that collect information from disparate internal and external sources., Transport and deliver data to data warehouses and data lakes in the required format., Apply advanced data manipulation techniques to ensure data availability and usability throughout data flows., Ensure data quality, security, and compliance in line with regulatory and system requirements., Provide ongoing technical support to stakeholders within and outside the science and analytics environment., Implement data governance controls, including lineage, metadata, data quality rules, access controls, and retention policies.

Опыт: At least 5 years of experience in data engineering., Experience deploying complex cloud data and big data systems., Experience applying data engineering methods within the cybersecurity domain., Proven ability to design, build, and maintain data pipelines and ETL workflows across disparate datasets., Experience with Azure Data Factory, Azure Databricks, Azure Functions, Azure Logic Apps, Azure Monitor, Azure Log Analytics, Azure Data Lake Store, S3, Synapse Analytics, and/or Power BI., Practical knowledge of Azure DevOps, Bash or PowerShell, Azure CLI, Python, Spark, SQL, Kusto Query Language, Git, and CI/CD systems., Advanced understanding of data transport, data pipelining, data cleansing, and data quality method