Обязанности: Build and maintain a Snowflake-based evaluation pipeline to measure the accuracy of new datasets, both independently and combined with existing data., Implement evaluation metrics such as correlation and mean absolute error (MAE) to compare estimated company revenue against reported results., Optimise Snowflake performance and compute costs through warehouse sizing, clustering, materialisation, query optimisation, and data pruning., Develop automated processes for collecting, mapping, validating, and maintaining ground truth company revenue data., Implement data quality checks, reconciliation rules, and monitoring to identify inconsistencies before they affect downstream reporting., Evaluate new datasets as they become available and investigate data quality issues., Own the pipeline end-to-end, making technical decisions and adapting the implementation as project requirements evolve., Build on existing prototypes and previous work to deliver a reliable, production-ready solution.
Опыт: Ability to work partially within the U.S. time zone (during onboarding: calls up to 10:00 PM CET a few times a week; later: up to 5/6/7 PM CET), 6+ years of experience in Data Engineering, with Snowflake as a primary data platform., Proven hands-on experience optimising Snowflake warehouses and storage for performance and cost efficiency in production environments., Experience building and optimising pipelines processing very large datasets, including full transaction-level histori