Описание
Description: Remote Our client seeks a data engineer to collaborate with cross-functional teams and own systems, processes, and the tech stack across the SDLC.
The role
focuses on building and optimizing scalable data pipelines across Azure and GCP, implementing feature engineering for machine learning with Python and Vertex AI, and ensuring quality through automated testing and CI/CD. The engineer will modernize and extend data assets across SQL, NoSQL, and streaming platforms while documenting architectures and interfaces. We can facilitate w2 and corp-to-corp consultants.
For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. 00/hr. w2
Responsibilities
Design, build, and maintain scalable and reliable data pipelines for ingestion, transformation, and integration using tools such as Kafka and Databricks. Leverage innovative technologies to modernize and extend core data assets across SQL, NoSQL, cloud, and real-time streaming platforms. Develop and manage feature engineering pipelines for machine learning using Vertex AI, BigQuery ML, and Python.
Design and implement automated unit, integration, and performance testing frameworks to ensure data quality and reliability. Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments. Draft and review architectural diagrams, interface specification
Контакты работодателя (email/phone/telegram) скрыты из публичного превью —
отправьте резюме, чтобы мы связали вас напрямую.