Senior Data Engineer (AI Consumer Intelligence Platform)

Market insights

Stack

Free. Sign in with email.

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

We are a rapidly growing consumer intelligence platform used by leading global brands such as Coca-Cola, Unilever, and Bayer. The Role As a Senior Data Engineer, you'll architect and scale production data pipelines that power our NLP and ML systems processing billions of multilingual data points daily. Reporting to our CTO, you'll own the complete data lifecycle, from ingestion and transformation through deployment and observability, while defining infrastructure standards for a growing engineering team. This is a high-ownership role at an early stage: no legacy code politics and no entrenched hierarchies. You'll convert MVPs into scalable products, establish DataOps/DevOps standards, and design governance mechanisms that prevent technical debt. Your architectural decisions will directly impact how Fortune 500 companies access real-time consumer intelligence. Tech Stack - Core: Python, PySpark, SQL - Cloud & Infrastructure: Azure ecosystem, Databricks - Deployment: Kubernetes, containerization, observability tooling - NLP/ML : Large Language Models, LLM APIs, Spacy/NLTK/CoreNLP/TextBlob - Data: Robust pipelines for multi-language text at scale What You'll Do • Design, build, and maintain production data pipelines processing 10M+ text records daily across multiple languages • Architect scalable NLP data infrastructure using PySpark, Databricks, and Azure services • Integrate Large Language Model APIs into production pipelines for text analysis and enrichment • Establish DataOp

Full description, company and the link to apply — after you sign in. Sign in

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.