IDC's Data Engineering team is seeking a Senior Engineer, AI/NLP Engineering to lead hands-on delivery of AI-powered data engineering workflows and manage a small team of engineers. This role combines direct people management with deep, current experience operating in governed, agentic development environments and building large-scale natural language processing (NLP) pipelines that make unstructured content AI-ready.You will manage day-to-day delivery, review and direct the work of junior team members, and act as the technical point of contact with specialist stakeholders assessing feasibility, challenging proposals, and negotiating realistic delivery expectations and trade-offs.This is a hands-on management role for someone who can ramp quickly on unfamiliar codebases, exercises sound technical judgment, and is comfortable pushing back rather than overpromising.
What You’ll Do
Manage and direct the day-to-day work of a small team of data engineers, reviewing output alongside personal delivery responsibilities.
Operate extensively within Claude Code and other governed, AI-powered development workflows, applying guardrails such as safe-zone scoping and critically reviewing agent-generated plans.
Build and operate natural language processing (NLP) pipelines at scale that ingest, parse, chunk, embed, and extract metadata/entities from millions of documents, and extract insights via Large Language Models (LLMs) or NLP models.
Ramp quickly o