This role is not open to visa sponsorship or transfer of visa sponsorship including those on H1-B, F-1, OPT, STEM-OPT, or TN visa, nor is it available to work corp-to-corp.
For the Allconnect website click here. Curious how Allconnect fits into Red Ventures? Click here.
As a Staff Data Engineer at AllConnect, you'll own the design and modernization of our Databricks environments, working with multiple engineering teams and with technical stakeholders inside and outside AllConnect. You'll also build the AI/ML data infrastructure, from feature stores to LLM-ready pipelines, that gives ML engineering teams reliable, governed and cost-efficient model inputs at scale.
What You’ll Do:
Drive technical design with internal and external AllConnect stakeholders, turning their needs into clear architecture decisions
Lead the development and modernization of Databricks environments across multiple teams
Design and operate AI/ML data infrastructure, including feature stores and vector databases
Build LLM-ready pipelines covering embedding generation, retrieval and RAG data flows, and training-data versioning
Partner with ML engineering teams to deliver governed, reliable and cost-efficient model inputs at scale
Establish data governance, data quality and observability standards across pipelines, including access controls and PII protections
Drive platform-level cost optimization and DevOps practices, including CI/CD automation and data contracts between producers and consumers