Lead Research Engineer – AI Evaluation & Benchmarking

Análisis del mercado

Stack

Detalles

Gratis, tras iniciar sesión.

Postular

Sube tu CV: empleadores y reclutadores de distintos países que buscan tu perfil podrán contactarte directamente.

Descripción

Job Description Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language models (LLMs), measure quality, cost, and latency, and make informed decisions about model selection and development. You will own the engineering approach from early prototypes through reliable, maintainable tools, collaborating closely with research scientists, engineering teams, and product partners while helping shape technical direction and engineering delivery. Key Responsibilities Lead technical delivery and engineering planning: Partner with program and research leaders to define priorities, break projects into delivery stages, estimate effort and cost, recommend staffing and required skills, identify dependencies, and adapt plans to available resources. Design and build scalable evaluation infrastructure: Extend existing shared tools and services, design new components where needed, and develop production-quality Python software, APIs, and reusable evaluation frameworks. Deliver useful initial versions, validate them with users, and improve them through iterative development. Turn research methods into working software: Collaborate with scientists to build automated evaluation pipelines connecting model APIs, test datasets, and agreed scoring methods. Imp

Descripción completa, empresa y enlace para postular: después de iniciar sesión. Iniciar sesión

Los contactos del empleador (correo/teléfono/telegram) están ocultos en la vista previa pública. Envía tu CV para que los empleadores puedan contactarte directamente.