Senior AI Platform Engineer

Market insights

Stack

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

We are looking for a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform , a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The role includes standardizing agent development across the organization, implementing advanced agentic evaluation frameworks (using AWS AgentCore), and building robust LLM-as-a-judge and CI/CD deployment gates to reduce development from months to days while enforcing strict security and quality standards. Strong Python skills and deep expertise in LLM evaluation are required, along with experience in cloud infrastructure. Responsibilities Develop and launch scalable conversational AI systems that operate across multiple channels, including chat, voice, email, and APIs Architect microservices and asynchronous systems for AI applications, ensuring high availability and performance Use Python to implement orchestration and decision logic - the control layer that manages tools, workflows, and system interactions Agentic Evaluation & Quality Gates: Design evaluation frameworks for autonomous agents tracking multi-step workflows, tool-calling accuracy, and session performance, integrating automated gates into CI/CD pipelines LLM-as-a-Judge & Testing Pipelines: Establish automated evaluation protocols utilizing LLM-as-a-judge patterns Optimize AI models through fine-tuning and LoRA integration, making data-driven decision

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.