Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years

Job Title: AI Engineer / Generative AI Engineer Location: Los Angeles, CA (Hybrid) Duration: 3+ Months (Extension Possible) Experience: 15+ Years Job Summary We are seeking a hands-on AI Engineer with expertise in Python, Agentic AI, AWS Bedrock Agent

Core, and LLM evaluation to build, deploy, monitor, and continuously improve production-grade AI agents. Key

Develop AI agents using Python and Claude Agent SDK. Deploy agents using AWS Bedrock Agent

Core Runtime. Design golden datasets and implement LLM-as-a-Judge evaluations. Integrate automated evaluations into CI/CD pipelines as quality gates.

Implement Langfuse/OpenTelemetry for AI observability and tracing. Evaluate agent accuracy, task completion, tool execution, and performance. Support RAG pipelines and AWS data processing workflows.

Required Skills Python and Agentic AI development. AWS Bedrock Agent

Core Evaluations / Bedrock evaluation. Golden-dataset design and curation. LLM-as-a-Judge design and calibration against human labels.

Automated evaluation and CI gate integration. Langfuse and/or OpenTelemetry. Good to Have RAGAS or equivalent evaluation frameworks.

Trajectory evaluation and agentic red-teaming. Bedrock Guardrails, Strands Agents SDK, and GitHub Actions.

6–8+ years of software engineering, cloud engineering, or AI/ML experience. Hands-on experience with production AI agents and continuous evaluation. Strong problem-solving and troubleshooting skills.