Member of Technical Staff, Agents

Join a small, senior team building autonomous AI agents that handle real executive workflows. You will develop agent capabilities and the evaluation systems needed to verify reliability before changes reach users.

• Build agents that complete delegated work end to end without requiring users to check every step.
• Design reliable measures of agent success and maintain representative evaluations for real-world tasks.
• Develop new agent capabilities for tools executives already use, and verify their readiness before launch.
• Investigate production failures, identify root causes, and deliver fixes that prevent recurrence.
• Build scalable failure detection for known issues and unexpected patterns using evaluation and monitoring tools.
• Improve agent recovery when a tool or website fails.
• Create repeatable workflows so engineers can measure whether agent changes improve performance.

• At least 3 years in data science or machine learning roles building or delivering evaluation systems, metrics, or product quality measurement.
• Production-level Python and SQL skills for analysis, large datasets, and automated pipelines.
• Experience designing evaluation frameworks, including success criteria, representative datasets, appropriate metrics, and trustworthy benchmarks.
• Experience using statistics, experiment design, and realistic end-to-end simulations to evaluate agent changes.
• Background building or operating agents for real users