Architect and scale high-throughput, low-latency API gateways powering enterprise AI model inference
Own end-to-end backend development across Go/Python microservices, GPU orchestration, and open-source inference engines
About the company
As an innovative leader in artificial intelligence infrastructure, this organization builds developer-first platforms that simplify access to foundation models. The company is committed to advancing scalable cloud-native technologies, empowering global enterprises to deploy reliable AI applications seamlessly.
About the job
Architecting and evolving a fault-tolerant, secure backend platform that serves enterprise AI inference workloads at scale
Building core platform services including unified API protocol layers, identity and access management, dynamic request routing, and usage metering/billing engines
Designing seamless technical integrations to connect the inference platform with diverse enterprise client environments
Implementing deep system observability while continuously optimizing service latency, compute efficiency, and overall platform reliability
Evaluating and integrating emerging open-source AI inference technologies into production workflows to elevate system throughput
Driving full-lifecycle software delivery—from architectural design and automated testing to production rollout and root cause incident analysis
Skills and experience required
Master's or Ph