Senior Software Engineer

What You’ll Do: Inference Platform Team The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsible for request routing, scheduling, GPU resource management, and system-wide optimizations that drive performance, efficiency, and reliability across real-time inference systems.

As a Senior Software Engineer on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple services and teams. Your day-to-day will involve leading cross-team design initiatives, optimizing inference performance (latency, throughput, and GPU utilization), and improving system reliability at scale. You will work deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization.

This role requires hands-on technical leadership and the ability to influence engineering direction across the organization. Who You Are: 5-8+ years of experience building and operating large-scale distributed systems or cloud platforms Proven experience leading cross-team technical initiatives impacting multiple services or organizations Strong programming skills in Go, Python, or C++ Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design Strong understanding of distributed systems, networking, and performance opti