Inference Performance Engineer

Стек

Откликнуться

Загрузите резюме — мы свяжем вас с работодателем напрямую через нашу базу.

Описание

About the role Serving frontier models at scale requires solving novel systems problems at every layer of the stack. As an Inference Performance Engineer, you'll own the runtime that turns accelerators into a production serving system, optimizing throughput, latency, and cost across thousands of nodes. You'll work alongside hardware and compiler teams operating at the frontier of AI silicon design. What you'll do Build and improve the inference runtime Design scheduling, continuous batching, KV cache, and prefill/decode disaggregation Implement low-precision kernels and speculative decoding Drive throughput, latency, and cost per token Collaborate with hardware teams on kernels, operators, and graph optimizations Own the OpenAI-compatible API surface and serving protocol Build benchmarking, profiling, and regression infrastructure cpp, or custom runtimes GPU or ASIC programming experience: CUDA, ROCm, Triton, or vendor-native toolchains Experience with low-precision inference (FP8, FP4, INT4) Profiling and benchmarking experience: Nsight, perf, custom harnesses What we offer Top-tier compensation structured to recognize and retain the best talent Meaningful equity Comprehensive medical, dental, vision, life, and disability insurance Parental leave for all new parents, including adoptive and surrogate journeys Flexible PTO Paid Holidays Relocation support Equal Employment Opportunity We're an Equal Opportunity Employer and do not discriminate on the basis of any protected status under applicable law.

Контакты работодателя (email/phone/telegram) скрыты из публичного превью — отправьте резюме, чтобы мы связали вас напрямую.