Description
Insight Softmax is a leading organization in the fields of machine learning, data science, and high-performance computing (HPC). We are dedicated to providing innovative solutions in computing technology to solve complex problems in various sectors including research, science, manufacturing, finance, and data analytics. Description: We are hiring an AI Engineer for our engineering team.
You will implement the AI platforms and services our architects design and our customers run: inference stacks, AI gateways, RAG and agent systems, and the automation around them. You will work directly inside customer environments, from neoclouds with thousands of GPUs to enterprises deploying their first production LLM service, and on our own platform product work for vendor partners.
The role
is forward-deployed in spirit. You will spend much of your time embedded with a customer team, shipping working systems and leaving behind documentation and automation they can run. Our team requires individuals with focus on delivery and results, hunger to learn, ability to adapt, and can thrive in a self-directed environment where you’ll figure out what’s needed to deliver rather than wait for detailed instructions.
Key
Responsibilities
Deploy and operate LLM inference services on Kubernetes and bare metal GPU clusters, including model serving, autoscaling, GPU scheduling and performance tuning. Build and operate AI gateway and routing layers: tenant keys, model pools, quotas, rate limits, caching,
Description complète, entreprise et lien pour postuler : après connexion.
Se connecterLes contacts de l'employeur (e-mail/téléphone/telegram) sont masqués dans l'aperçu public.
Envoyez votre CV pour que les employeurs puissent vous contacter directement.