Senior LLM Inference Engineer / AI Infrastructure Architect - 20159

Stack

Free. Sign in with email.

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

Veritaz is a leading IT staffing solutions provider in Sweden, committed to advancing individual careers and aiding employers in ensuring the perfect talent fit. With a proven track record of successful partnerships with top companies, we have rapidly grown our presence in the USA, Europe, and Sweden as a dependable and trusted resource within the IT industry. Job Overview Role Summary An experienced Senior LLM Inference Engineer / AI Infrastructure Architect Key Responsibilities Analyze existing LLM-powered applications and agent workflows to identify performance bottlenecks, resource constraints, and cost drivers. Optimize inference performance with respect to token usage, response times, concurrency, GPU memory utilization, and overall service capacity. Evaluate model selection, including the use of smaller models for less complex tasks where appropriate. Assess and implement inference optimization techniques such as prompt caching, batching, and quantization. Conduct performance measurement, load testing, and capacity planning for AI services. Compare operating models including model APIs, self-hosted cloud deployments, on-premises infrastructure, and hybrid alternatives. Develop a concrete decision basis for future operating strategy, including recommendations for GPU capacity, scaling approaches, and economically viable usage-volume thresholds. Document findings, implemented improvements, and technical recommendations, and transfer knowledge to the development team. Te

Full description, company and the link to apply — after you sign in. Sign in

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.