We use technical cookies and visit statistics: Yandex Metrica and Zorky's own de-identified visit log (cookie zk_aid). We never collect form contents, search text or full IP addresses, and never sell data. Opt out with the button below, or with Global Privacy Control or Do Not Track in your browser. More about cookies and statistics.
Zorky CRMZorky CRM
EN|RU
@termdocs
← All jobs

Staff Inference Engineer

principal~$16.4K /moNew York, USScore 81.5/1003d ago
Market insights
📊 DevOps / SRE: salaries and demand on the market
Stack
c++cloudgrafanallmprometheuspythonpytorchtritonvllm
Apply
Upload your CV — we will connect you with the employer directly through our pool.
Send your CV →
Description
Uniphore is the Business AI company. Our sovereign, composable and secure AI platform connects enterprise data, fine-tunes AI models and deploys agentic AI across the enterprise. We empower every worker to boost productivity and help businesses grow faster, operate smarter and reduce costs. Trusted by more than 2,000 businesses globally, and recognized on the Deloitte Fast 500, Uniphore delivers on the promise of AI as a transformative force for business. Job Description: Staff Inference Engineer – Uniphore is building an enterprise AI pla4orm where agents operate across voice, video, text, and structured data in real time. We are looking for a Senior or Staff Inference Engineer to own the inference layer — combining deep model inference expertise with systems engineering to deliver a context-aware runtime serving finetuned SLMs across cloud, on-premises, and widely used GPU platforms. This is a hands-on individual contributor role working closely with Uniphore’s research, model engineering, knowledge systems, agent, and pla4orm teams. What You Will Build Context-aware runtime: Integrate context selection, compression, conversation compaction, and persistent task state with model execution. Adapt context budgets, model selection, and reasoning effort to each task. KV-cache and computation optimization: Build paged KV-cache and prompt-prefix-cache management, cache-aware routing, retention, eviction, and offloading. Preserve correctness as context, permissions, model versions,
Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.
Urgent question? Message @termdocs