Nova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of Samba
Nova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into Samba
Rack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value.
We take frontier open-weight models (dense, mixture-of-experts with hundreds of experts, hybrid Mamba/attention, sliding-window attention, multi-token prediction) from Hugging Face to production serving on Samba
Nova's RDU dataflow accelerators. That means compiling them, proving them numerically correct against the reference, serving them with the full feature set, and merging the work into a shared stack so the next model is cheaper.
You will bring new open-weight LLMs, including dense, mixture-of-experts, and hybrid Mamba/attention architectures, up on Samba
Nova’s RDU dataflow accelerators and into production serving. That means adapting the model, mapping it across chips and hosts, compiling it, and validating it numerically against the reference. You also build inference features like continuous batching, speculative decoding, and FP8/FP4 as sh