NVIDIA releases Nemotron 3 Ultra: a 550B open-weight MoE built to orchestrate long-running agents
NVIDIA shipped Nemotron 3 Ultra as open weights: a roughly 550B-parameter mixture-of-experts model with about 55B active parameters per token, a hybrid Mamba-Transformer backbone and up to 1M context, trained with NeMo RL/Gym and a Multi-Teacher On-Policy Distillation loop over many specialist teachers.
It is aimed at the hard calls inside an agent trace — long-horizon planning, tool calling, verification — rather than single-turn chat. NVIDIA claims 5x higher throughput than comparable open models and up to 30% lower cost on agentic tasks, with weights and recipes on Hugging Face, ModelScope, OpenRouter and build.nvidia.com. Artificial Analysis scored it 48 on its Intelligence Index, the strongest US open-weight model to date, though still under Chinese open models such as Kimi K2.6 at 54.

WHY IT MATTERS
If you self-host agent stacks, the open-weight frontier moved this week: an explicitly agent-shaped MoE you can run behind NIM or vLLM, shipping with its fine-tuning recipes and RL tasks.
