NVIDIA

NVIDIA Announces Nemotron 3 Open Models and Unsloth Optimization for GPU Fine-Tuning


Executive Summary

NVIDIA has announced a collaboration with the Unsloth open-source framework to accelerate and simplify the fine-tuning of Large Language Models (LLMs) on its hardware, from RTX AI PCs to DGX Spark. Coinciding with this, NVIDIA is releasing its new Nemotron 3 family of open models, starting with Nemotron 3 Nano, which is designed for efficient agentic AI fine-tuning. The initiative aims to make customized AI model development more accessible and performant for developers by providing optimized software and powerful new base models.

Key Takeaways

* Unsloth Framework Optimization: The Unsloth framework is now optimized for NVIDIA GPUs, boosting the performance of Hugging Face transformers library training by 2.5x while reducing VRAM consumption.

* Launch of Nemotron 3 Models: NVIDIA introduced a new family of open models: Nemotron 3 Nano, Super, and Ultra, built on a hybrid Mixture-of-Experts (MoE) architecture.

* Nemotron 3 Nano Availability: The Nemotron 3 Nano 30B-A3B model is available now on Hugging Face. It is optimized for tasks like software debugging and AI assistant workflows, featuring a 1 million-token context window and up to 60% fewer reasoning tokens.

* Hardware Enablement: The announcement highlights the suitability of NVIDIA hardware for these tasks, including GeForce RTX desktops/laptops for accessible fine-tuning and the DGX Spark compact supercomputer for larger models (>30B parameters) and advanced techniques.

* Future Models: The higher-accuracy Nemotron 3 Super and Ultra models are planned for release in the first half of 2026.

Strategic Importance

This announcement strengthens NVIDIA's AI ecosystem by moving beyond hardware to provide optimized open-source tools and proprietary open models. This lowers the barrier for developers to build on the NVIDIA platform, encouraging the entire AI development lifecycle to occur on its hardware, from local PCs to supercomputers.

Original article