Louisa Crawford
December 17, 2024 14:48
NVIDIA’s Jetson Orin Nano developer kit has been significantly upgraded, delivering up to 1.7x better performance for generative AI applications at an affordable price.
NVIDIA has announced a significant upgrade to the Jetson Orin Nano Developer Kit, now rebranded as the Jetson Orin Nano Super Developer Kit. This update is designed to improve the performance of generative AI applications, giving developers powerful tools for deploying advanced models. According to NVIDIA, the new kit delivers up to 1.7x better performance and is available for a discounted price of $249.
Key upgrades and features
The Jetson Orin Nano Super Developer Kit boasts several improvements over its predecessor, including an increase in sparse TOPS from 40 to 67 and an increase in memory bandwidth from 65 GB/s to 102 GB/s. The CPU clock speed has also been improved from 1.5GHz to 1.7GHz. These improvements are made possible through new power modes that improve performance of GPU, CPU, and memory.
Developers can upgrade their existing Jetson Orin Nano Developer Kit to the new Super version through a simple software update. This upgrade enables the kit to handle a wide range of large language models (LLMs), visual language models (VLMs), and vision transducers (ViTs) containing up to 8 billion parameters.
Improved AI model performance
The Jetson Orin Nano Super Developer Kit supports a variety of machine learning frameworks such as HuggingFace Transformers and NVIDIA TensorRT-LLM, making it an ideal choice for deploying scalable solutions across cloud, edge, and PC environments. The kit’s new features allow you to run the latest Transformer-based models and improve generative AI performance by up to 70%.
Benchmark tests show significant performance gains across popular LLMs and VLMs, with models such as Llama 3.1 8B and Qwen2.5 7B showing improvements of 1.37x and 1.53x, respectively. ViT can also benefit from upgrades with models such as Clip-vit-base-patch32, which achieves a 1.60x performance increase.
Applications and Use Cases
The enhanced features of the Jetson Orin Nano Super Developer Kit make it well-suited for a variety of applications, from robotics to multi-mode agents. NVIDIA’s Jetson AI Lab provides a platform for developers to explore these possibilities, providing tutorials and pre-built containers for generative AI projects.
NVIDIA has partnered with Hugging Face to accelerate robotics research on the LeRobot platform running on the Jetson Orin Nano super developer kit. Developers can also use the kit to create generative AI chatbots, leveraging open source interfaces such as Open WebUI.
future prospects
In addition to the Jetson Orin Nano series, NVIDIA is also improving the performance of the Jetson Orin NX series. Both series now offer enhanced compute capabilities essential for running generative AI models on edge devices. NVIDIA is extending the life cycle of Jetson Orin through 2032, ensuring long-term support for this powerful platform.
With these advancements, NVIDIA continues to pave the way for innovation in generative AI and edge computing, giving developers the tools they need to solve real-world problems.
Image source: Shutterstock