NVIDIA's Jetson Orin Nano Super: A Palm-Sized AI Powerhouse Revolutionizing Edge Computing

Word on the StreetTuesday, Dec 17, 2024 3:00 pm ET
1min read

NVIDIA has unveiled its latest innovation, the Jetson Orin Nano Super, a generative AI supercomputer priced at $249. Measuring compact enough to fit in the palm of one's hand, this device marks a significant leap in affordable AI technology. NVIDIA CEO Jensen Huang emphasized that through software advancements, this developer kit has significantly uplifted AI performance by up to 1.7 times compared to previous models.

This new offering is designed for a broad audience of commercial AI developers, hobbyists, and students. The Jetson Orin Nano Super demonstrates a remarkable 70% performance increase over its predecessor while maintaining a competitive price point. It boasts an impressive capability of executing up to 67 trillion INT8 operations per second, with a 50% improvement in memory bandwidth reaching 102GB/s.

Suitability for diverse AI applications is a highlight of this new device. From building large language model chatbots using Retrieval-Augmented Generation (RAG) techniques to enabling vision AI agents and AI-powered robotics, the Orin Nano Super is engineered to deliver robust computational power at a reduced cost. Its efficient design supports low power requirements ranging from 7 to 25 watts, making it ideal for various edge-device and cloud-computing scenarios such as smart cities, smart agriculture, and robotics development.

Beyond its hardware capacities, NVIDIA continues to bolster the generative AI ecosystem through comprehensive community support and an expansive suite of AI software. The Jetson platform supports NVIDIA's own AI tools, such as NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI, and NVIDIA Holoscan for sensor processing, collaboratively enhancing the efficiency of AI model deployment and development.

The Jetson Orin Nano Super is anticipated to be available via global distributors soon, providing an accessible entry point into AI development for students, engineers, and creators. By positioning the Jetson Orin Nano Super Developer Kit as a pivotal product, NVIDIA aims to expand AI's reach into industries like intelligent transportation, retail management, and IoT applications.