2026/1/27

Edge AI 2.0 - Bringing Gen AI to Life with ASUS IoT Edge AI Computer built on NVIDIA^® Jetson™

Futuristic image showing a robotic hand touching holographic buttons with 'Generative AI' text. A human head silhouette with gears symbolizes AI.

Edge AI refers to deploying AI algorithms on edge devices rather than relying solely on centralized cloud computing. This approach is integral to AI inference, where trained models generate predictions or insights from new data. Edge AI enhances the application of Gen AI, LLMs, and VLMs by enabling real-time processing and decision-making, particularly in scenarios requiring immediate responses and low latency.

Generative AI refers to a class of algorithms that can generate new content, such as text, images, and audio, based on the data they have been trained on. Large language models (LLMs) such as Gemma 7B/Llama 8B are a subset of Generative AI specifically designed to understand and generate human-like text. These models are trained on vast amounts of text data and use neural networks to comprehend context, grammar, and other nuances. Vision language models (VLMs) such as VILA/LLaVA combine visual and textual information, allowing for tasks such as image captioning and object recognition in images, based on natural-language queries.

A New Trend: Edge AI 2.0

According to NVIDIA, Edge AI 2.0 represents a significant evolution in edge computing, marked by enhanced generalization capabilities powered by foundational VLMs. This trend signifies a shift toward more intelligent and adaptable edge devices capable of understanding complex queries and processing information dynamically. The strength of VLMs lies in their ability to leverage world knowledge acquired during language pre-training, allowing users to interact with AI-powered devices using natural language and eliminating the need for hardcoded vision pipelines. Consequently, these systems can perform complex tasks like event detection and object recognition in real-time, increasing their utility across various applications.

The rise of agentic AI is driving the adoption of small language models (SLMs) for specific tasks. SLMs offer a more efficient and cost-effective alternative to large language models (LLMs). They are particularly well-suited for repetitive, predictable, and highly specialized tasks such as parsing commands, generating structured outputs, and producing summaries. They can also be fine-tuned for strict formatting and behavioral requirements.

ASUS IoT systems powered by NVIDIA^® Jetson Orin^™ Series — AI Inferencing at the Edge

When selecting an edge AI solution, the ASUS IoT systems powered by NVIDIA^® Jetson Orin^™ stand out for several compelling reasons. Its compact form factor allows it to fit seamlessly into various environments, making it ideal for space-constrained applications. The series features effective thermal management solutions that ensure optimal performance and reliability under demanding conditions, while also meeting military-grade durability standards for harsh environments. With a focus on power efficiency, the NVIDIA Arm^® CPU delivers high performance without excessive energy consumption. Additionally, the Jetson Orin^™ series offers Super mode, which provides 2X higher Gen AI model performance with the Jetson Orin NX^™ or Orin Nano^™ series. The platform also supports high-speed data transmission through Gigabit Multimedia Serial Link (GMSL) technology, which is essential for advanced AI applications, and it facilitates remote management and maintenance via Out-Of-Band (OOB) management, enhancing operational efficiency via simplified one-command setup for effortless deployment.

Driving Advanced AIoT Applications

ASUS IoT Edge AI systems powered by NVIDIA^® Jetson Orin^™ are paving the way for the development of innovative applications across various industries.

Robotics: The Next Era of Physical AI with Jetson^™ Thor

The ASUS IoT PE3000N powered by NVIDIA^® Jetson AGX Thor^™ revolutionizes humanoid robotics by delivering the high-performance computing necessary for real-time decision-making in dynamic environments. Built on NVIDIA’s Blackwell architecture, Jetson AGX Thor enables low-latency, high-throughput inference, crucial for tasks requiring human-like perception and dexterity. PE3000N’s modular design enables project-specific I/O for vertical (CAN, QSFP28, POE) expansion, within a 2U height. It features rich I/O, including 10G LAN and ignition power control. Built to pass stringent testing to U.S. MIL-STD-810H standards, PE3000N is also reliable in temperature ranging from -25°C to 70°C, so it’s suited for almost any environment. It’s ideal for demanding applications such as adaptable humanoid robots in factories or for providing assistance in healthcare settings, enhancing operational efficiency and helping alleviate labor shortages.

Promotional image for ASUS IoT PE3000N Edge AI Computer featuring the device and text highlighting its rugged, modular design. Powered by NVIDIA Jetson Thor, it offers flexible expansion, compact design, and 2,070 FP4 TFLOPS performance. The background has a high-tech, digital aesthetic.

AMR/AGV in Smart Factories

For smart manufacturing, Autonomous Mobile Robots (AMRs) equipped with Jetson^™ technology enable context-aware interactions through Vision Transformers. These robots can navigate and detect their environment, triggering alarms to management for enhanced safety and efficiency. ASUS IoT PE1103N supports up to 8GMSL cameras and the open source ROS 2 software framework to ensure precise and complex mission planning and execution. It also supports optional high-precision time sync and frame out for cameras, LiDARs, radars, and IMUs, and it features WiFi and 4G/5G for seamless connectivity.

Futuristic warehouse with robots transporting boxes. Digital overlays display data like efficiency and online status, highlighting advanced technology.

Accelerating Smart City Initiatives

The ASUS IoT PE2100N edge AI computer showcases the capabilities of VLMs in urban settings. By using natural language to interact with videos and images, it can identify abnormal events and perform object detection to ensure public safety. The PE2100N, powered by NVIDIA^® Jetson AGX Orin^™ and supporting the latest JetPack SDK, delivers up to 275 TOPS with 4 PSE ports, all in a rugged, fanless design that boasts low power consumption and a compact form factor.

A cityscape with digital icons representing technology and connectivity floats above busy streets and buildings, conveying a futuristic, interconnected urban scene.

Conclusion

For a wide range of industries, integrating edge AI 2.0 solutions will be crucial for enhancing operational efficiency, safety, and productivity. ASUS IoT systems powered by NVIDIA^® Jetson Orin^™ stand ready to meet the ever-evolving demands of this new era.

To learn more about ASUS IoT solutions and how these cutting-edge technologies can transform your business, click here.