Language

AI Accelerator

AI Accelerator PCIe Card

Less Energy, High Efficiency
ASUS AI Accelerator PCIe Card is the first PCI Express® expansion card with multiple Coral Edge TPUs for AI inferencing at the edge.

  • ASIC design for AI inference acceleration
  • Multiple AI analytics run in parallel
  • AI-model-pipelining technology to achieve low latency
  • Low power consumption of just 36-52 watts
Data Sheet Request Quote Partners
Overview
Technical Resources

Parallel ML inferences with low latency

Run multiple AI models at the same time.

In application scenarios that need to run multiple models, you can assign each model to a specific Edge TPU and run them in parallel for maximum performance.

Enhance ML performance with model-pipelining technology

For applications that require fast response or large-model execution, pipelining techniques enable you to partition models into several smaller models.

  • Partition and run : Execute smaller models on different Edge TPUs.
  • Rapid response : Increase throughout in high-speed applications.
  • Reduce latency : Minimize total latency for large models.

Maximize ML result with small datasets

The Edge TPU is primarily designed for inferencing at the edge. With on-device training, it’s possible to run API-based transfer-learning from a pre-trained model to achieve a fine-tuned model directly on the AI Accelerator PCIe Card.

  • Increase model accuracy : Enable transfer learning at the edge via AI Accelerator PCIe card, with no need to for server/cloud interaction for model retraining.
  • Save training time : Optimize models using fewer than 200 images, eliminating the need to start from scratch. 

Do more with less energy

Designed with energy efficiency in mind, AI Accelerator PCIe Card is equipped with excellent thermal stability to achieve inference acceleration with multiple Edge TPUs.

  • Low power consumption : 36/52 W ( 8/16 Edge TPUs).
  • No external PSU needed : Power is drawn directly from the PCIe slot.

Prototype AI applications in minutes

If you have a need to build AI demonstrations or prototypes in short order then AI Accelerator PCIe Card is ready to help. We've developed an AI-deployment builder, called Edge Inference Node for Coral Edge TPU*, in compliance with Node-RED. This programming tool enables flows to be wired together easily using the Edge TPU nodes, all with a single click – avoiding onerous coding during the prototyping stage.

  • Intuitive platform : Browser-based with graphical interface, with no need for coding.
  • Easy to use : Drag and drop any ML node, wire it up and it’s ready to deploy.
  • Data visualization : Monitor usage metrics of the AI Accelerator PCIe Card via the beautifully-designed dashboard.

* Download Edge Inference Node for Coral Edge TPU here

Applications

  • Manufacturing

    Defect detection
    Utilities monitoring
    Safety

  • Retail

    In-store automated checkout
    Crowd -density analysis
    Intelligent signage

  • Transportation

    Traffic management
    Fleet management
    Parking

  • Surveillance

    Intrusion
    Virtual fencing
    Security

Workflow

How AI Models are deployed on ASUS AI Accelerator PCIe Card

  • TensorFlow Lite converter : Converts TensorFlow models (with .pb file extension) to TensorFlow Lite models (with .tflite file extension).
  • Compiler : A command-line tool that compiles a TensorFlow Lite models (with .tflite file extension) into files that can be run on an Edge TPU.
  • Deploy : To execute AI models via PyCoral API (Python) or Libcoral API (C++).

ML model requirement

  • ML framework support : TensorFlow Lite.
  • Quantization : Tensor parameters are quantized (8-bit fixed-point numbers; int8).
  • Neural networks support : Convolutional Neural Networks (CNN).
  • Model conversion : TensorFlow model to TensorFlow lite model via TensorFlow converter tool.

Technical specifications

  • ML accelerator : Integrated with 8/16 Edge TPUs to achieve performance 32/64 TOPS
  • Interface : PCI Express® (PCIe®) 3.0 x16
  • Form factor : Full-height, half-length, double-slot width
  • Cooling : Active fan
  • Operating temperature : 0-55°C
  • Dimensions : 42.1 x 126.3 x 186.3 ( W x H x D mm)
  • Power consumption : 36 to 52 watts
  • Supported operating systems : Ubuntu 18.04, Debian 10 and Windows 10

Ordering information

  • CRL-G18U-P3D : Integrated with 8 Edge TPUs
  • CRL-G116U-P3D : Integrated with 16 Edge TPUs
  • Products certified by the Federal Communications Commission and Industry Canada will be distributed in the United States and Canada. Please visit the ASUS USA and ASUS Canada websites for information about locally available products.
  • All specifications are subject to change without notice. Please check with your supplier for exact offers. Products may not be available in all markets.
  • Specifications and features vary by model, and all images are illustrative. Please refer to specification pages for full details. Brand and product names mentioned are trademarks of their respective companies.
  • The product (electrical , electronic equipment, Mercury-containing button cell battery) should not be placed in municipal waste. Check local regulations for disposal of electronic products.
  • The use of trademark symbol (TM, ®) appears on this website means that the word text, trademarks, logos or slogans, is being used as trademark under common laws protection and/or registered as Trademark in U.S. and/or other country/region.

Talk to an expert
Contact us today to discuss how ASUS IoT can help you.

CONTACT US

Related Products

Related Stories