ASUS UGen300: a USB that adds 40 TOPS of AI power to any device

ASUS UGen300: a USB that adds 40 TOPS of AI power to any device

To help with the tasks of Artificial intelligencemany processors now incorporate a dedicated NPU capable of delivering great performance for this type of workflow. But if you don’t have an NPU on your device, ASUS has launched the world’s first USB acceleratorhe UGen300. A connected device Integrated USB-C that you can insert to start working with it.

ASUS UGen300: the first AI accelerator in USB format

Inside this unit we find a processor for AI Hailo-10H capable of offering on its own 40 TOPS powerwhich will allow managing LLM, VLM and much more. It has a connector Integrated USB Type Cso you will not need to use cables or adapters, and of course you will not have to open the equipment or use tools for installation. This design of plug and play is compatible with equipment Windows, Linux and even Android.

8 GB of dedicated memory and compatibility with major AI frameworks

Comes with 8 GB of dedicated LPDDR4 memory that will be managed from the device itself. It is also compatible with leading AI software such as PyTorch, ONNX or TensorFlowready to use. Another of its strong points is its consumption, with only 2.5 watts in typical workload situations. Its size will allow you to take it with you anywhere, since it measures only 105x50x18mmand thanks to its connectivity and great compatibility you can add it to a multitude of devices.

Up to 40 additional TOPS to run local AI without relying on the cloud

In terms of performance, this ASUS UGen300 will allow you to complement the CPU and even the NPU of the device you connect it to with 40 additional TOPS for AI. This new ASUS in USB format will allow you to execute tasks localavoiding having to resort to the cloud and paying additional fees to use these services. With the UGen300 you can run AI apps like those from text generation, video summarization, speech to text and even real-time perception.

Geeknetic ASUS UGen300: a USB that adds 40 TOPS of AI power to any device 2

AI on any device thanks to its compact design and plug and play

The memory of 8 GB LPDDR4 integrated It will help to perform AI calculations in more complex models. This system, together with this integrated memory, will allow AI tasks to be executed on computers or devices that are not prepared for it.

In addition, connecting it will be an easy task with its USB 3.1 Gen 2 Type Coffering an AI accelerator in a matter of seconds. ASUS will provide a tool UGen Utility that will allow validation through more than 100 pre-trained models to start it easily. You can also access the Hailo developer communitywhere you’ll find resources to get the most out of your ASUS UGen300.

Availability and price of the ASUS UGen300

At the moment there is no recommended price for this new ASUS UGen300. These are its complete specifications.

Model and chipset

  • Model: UGen300-USB-8G
  • Chipset: Hailo-10H

Interface

  • Compatible with USB 3.1 Gen2 Type-C (10Gbps)

AI performance

  • Until 40 TOPS (INT4)
  • Until 20 TOPS (INT8)

Memory

  • 8GB LPDDR4
  • Speed: 4266 MT/s

Consumption

Design

  • Dimensions: 105x50x18mm
  • Weight: 150g

Compatibility

  • Compatible operating systems:
  • Supported architectures:

Supported AI Frameworks

  • Keras
  • TensorFlow
  • TensorFlow Lite
  • PyTorch
  • ONNX

Compatible Model Types

  • Models of vision (Vision AI)
  • Models of Generative AI (GenAI)