Google’s Edge TPU Debuts in New Development Board
We’ve written a fair bit about Google’s Cloud TPU, the AI inference and ML training accelerator the company developed for handling specific workloads more effectively than a GPU or CPU. These large-scale TPUs, however, are intended to power server rooms and major data centers. Google has also developed hardware for smaller devices, use-cases, and the network edge, appropriately dubbed the Edge TPU.
The Coral FAQ describes the Edge TPU as follows:
The Edge TPU is a small ASIC designed by Google that provides high-performance ML inferencing for low-power devices. For example, it can execute state-of-the-art mobile vision models such as MobileNet V2 at 100+ fps, in a power efficient manner.
The Coral development board includes:
- Edge TPU Module (SOM)
- NXP i.MX 8M SOC (Quad-core Cortex-A53, plus Cortex-M4F)
- Google Edge TPU ML accelerator coprocessor
- Vivante GC7000 GPU
- Cryptographic coprocessor
- Wi-Fi 2×2 MIMO (802.11b/g/n/ac 2.4/5GHz)
- Bluetooth 4.1
- 8GB eMMC
- 1GB LPDDR4
Various USB ports, audio connections, and video connections are all available, including multiple microphone hook-ups, USB-C support, an HDMI 2.0a port, and both a 39-pin and 24-pin connector for a MIPI-DSI display and a MIPI-CSI2 camera. The Edge TPU claims to support Mendel Linux (a derivative of Debian). I wasn’t able to find any information on this distro online. Google’s web page for the Edge TPU project only states that the device is compatible with “Linux OS.” This may be a typo in the documentation or a reference to a custom Linux distro that Google built itself. The dev board is on sale for $149.99.
Also up for sale is a new Edge USB accelerator. Unlike the complete development module, this is just an Edge TPU implemented via USB that can be connected to other devices, such as a Raspberry Pi. Think of it as conceptually similar to Intel’s Neural Compute Stick. Benchmarks for the Edge TPU and USB-connected version (according to Google’s FAQ) are below. The new USB accelerator is also cheaper than the full board, at $74.99:
The Edge TPU only supports TensorFlow Lite, so any code you want to run on the hardware must be converted to that format first. It can’t perform traditional backward propagation (necessary for traditional ML training), but there’s a modified way you can run these workloads in specific instances, as described in the FAQ.
For now, AI remains a fairly specialized field, and parts like this are intended for a relatively small developer audience that can use them for software testing. In the future, however, these types of low-cost devices could be key to extending AI capabilities to ‘regular folks’ and hardware, allowing more people to experiment with the kinds of features AI can provide.
Continue reading
RISC-V Tiptoes Towards Mainstream With SiFive Dev Board, High-Performance CPU
RISC V continues to make inroads across the market, this time with a cheaper and more fully-featured test motherboard.
Unreleased Nintendo Game Boy Keyboard Brought Back to Life
Gaming history YouTuber Liam Robertson has gotten his hands on a Work Boy — possibly the last one in the world, and it's working thanks to that giant Nintendo data leak from a few months back.
GPU, Motherboard Prices Will Jump Thanks to US-China Trade War
GPU prices from Asus and other manufacturers are headed upwards, now that tariff exemptions have expired.
Mercedes-Benz Unveils 56-Inch ‘Hyperscreen’ Dashboard Panel
Ahead of the now-virtual CES 2021, Mercedes-Benz has unveiled the MBUX Hyperscreen, a 56-inch-wide, curved cinematic display that stretches across the entire dashboard, from the left air vent to the right.