‘Universal Lego Sorter’ Uses AI to Recognize Any Lego Brick

‘Universal Lego Sorter’ Uses AI to Recognize Any Lego Brick

Scientists around the world have used neural networks to train self-driving cars, diagnose disease, and search for exoplanets. Now, someone is finally leveraging this technology to do something useful: sorting Lego bricks. On YouTube, you can learn how one man created a Lego sorting machine using AI, motors, and of course, Lego bricks.

When you look at a pile of Lego blocks, your brain knows how to identify the pieces from any orientation or background as long as you can see the whole block. Even kids can spot the difference between a 2×1 red block, a 4×1 green, and one of those little hinge things. A traditional computer system for identifying blocks would need programmatic information about what the block looks like from every angle. A neural network works more like your brain to learn what those parts look like.

The mechanical element of the sorting machine is composed of over 10,000 Lego bricks with six Lego motors and nine servos. To sort Lego bricks, you just dump them in the hopper and let the machine go to work. The Universal Lego Sorter, as it’s understandably called, uses a motorized belt to pull pieces out of the sorting bin. Next, they cross a vibrating platform powered by off-set Lego motor. That ensures the blocks separate so the camera can see each one individually. A series of gates on the motorized belt can direct the parts into the appropriate bin.

It can identify and sort one brick every two seconds, but getting there was no simple feat. Designer Daniel West says the Universal Lego Sorter can recognize about 3,000 different Lego parts — the entire catalog. It can even recognize blocks that it’s never seen in real life thanks to 3D models of Lego components available on sites like Rebrickable. That’s what West used as training data for the convolutional neural network, which runs on a nearby computer. The 3D models made training vastly easier as West only needed a few real photos of Lego bricks for fine-tuning the model.

West spent the last several years working on this project and hopes to write an academic paper on it. He hasn’t committed to releasing instructions on how to build the mechanical parts of the machine, but he is open to releasing the AI software for free.

Continue reading

AMD Has No Near-Term Plan For Hybrid Big, Little Cores on Same Silicon
AMD Has No Near-Term Plan For Hybrid Big, Little Cores on Same Silicon

AMD has no plans to build a hybrid CPU with big and little cores any time in the near future, but the company continues to evaluate the concept.

Microsoft: Pluton Chip Will Bring Xbox-Like Security to Windows PCs
Microsoft: Pluton Chip Will Bring Xbox-Like Security to Windows PCs

Intel, AMD, and Qualcomm are working to make Pluton part of their upcoming designs, which should make PCs more difficult to hack, but it also bakes Microsoft technology into your hardware.

AMD Will Bring Smart Access Memory Support to Intel, Nvidia Hardware
AMD Will Bring Smart Access Memory Support to Intel, Nvidia Hardware

AMD is reportedly working with Nvidia and Intel to bring hardware support for Smart Access Memory to other GPU and CPU platforms.

AMD Is Bringing Threadripper Pro, 8-Channel Motherboards to Market
AMD Is Bringing Threadripper Pro, 8-Channel Motherboards to Market

AMD is bringing its 8-channel Threadripper Pro family to the retail channel after previously restricting it to OEMs only.