‘Universal Lego Sorter’ Uses AI to Recognize Any Lego Brick

‘Universal Lego Sorter’ Uses AI to Recognize Any Lego Brick

Scientists around the world have used neural networks to train self-driving cars, diagnose disease, and search for exoplanets. Now, someone is finally leveraging this technology to do something useful: sorting Lego bricks. On YouTube, you can learn how one man created a Lego sorting machine using AI, motors, and of course, Lego bricks.

When you look at a pile of Lego blocks, your brain knows how to identify the pieces from any orientation or background as long as you can see the whole block. Even kids can spot the difference between a 2×1 red block, a 4×1 green, and one of those little hinge things. A traditional computer system for identifying blocks would need programmatic information about what the block looks like from every angle. A neural network works more like your brain to learn what those parts look like.

The mechanical element of the sorting machine is composed of over 10,000 Lego bricks with six Lego motors and nine servos. To sort Lego bricks, you just dump them in the hopper and let the machine go to work. The Universal Lego Sorter, as it’s understandably called, uses a motorized belt to pull pieces out of the sorting bin. Next, they cross a vibrating platform powered by off-set Lego motor. That ensures the blocks separate so the camera can see each one individually. A series of gates on the motorized belt can direct the parts into the appropriate bin.

It can identify and sort one brick every two seconds, but getting there was no simple feat. Designer Daniel West says the Universal Lego Sorter can recognize about 3,000 different Lego parts — the entire catalog. It can even recognize blocks that it’s never seen in real life thanks to 3D models of Lego components available on sites like Rebrickable. That’s what West used as training data for the convolutional neural network, which runs on a nearby computer. The 3D models made training vastly easier as West only needed a few real photos of Lego bricks for fine-tuning the model.

West spent the last several years working on this project and hopes to write an academic paper on it. He hasn’t committed to releasing instructions on how to build the mechanical parts of the machine, but he is open to releasing the AI software for free.

Continue reading

IRS Drops Facial Recognition Program Used to Verify Identities
IRS Drops Facial Recognition Program Used to Verify Identities

The IRS was facing intense pressure to find a better solution, and surprisingly it capitulated.

Clearview Plans Facial Recognition Database That Knows Every Person on Earth
Clearview Plans Facial Recognition Database That Knows Every Person on Earth

Clearview AI aims to build a facial recognition database that includes you. Yes, you. But not only you. Clearview wants its database to include every human being on Earth, and it thinks it can get there by siphoning up 100 billion photos from the internet.

Ukraine is Using Facial Recognition to Contact Kin of Dead Russian Soldiers
Ukraine is Using Facial Recognition to Contact Kin of Dead Russian Soldiers

The families of at least 582 individuals have been contacted this way so far.

Dolphins Recognize Companions By the Taste Of Their Urine
Dolphins Recognize Companions By the Taste Of Their Urine

Earlier this week, we found out that bottlenose dolphins self-medicate by rubbing their bodies against coral. But this sea creature’s peculiar intelligence doesn’t appear to stop there.