It Took Half a Ton of Hard Drives to Store the Black Hole Image Data

It Took Half a Ton of Hard Drives to Store the Black Hole Image Data

The newly released image of a black hole (below) is a watershed moment for physics. Finally, we can put some of Einstein’s most famous predictions from a century ago to the test, but it was not as easy as pointing a big lens at the M87 galaxy and pressing a button. It took years of work and the collaboration of more than 200 scientists to make it happen. It also required about half a ton of hard drives.

Data collection for the historic black hole image began in 2017 with a coordinated effort called the Event Horizon Telescope (EHT). That isn’t a single instrument but rather a collection of seven radio telescopes from around the world. The EHT used a principle called interferometry to combine the capacity of all those telescopes, creating a “virtual” telescope the size of the Earth.

The EHT had to collect a huge volume of data to deliver us this one image. Dan Marrone, Associate Professor of Astronomy at the University of Arizona says the EHT team had to install specialized super-fast data recorders on the various radio telescopes to handle the influx of measurements.

The now-famous image of a black hole comes from data collected over a period of seven days. At the end of that observation, the EHT didn’t have an image — it had a mountain of data. Scientists like MIT’s Katie Bouman (above) had to develop algorithms to take 5 petabytes of data and make sense of it. But how do you get all that data to the correlation teams in the US and Germany? You use an airplane.

It Took Half a Ton of Hard Drives to Store the Black Hole Image Data

According to Marrone, 5 petabytes is equal to 5,000 years of MP3 audio. There’s simply no way to send that much data efficiently over the internet. It’s faster to actually ship the hard drives to collaborators around the world. That’s why MIT has 1,000 pounds of hard drives sitting in its Haystack Observatory labs.

Jason Snell at Six Colors has helpfully worked out the effective data rate of shipping these hard drives. The Mauna Kea Observatory in Hawaii might have generated about 700TB of data (one-seventh of the total), and it’s 5,000 miles from MIT in Boston. Figuring in trips to and from the airport and the flight itself, it took around 50,400 seconds to move the data. While the best internet connections are currently measured in a few gigabits per second, shipping those drives from Hawaii to MIT works out to 14 gigabytes per second (112 gigabits per second).

Continue reading

The PlayStation 5 Will Only Be Available Online for Launch Day
The PlayStation 5 Will Only Be Available Online for Launch Day

The PlayStation 5 isn't going to be available in stores on launch day, and if you want to pick up an M.2 SSD to expand its storage, you'll have some time to figure out that purchase.

Jupiter’s Moon Europa Might Glow in the Dark
Jupiter’s Moon Europa Might Glow in the Dark

The intense radiation bombarding Europa might make it glow in the dark, and that could help scientists learn more about the moon's ice sheets and the ocean below.

Which Is Faster, the Xbox Series X or PlayStation 5? Early Data Says It’s Complicated
Which Is Faster, the Xbox Series X or PlayStation 5? Early Data Says It’s Complicated

Competitive head-to-head data on the Xbox Series X versus the PlayStation 5 is beginning to trickle out.

Time to Update: Google Patches 2 Severe Zero-Day Chrome Vulnerabilities
Time to Update: Google Patches 2 Severe Zero-Day Chrome Vulnerabilities

Unlike the last few zero-days, Google didn't find these security holes itself. Instead, it was tipped by anonymous third-parties, and the problems are severe enough that it hasn't released full details. Suffice it to say, you should stop putting off that update.