Nvidia Unveils Hopper H100 Data Center GPU

Nvidia has pulled the wraps off its new Hopper GPU architecture at its AI-based GTC conference. As expected the chip is a beast, packing 80 billion transistors into a gigantic 814mm monolithic die. It features PCIe Gen 5 connectivity, and uses up to six stacks of High-Bandwidth-Memory (HBM). The technology is the official replacement for the Ampere GA100, which launched two years ago. Nvidia will be offering the H100 in a variety of products designed to accelerate AI-based enterprise workloads.

Hopper is a significant step forward for Nvidia. Despite the die being roughly the same size as the Ampere-based GA100 that preceded it, it has almost 40 percent more transistors. This is due to the company’s transition from TSMC’s 7nm node to TSMC’s 4nm process. It’s also transitioned from the GA100’s 40GB or 80GB of HBM2 to 80GB of HBM3 memory on a 5,120-bit wide memory bus.

This allows for up to 3TB/s of memory bandwidth. Nvidia claims 20 H100s linked together “can sustain the equivalent of the entire world’s internet traffic.” It’s an odd comparison for a graphics card, even a data center product.

One of the more interesting advancements with Hopper is the inclusion of DPX instructions. Nvidia claims DPX can accelerate “dynamic programming” used by a lot of algorithms across many scientific industries. This includes the Floyd-Warshall algorithm that’s used to find the best routes for autonomous fleets. It will also boost the Smith-Waterman algorithm used in sequence alignment for DNA and protein classification and folding. The company states Hopper can speed up these workflows by 40X compared to using CPUs, and 7X faster than with previous-gun GPUs.

The arrival of the H100 means the company also has new DGX workstations. Each DGX H100 system will offer eight H100 GPUs connected by Nvidia’s 4th generation NVLink technology. This new connector provides 1.5X the bandwidth of the previous generation, for 900GB/s of bandwidth. It can scale up via an external NVLink switch to connect 32 nodes for a DGX SuperPOD super computer. A single DGX 100 allows up to 32 petaflops of FP8 performance.

Nvidia’s new architecture is named after Grace Hopper, who was an early pioneer in computer programming. The release of Hopper was anticipated, as it’s been on Nvidia’s roadmaps for quite some time. Also, Nvidia typically releases a data center version of its new technology before the gaming version arrives, so this is par for the course. The replacement for Ampere for gamers is named after another female IT trailblazer named Ada Lovelace, as we’ve previously reported. Nvidia’s H100 GPU will be available in the third quarter of 2022, in both SXM and PCIe form factors. You can watch Nvidia’s GTC keynote address here.

Continue reading

Pfizer Claims New COVID-19 Vaccine 90 Percent Effective

There have been a number of COVID-19 vaccines in development in the United States and around the world, and one of them has shown some very positive preliminary results in its Phase 3 trial. One particular vaccine developed by Pfizer and German firm BioNTech appears to be more than 90 percent effective in preventing symptomatic…

Apple’s New M1 SoC Looks Great, Is Not Faster Than 98 Percent of PC Laptops

Apple's new M1 silicon really looks amazing, but it isn't faster than 98 percent of the PCs sold last year, despite what the company claims.

Space Mining Gets 400 Percent Boost From Bacteria, ISS Experiments Show

We'll need lots of raw materials to sustain human endeavors on other planets, and a new project on the International Space Station demonstrates how we can make space mining over 400 percent more efficient.

Cyberpunk 2077’s PC Player Base Has Shrunk 79 Percent Since Launch

CD Projekt Red's latest game has seen a steep player drop off — steeper than usual for a game of this size — but it's probably not a problem for the title long-term.