NVIDIA H100 Hopper already on sale
Hermitage Akhiabara reports that the first Japanese HPC retailer has NVIDIA’s new Hopper GPU listed for a crazy amount of money.
GDEP Advance now has NVIDIA H100 listed at a price of 4,745,950 yen (~36,550 USD), which is the price of the NVIDIA Hopper HPC accelerator equipped with 80 GB memory. This mentioned price includes taxes and shipping, while the card itself costs 4,313,000 yen (~33,200 USD).
NVIDIA has not yet confirmed the official MSRP for any of the H100 GPU variants. This particular model is the PCIe based model with passive cooling for server enclosures:
NVIDIA H100 listing in Japan, Source: GDEP Advance
NVIDIA H100 was first announced at GTC 2022, but it is not expected to become available till the second half of this year. This new data-center solution is NVIDIA’s first GPU to utilize TSMC 4nm process technology. It has 80 billion transistors packed into 814 mm² silicon.
The PCIe variant with 80GB HBM2e memory has 2TB/s of memory bandwidth and utilizes PCIe Express 5.0 interface, which is the first NVIDIA card to do so. It also ships with fewer CUDA cores than SXM variant: 14592 instead of 16896, but neither configuration is the full implementation of GH100 GPU. Moreover, the H100 PCIe model features HBM2e memory instead of HBM3 of the SXM model. The TDP has also been limited on this card to 350W, which is half of what the SXM implementation requires.
| NVIDIA Data-Center GPUs Specifications | ||||
|---|---|---|---|---|
| VideoCardz.com | NVIDIA H100 | NVIDIA A100 | NVIDIA Tesla V100 | NVIDIA Tesla P100 |
| Picture |  |  |  |  |
| GPU | GH100 | GA100 | GV100 | GP100 |
| Transistors | 80B | 54.2B | 21.1B | 15.3B |
| Die Size | 814 mm² | 828 mm² | 815 mm² | 610 mm² |
| Architecture | Hopper | Ampere | Volta | Pascal |
| Fabrication Node | TSMC N4 | TSMC N7 | 12nm FFN | 16nm FinFET+ |
| GPU Clusters | 132/114* | 108 | 80 | 56 |
| CUDA Cores | 16896/14592* | 6912 | 5120 | 3584 |
| L2 Cache | 50MB | 40MB | 6MB | 4MB |
| Tensor Cores | 528/456* | 432 | 320 | – |
| Memory Bus | 5120-bit | 5120-bit | 4096-bit | 4096-bit |
| Memory Size | 80 GB HBM3/HBM2e* | 40/80GB HBM2e | 16/32 HBM2 | 16GB HBM2 |
| TDP | 700W/350W* | 250W/300W/400W | 250W/300W/450W | 250W/300W |
| Interface | SXM5/*PCIe Gen5 | SXM4/PCIe Gen4 | SXM2/PCIe Gen3 | SXM/PCIe Gen3 |
| Launch Year | 2022 | 2020 | 2017 | 2016 |
Source: GDM