NVIDIA to announce Blackwell at GTC 2024
The next-gen HPC GPU to feature 192 GB of capacity.
Tomorrow at the GTC 2024 keynote, Jensen Huang is said to announce the next-generation GPU architecture called Blackwell. Similarly to what we observed in the past, NVIDIA will use the same underlying architecture for its data-center and gaming segments. Interestingly, the announcement of the Blackwell GPU comes even before NVIDIA is shipping the second-generation Hopper GPU (GH200).
According to XpeaGPU, the B100 launching tomorrow will feature two dies based on TSMC CoWoS-L packaging technology. The CoWoS (Chip-on-Wafer-On-Substrate-L) is advanced 2.5D packaging technology that enables companies to design and manufacture larger processors.
I dont want to spoil Nvidia B100 launch tomorrow but this thing is a monster. 2 dies on CoWoS-L, 8×8-Hi HBM3e stacks for 192GB of memory. One year later, B200 goes with 12-Hi stacks and will offer a beefy 288GB. And the performance! it's… oh no Jensen is there… me run away! pic.twitter.com/YFXzrnSRmG
— AGF (@XpeaGPU) March 17, 2024
Last year, TSMC announced that CoWoS-L technology allows the company to build larger interposers. Initially aimed at 2025, the technology would allow interposers to host up to six times the TSMC reticle limit, an increase of 3.3 compared to previous generation interposers.
Xpea revealed that two compute chiplets would be connected to 8 stacks of 8-Hi HBM3e memory, totaling 192 GB of capacity. Worth noting that the same capacity of 192 GB is already offered by AMD, who have put 8 HBM3 chiplets on their Instinct MI300 GPU .
Looking ahead, the next-gen Blackwell GPU update codenamed B200 would utilize 12-high stacks which enable higher capacity. It is reportedly reaching 288 GB, without stating whether that’s HBM3e or HBM4. AMD is also said to be working on an update to MI300 series to HBM3e memory.
NVIDIA B100 in 2024, Source: NVIDIA
NVIDIA has been teasing the B100 processor for its superior AI-inference performance in the past, without directly confirming its codename. More importantly, the B100 was confirmed to be launched this year.
NVIDIA GTC 2024 kicks off tomorrow. You can watch the keynote here .
| NVIDIA Data-Center Accelerators | |||||
|---|---|---|---|---|---|
| VideoCardz | (G)R100 | (G)B200 | (G)B100 | (G)H200 | (G)H100 |
| Architecture | Rubin | Blackwell | Blackwell | (Grace) Hopper | Hopper |
| Release Date | 2026 (?) | 2025 | 2024 | 2023-2024 | 2023 |
| CPU | TBC | TBC | – | 72 ARM Neoverse V2 | – |
| Streaming Multiprocessors | TBC | TBC | TBC | 132 | 132 |
| Memory | HBM4 | 288GB HBM3e | 192GB HBM3e | 96GB HBM3 144GB HBMEe | 80GB HBM3 |
| TDP | TBC | ~1000W | TBC | 450-1000W | 700W |
Source: XpeaGPU