NVIDIA B200 Tensor Core GPU coming next year, might need 1000W of power

Dell executive might have revealed NVIDIA plans for 2025.

NVIDIA’s roadmap from the previous year didn’t make any mention of the B200 accelerator. It’s worth noting that there is a distinction between B200 and GB200. The latter, GB200, has been confirmed by NVIDIA as a GPU processor. On the other hand, B200 appears to be the name of the actual product, like the NVIDIA B200 Tensor Core GPU.

Looking at the 2023 roadmap, it only features B100 as a product, yet it already introduced GB200 and GB200NVL processors. While there was no mention of the B200 product, a Dell executive claims that such a product does indeed exist, and it is expected to hit the market next year.

Dell’s Chief Operating Officer Jeff Clarke is confident that their engineering teams will be ready for such a product. He discusses what is required for a 1000W energy density, hinting at possible power increase for future data-center GPUs. In fact, he says that this will happen next year with B200 already. To put this in perspective, the current H100 peaks at 700 watts, and that’s specifically for the SXM variant.

[…] We’re excited about what happens at the B100 and the B200, and we think that’s where there’s actually another opportunity to distinguish engineering confidence. Our characterization in the thermal side, you really don’t need direct liquid cooling to get to the energy density of 1,000 watts per GPU.

That happens next year with the B200. The opportunity for us really to showcase our engineering and how fast we can move and the work that we’ve done as an industry leader to bring our expertise to make liquid cooling perform at scale […]

— Jeff Clarke, Dell Technologies Inc. – COO & Vice Chairman

According to Barrons, both Dell and NVIDIA declined to comment further on this news. However, one should remember that NVIDIA is just about to kick off its GTC 2024 conference in 16 days. It would be a perfect time and place to announce the future of NVIDIA’s data-center plans.

AI Accelerator roadmap, Source: NVIDIA

Dell shares have risen 32% on Friday, while NVIDIA this week crossed the $2T market share value. Dell is one of the key partners for NVIDIA in the data-center segments.

Source: Dell (PDF) , Barrons