AMD Supercomputers with 327,680 Zen 2 Cores Will Help NOAA Predict the Weather

Tom's Hardware | Feb. 26, 2020, 5:53 a.m. | Original
(Image credit: Shutterstock)

The United States’ National Oceanic and Atmospheric Administration (NOAA) announced plans to purchase and install two new forecasting supercomputers as part of its new 10-year $505.2 million program.

The two supercomputers have 2,560 dual-socket nodes placed in 10 cabinets and powered by second-generation AMD Epyc ‘Rome’ 64-core 7742 processors, all connected by Cray’s Slingshot network. That works out to 327,680 Zen 2 cores for the clusters.

Each machine will have 1.3 petabytes of system memory and Cray’s ClusterStor systems will come with 26 petabytes of storage per site. 614 terabytes will be flash storage, with the rest being split into two 12.5 petabytes HDD file systems.

The peak theoretical performance of each Cray system is 12 petaflops. Combined with its other research and operational capacity, NOAA’s supercomputers can reach a peak theoretical performance of 40 petaflops.

Cray’s Shasta systems haven’t hit the top 500 supercomputer list yet, but based on their promised performance, they’d be ranking somewhere around the 25th place, based on the November 2019 listing. However, the new Shasta systems won’t be installed until 2022, and chances are they won’t rank as high by then.

The NOAA scientists argue that leadership could also be measured based on how well hurricanes are tracked, the accuracy of the upper-level flow, identifying surface temperature anomalies, and so on.

They also don’t see the supercomputers as putting them in a “fierce competition” with their colleagues at other forecasting centers around the world.

Out With The Old (IBM, Dell), In With The New (Cray)

NOAA will be replacing a mix of eight older systems, most of which are IBM and Dell, but with two also being older Cray systems. IBM manages the operational centers of NOAA until 2022, after which General Dynamics Information Technology (GDIT) will take over for the following eight years with a two-year optional renewal period. The contract with GDIT is worth $505.2 million over the 10 year span.

GDIT won the contract based on it meeting the 99% system availability requirements as well as offering the best the performance-per-dollar out of all the bidders. GDIT choosing AMD’s Epyc servers for the CPUs may have played a significant role in reaching that performance-per-dollar objective, too. We've recently seen several other institutions opt for AMD Epyc-based systems due to their high performance-per-dollar.

7 Comments Comment from the forums
  • spongiemaster 26 February 2020 19:00
    admin said:
    The NOAA announced that it will install two new AMD Epyc-based supercomputers for weather forecasting.

    AMD Supercomputers Heading to NOAA Will Predict Weather With 327,680 Zen 2 Cores : Read more
    Wouldn't it be cheaper and easier to order a Farmers' Almanac off of Amazon?
    Reply
  • svan71 27 February 2020 00:34
    Why do they state the core count rather than cpu count?
    Reply
  • OMGPWNTIME 27 February 2020 01:20
    svan71 said:
    Why do they state the core count rather than cpu count?

    A system of 64-Core chips totalling 327,680 cores would mean 5120 CPUs.

    An interesting thing to consider is that while I'm sure you get a discount for ordering a massive number of CPUs, the MSRP of the 7742 processor is $6950, which would mean in excess of $35 million in CPUs alone.
    Reply
  • svan71 27 February 2020 02:29
    my question was sarcastic really, 327,680 sounds allot more exciting than 5120 .
    Reply
  • drivinfast247 27 February 2020 02:52
    svan71 said:
    my question was sarcastic really, 327,680 sounds allot more exciting than 5120 .
    Or transistor count 163,840,000,000,000
    Reply
  • ron baker 27 February 2020 14:29
    This will use so much Powa that it will create its own weather systems near the Heat exfiltration systems. Someone needs to develop a seriously effiient design 5-10w per core , not this 60-90w nonsense. Back to the drawing board Mr Cray!
    Reply
  • aldaia 27 February 2020 15:58
    ron baker said:
    This will use so much Powa that it will create its own weather systems near the Heat exfiltration systems. Someone needs to develop a seriously effiient design 5-10w per core , not this 60-90w nonsense . Back to the drawing board Mr Cray!

    AMD EPYC 7742 requires less than 4 W per CORE
    Reply
PC Case Deal Drops Corsair Tempered Glass RGB Mid-Tower to $70 Report: Horizon Zero Dawn for PC Listed on Amazon