NVIDIA A100 PCIe 80GB
NVIDIA formally introduces its A100 variant with a PCI Express interface and 80GB of memory.
Back in November NVIDIA introduced an 80GB variant of the A100 accelerator based on the SXM4 form factor. This variant offered twice the memory capacity of the original Ampere GA100 based model as well as higher bandwidth. Seven months later, NVIDIA also introduces a PCIe-based model featuring the exact same features, except on a standard interface and with lower TDP.
NVIDIA A100 PCIe 80GB is based on 7nm Ampere GA100 GPU featuring 6192 CUDA cores. The bandwidth on this variant increases to 2039 GB/s (over 484 GB/s more than A100 40GB). This is achieved using faster memory with an effective speed of 3186 Gbps.
This GPU is computer-oriented which means it has no gaming purposes, at least not in this form. This product is strictly for high-performance computing to accelerate training using deeplearning algorithms.
Furthermore, NVIDIA announced its GPUDirect Storage feature, which is similar to consumer Microsoft DirectStorage technology. In consumer space, it gives access to fast NVMe storage which can boost loading times in certain workloads. NVIDIA’s technology appears to focus on a similar type of access except to the large memory pool on the GPU, in this case, 80GB of faster HBM2e memory.
| NVIDIA Compute Accelerator Series (Formely Tesla) | |||||
|---|---|---|---|---|---|
| VideoCardz.com | A100 PCIe | A100 SXM | Tesla V100s | Tesla V100 | Tesla P100 |
| Picture |  |  |  |  |  |
| GPU | 7nm GA100 | 7nm GA100 | 12nm GV100 | 12nm GV100 | 16nm GP100 |
| Die Size | 826 mm^2 | 826 mm^2 | 815 mm^2 | 815 mm^2 | 610 mm^2 |
| Transistors | 54 billion | 54 billion | 21.1 billion | 21.1 billion | 15.3 billion |
| SMs | 108 | 108 | 80 | 80 | 56 |
| CUDA Cores | 6912 | 6912 | 5120 | 5120 | 3840 |
| Tensor Cores | 432 | 432 | 640 | 640 | NA |
| FP16 Compute | 78 TFLOPS | 78 TFLOPS | 32.8 TFLOPS | 31.4 TFLOPS | 21.2 TFLOPS |
| FP32 Compute | 19.5 TFLOPS | 19.5 TFLOPS | 16.4 TFLOPS | 15.7 TFLOPS | 10.6 TFLOPS |
| FP64 Compute | 9.7 TFLOPS | 9.7 TFLOPS | 8.2 TFLOPS | 7.8 TFLOPS | 5.3 TFLOPS |
| Boost Clock | ~1410MHz | ~1410MHz | ~1601 MHz | ~1533 MHz | ~1480MHz |
| Bandwidth | 2039/1555 GB/s | 2039/1555 GB/s | 1134 GB/s | 900 GB/s | 721 GB/s |
| Eff. Memory Clock | 3186/2430 Gbps | 3186/2430 Gbps | 2214 Gbps | 1760 Gbps | 1408 Gbps |
| Memory Config. | 80/40GB HBM2e | 80/40GB HBM2e | 32GB HBM2 | 16/32GB HBM2 | 16GB HBM2 |
| Memory Bus | 5120-bit | 5120-bit | 4096-bit | 4096-bit | 4096-bit |
| TDP | 250 | 400 | 250W | 300W | 300W |
| Form Factor | PCIe 4.0 | SXM4 | PCIe 3.0 | SXM2 / PCIe 3.0 | SXM |
Source: HardwareLuxx