NVIDIA H100 NVL 94 GB

NVIDIA H100 NVL 94 GB — 94 Гб HBM3, 16,896 ядер, GPI 57.2

Loading...

Performance Rating

The H100 NVL 94 GB is a professional graphics card by NVIDIA, launched on March 21st, 2023. Built on the 5 nm process, and based on the GH100 graphics processor, the card does not support DirectX. Since H100 NVL 94 GB does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GH100 graphics processor is a large chip with a die area of 814 mm² and 80,000 million transistors. It features 16896 shading units, 528 texture mapping units, and 24 ROPs. Also included are 528 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 94 GB HBM3 memory with the H100 NVL 94 GB, which are connected using a 6016-bit memory interface. The GPU is operating at a frequency of 1080 MHz, which can be boosted up to 1785 MHz, memory is running at 1310 MHz.

A100 A100
H200 H200
MI325X MI325X

NVIDIA H100 NVL 94 GB

57.2

NVIDIA H100 NVL 94 GB

57.2

Memory

Memory Size

94 GB

Memory Type

Memory Bandwidth

3.94 TB/s

Memory Bus Width

6,016 бит

ML Performance

FP16 (Half Precision)

241.3 TFLOPS

BF16 (Brain Float)

No TFLOPS
311.84 TFLOPS
(NVIDIA A800 SXM4 80 GB)

TF32 (TensorFloat)

Compute Power

FP32 (Single Precision)

60.32 TFLOPS

FP64 (Double Precision)

30.16 TFLOPS

CUDA Cores

Architecture & Compatibility

GPU Architecture

SM (Streaming Multiprocessor)

PCIe Version

PCIe 5.0 x16

ML Software Support

CUDA Version

CUDA Toolkit (first supported)

CUDA Toolkit 12

CUDA Toolkit status

Supported

Clocks & Performance

Base Clock

Boost Clock

Memory Clock

Power Consumption

Recommended PSU

Power Connector

8-pin EPS

TDP/TGP

400 W
unknown
(NVIDIA CMP 70HX)

Rendering

Texture Units (TMU)

L2 Cache

50 MB

Additional

Slots

Dual-slot
SXM Module
(NVIDIA B300)

Release Date

March 21, 2023
March 12, 2026
(Intel Arc B770)

Display Outputs

No outputs
Portable Device Dependent
(NVIDIA GeForce RTX 5090 Mobile)

Renting is cheaper than buying