MSI RTX 5090 LIGHTNING Z vs NVIDIA H200 NVL

Comparison of MSI RTX 5090 LIGHTNING Z with 32 GB GDDR7 and 21,760 cores vs NVIDIA H200 NVL with 141 GB HBM3e and 16,896 cores.

Loading...

Performance Rating

NVIDIA H200 NVL outperforms MSI RTX 5090 LIGHTNING Z by 34.86% in the overall GPU ARK performance rating

A100 A100
H200 H200
MI325X MI325X

MSI RTX 5090 LIGHTNING Z

47.2

MSI RTX 5090 LIGHTNING Z

47.2
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

NVIDIA H200 NVL

63.6

NVIDIA H200 NVL

63.6

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

32 GB
🔥 +341% 141 ГБ

Memory Type

GDDR7 HBM3e

Memory Bandwidth

1.79 TB/s
🔥 +173% 4.89 TB/s

Memory Bus Width

512 бит 6,144 бит

ML Performance

FP16 (Half Precision)

118.8 TFLOPS
🔥 +103% 241.3 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

🔥 +97% 118.8 TFLOPS
60.32 TFLOPS

FP64 (Double Precision)

1.856 TFLOPS
🔥 +1,525% 30.16 TFLOPS

CUDA Cores

🔥 +29% 21,760
16,896

RT Cores

🔥 170
No

Architecture & Compatibility

GPU Architecture

Blackwell 2.0 Hopper

SM (Streaming Multiprocessor)

🔥 +29% 170
132

PCIe Version

PCIe 5.0 x16 PCIe 5.0 x16

ML Software Support

CUDA Version

🔥 12.0
9.0

Clocks & Performance

Base Clock

🔥 +48% 2,017
1,365

Boost Clock

🔥 +53% 2,730
1,785

Memory Clock

🔥 +10% 1,750
1,593

Power Consumption

Recommended PSU

1400 W
🔥 -29% 1000 W

Power Connector

🔥 2x 16-pin
8-pin EPS

TDP/TGP

1000 W
🔥 -40% 600 W

Rendering

Texture Units (TMU)

🔥 +29% 680
528

ROP

🔥 170
No

L2 Cache

🔥 +92% 96 MB
50 MB

Benchmarks

MLPerf, llama2-70b-99.9 (fp4)

7 436 tokens/s

MLPerf, llama3.1-405b (fp4)

130.5 tokens/s

MLPerf, deepseek-r1 (fp4)

2 327 tokens/s

Additional

Slots

Triple-slot Dual-slot

Release Date

Jan. 6, 2026 Nov. 18, 2024

Display Outputs

1x HDMI 2.1b
3x DisplayPort 2.1b

1x HDMI 2.1b
3x DisplayPort 2.1b
1x USB Type-C
No outputs

Renting is cheaper than buying