MSI RTX 5090 LIGHTNING Z vs NVIDIA H100 PCIe 80 GB

Comparison of MSI RTX 5090 LIGHTNING Z with 32 GB GDDR7 and 21,760 cores vs NVIDIA H100 PCIe 80 GB with 80 GB HBM2e and 14,592 cores.

Loading...

Performance Rating

MSI RTX 5090 LIGHTNING Z outperforms NVIDIA H100 PCIe 80 GB by 7.13% in the overall GPU ARK performance rating

A100 A100
H200 H200
MI325X MI325X

MSI RTX 5090 LIGHTNING Z

47.2

MSI RTX 5090 LIGHTNING Z

47.2
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

NVIDIA H100 PCIe 80 GB

44.1

NVIDIA H100 PCIe 80 GB

44.1

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

32 GB
🔥 +150% 80 ГБ

Memory Type

GDDR7 HBM2e

Memory Bandwidth

🔥 1.79 TB/s
2.04 TB/s

Memory Bus Width

512 бит 5,120 бит

ML Performance

FP16 (Half Precision)

118.8 TFLOPS
🔥 +72% 204.9 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

🔥 +132% 118.8 TFLOPS
51.22 TFLOPS

FP64 (Double Precision)

1.856 TFLOPS
🔥 +1,280% 25.61 TFLOPS

CUDA Cores

🔥 +49% 21,760
14,592

RT Cores

🔥 170
No

Architecture & Compatibility

GPU Architecture

Blackwell 2.0 Hopper

SM (Streaming Multiprocessor)

🔥 +49% 170
114

PCIe Version

PCIe 5.0 x16 PCIe 5.0 x16

ML Software Support

CUDA Version

🔥 12.0
9.0

Clocks & Performance

Base Clock

🔥 +84% 2,017
1,095

Boost Clock

🔥 +56% 2,730
1,755

Memory Clock

🔥 +10% 1,750
1,593

Power Consumption

Recommended PSU

1400 W
🔥 -46% 750 W

Power Connector

🔥 +100% 2x 16-pin
1x 16-pin

TDP/TGP

1000 W
🔥 -65% 350 W

Rendering

Texture Units (TMU)

🔥 +49% 680
456

ROP

🔥 170
No

L2 Cache

🔥 +92% 96 MB
50 MB

Benchmarks

MLPerf, llama2-70b-99.9 (fp8)

1 222 tokens/s

MLPerf, mixtral-8x7b (fp8)

3 466 tokens/s

Additional

Slots

Triple-slot Dual-slot

Release Date

Jan. 6, 2026 Oct. 13, 2022

Display Outputs

1x HDMI 2.1b
3x DisplayPort 2.1b

1x HDMI 2.1b
3x DisplayPort 2.1b
1x USB Type-C
No outputs

Renting is cheaper than buying