NVIDIA CMP 70HX vs NVIDIA GeForce RTX 5090

Comparison of NVIDIA CMP 70HX with 8 GB GDDR6X and 3,840 cores vs NVIDIA GeForce RTX 5090 with 32 GB GDDR7 and 21,760 cores.

Loading...

Performance Rating

H200 H200
MI325X MI325X
A100 A100

NVIDIA CMP 70HX

NVIDIA CMP 70HX

MI250 MI250
Instinct MI300X Instinct MI300X
RX 7900 XTX RX 7900 XTX

NVIDIA GeForce RTX 5090

NVIDIA GeForce RTX 5090

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

8 GB 32 GB

Memory Type

GDDR6X GDDR7

Memory Bandwidth

608.3 GB/s 1.79 TB/s

Memory Bus Width

256 бит 512 бит

ML Performance

FP16 (Half Precision)

10.71 TFLOPS 104.8 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

10.71 TFLOPS 104.8 TFLOPS

FP64 (Double Precision)

0.1674 TFLOPS 1.637 TFLOPS

CUDA Cores

3,840 21,760

RT Cores

30 170

Architecture & Compatibility

GPU Architecture

Ampere Blackwell 2.0

SM (Streaming Multiprocessor)

30 170

PCIe Version

PCIe 1.0 x4 PCIe 5.0 x16

ML Software Support

CUDA Version

8.6
🔥 12.0

Clocks & Performance

Base Clock

1,365 2,017

Boost Clock

1,395 2,407

Memory Clock

1,188 1,750

Power Consumption

TDP/TGP

unknown 575 W

Recommended PSU

🔥 -79% 200 W
950 W

Power Connector

1x 12-pin 1x 16-pin

Rendering

Texture Units (TMU)

120 680

ROP

30 170

L2 Cache

4 MB 96 MB

Benchmarks

llama.cpp, llama 7B Q4_0

315.3 tokens/s

llama.cpp, llama-2-7b-Q4_0

273.7 tokens/s

Geekbench AI, FP16

69 765 points

Geekbench AI, INT8

34 585 points

Geekbench AI, FP32

46 834 points

Additional

Slots

Dual-slot Dual-slot

Release Date

March 11, 2021 Jan. 30, 2025

Display Outputs

No outputs
1x HDMI 2.1b
3x DisplayPort 2.1b

Renting is cheaper than buying