NVIDIA Tesla T4 vs XFX XFX QICKSILVER MagAir RX 7800 XT

Comparison of NVIDIA Tesla T4 with 16 GB GDDR6 and 2,560 cores vs XFX XFX QICKSILVER MagAir RX 7800 XT with 16 GB GDDR6 and 3,840 cores.

Loading...

Performance Rating

XFX XFX QICKSILVER MagAir RX 7800 XT outperforms NVIDIA Tesla T4 by 163.98% in the overall GPU ARK performance rating

A100 A100
H200 H200
MI325X MI325X

NVIDIA Tesla T4

6.4

NVIDIA Tesla T4

6.4
RX 7900 XTX RX 7900 XTX
MI250 MI250
Instinct MI300X Instinct MI300X

XFX XFX QICKSILVER MagAir RX 7800 XT

17.0

XFX XFX QICKSILVER MagAir RX 7800 XT

17.0

Contents:

Memory ML Performance Compute Power Architecture & Compatibility ML Software Support Clocks & Performance Power Consumption Rendering Benchmarks Additional

Memory

Memory Size

16 GB
🔥 16 ГБ

Memory Type

GDDR6 GDDR6

Memory Bandwidth

320.0 GB/s 624.1 GB/s

Memory Bus Width

256 бит 256 бит

ML Performance

FP16 (Half Precision)

65.13 TFLOPS
🔥 +15% 74.65 TFLOPS

BF16 (Brain Float)

No No

TF32 (TensorFloat)

No No

Compute Power

FP32 (Single Precision)

8.141 TFLOPS
🔥 +358% 37.32 TFLOPS

FP64 (Double Precision)

0.2544 TFLOPS
🔥 +458,333,233% 1,166,000.0 TFLOPS

CUDA Cores

2,560
🔥 +50% 3,840

RT Cores

40
🔥 +50% 60

Architecture & Compatibility

GPU Architecture

Turing RDNA 3.0

SM (Streaming Multiprocessor)

40 No

PCIe Version

PCIe 3.0 x16 PCIe 4.0 x16

ML Software Support

CUDA Version

7.5 No

Clocks & Performance

Base Clock

585
🔥 +121% 1,295

Boost Clock

1,590
🔥 +53% 2,430

Memory Clock

1,250
🔥 +95% 2,438

Power Consumption

Recommended PSU

🔥 -58% 250 W
600 W

Power Connector

None 2x 8-pin

TDP/TGP

🔥 -73% 70 W
263 W

Rendering

Texture Units (TMU)

160
🔥 +50% 240

ROP

40
🔥 +50% 60

L2 Cache

4 MB
🔥 4 MB

Benchmarks

LLM Perf, Llama-2-7b-hf (bnb)

8.55 tokens/s

LLM Perf, Llama-2-7b-hf (gptq)

33.6 tokens/s

LLM Perf, Llama-2-7b-hf (unquantized)

16.7 tokens/s

LLM Perf, Llama-3.1-8B-Instruct (awq)

22.0 tokens/s

LLM Perf, Llama-3.1-8B-Instruct (bnb)

7.68 tokens/s

LLM Perf, Llama-3.1-8B-Instruct (gptq)

28.8 tokens/s

LLM Perf, Meta-Llama-3-8B (awq)

22.4 tokens/s

LLM Perf, Meta-Llama-3-8B (bnb)

7.96 tokens/s

LLM Perf, Meta-Llama-3-8B (gptq)

28.8 tokens/s

LLM Perf, Meta-Llama-3-8B-Instruct (awq)

22.3 tokens/s

LLM Perf, Meta-Llama-3-8B-Instruct (bnb)

7.76 tokens/s

LLM Perf, Meta-Llama-3-8B-Instruct (gptq)

29.1 tokens/s

llama.cpp, llama-2-7b-Q4_0

46.4 tokens/s

LLM Perf, Mistral-7B-Instruct-v0.2 (gptq)

26.4 tokens/s

LLM Perf, Mistral-7B-v0.1 (bnb)

8.01 tokens/s

LLM Perf, Mistral-7B-v0.1 (gptq)

25.7 tokens/s

LLM Perf, Mistral-7B-v0.1 (unquantized)

15.5 tokens/s

Additional

Slots

Single-slot Dual-slot

Release Date

Sept. 13, 2018 June 18, 2024

Display Outputs

No outputs
1x HDMI 2.1a
3x DisplayPort 2.1

Renting is cheaper than buying