NelsaHost
search Login
smart_toy

GPUs for Llama 3.1 70B (70.00B)

70.00B parameters • 140.0GB VRAM (FP16) • Llama

info Model Details
check_circle 11 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 19 Fail

Recommended minimum: A100 40GB (40.0GB) or higher for optimal performance

check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +12.0GB headroom
check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +5.0GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +45.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +52.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +45.0GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +52.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +52.0GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +10.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +45.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +10.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +10.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -11.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -4.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -11.0GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -116.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -116.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -116.0GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -46.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -4.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -11.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -4.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -116.0GB headroom
Page 1 of 2 Next