NelsaHost
search Login
smart_toy

GPUs for Llama 3.1 70B (70.00B)

70.00B parameters • 140.0GB VRAM (FP16) • Llama

info Model Details
check_circle 11 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 19 Fail

Recommended minimum: A100 40GB (40.0GB) or higher for optimal performance

cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -100.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -30.0GB headroom
cancel

H100 PCIe

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -60.0GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -60.0GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -60.0GB headroom
Previous Page 2 of 2