NelsaHost
search Login
smart_toy

GPUs for Llama 3.1 405B (405.00B)

405.00B parameters • 810.0GB VRAM (FP16) • Llama

info Model Details
check_circle 0 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 32 Fail
cancel

H100 PCIe

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -325.0GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -325.0GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -82.0GB headroom
cancel

H100 PCIe

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -82.0GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -730.0GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -122.5GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -325.0GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -730.0GB headroom
Previous Page 2 of 2