NelsaHost
search Login
smart_toy

GPUs for Llama 3.1 405B (405.00B)

405.00B parameters • 810.0GB VRAM (FP16) • Llama

info Model Details
check_circle 0 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 32 Fail
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -178.5GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -381.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -138.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -178.5GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -786.0GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -138.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -786.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -786.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -786.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -178.5GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -381.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -381.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -138.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -138.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -381.0GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -178.5GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -162.5GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -770.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -122.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -365.0GB headroom
cancel

H100 PCIe

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -730.0GB headroom
cancel

H100 PCIe

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -122.5GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -82.0GB headroom
cancel

A100 80GB

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -122.5GB headroom
Page 1 of 2 Next