smart_toy

GPUs for Mixtral 8x22B (141.00B)

141.00B parameters • 282.0GB VRAM (FP16) • Mistral

info Model Details
check_circle 6 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 22 Fail

Recommended minimum: H100 SXM (80.0GB) or higher for optimal performance

check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +9.5GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +9.5GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +23.6GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +23.6GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +23.6GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +9.5GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -258.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -258.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -258.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.5GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -117.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.5GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -117.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -46.5GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -32.4GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -117.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -32.4GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -32.4GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -242.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -101.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -30.5GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -16.4GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -202.0GB headroom
cancel

H100 SXM

NVIDIA • 80.0GB

FAIL/OOM
80.0GB available -61.0GB headroom
Page 1 of 2 Next