memory

AI Models for NVIDIA A100 40GB

40.0GB VRAM • NVIDIA • Ampere

info GPU Details
check_circle 71 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 25 Fail
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
141.0GB required -101.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
202.5GB required -162.5GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
162.0GB required -122.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
810.0GB required -770.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
405.0GB required -365.0GB headroom
cancel

Mixtral 8x7B

Mistral • 46.70B

FAIL/OOM
93.4GB required -53.4GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
70.5GB required -30.5GB headroom
cancel

Mixtral 8x7B

Mistral • 46.70B

FAIL/OOM
46.7GB required -6.7GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
56.4GB required -16.4GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
72.0GB required -32.0GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
144.0GB required -104.0GB headroom
cancel

Gemma 2 27B

Gemma • 27.00B

FAIL/OOM
54.0GB required -14.0GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
70.0GB required -30.0GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -100.0GB headroom
cancel

Qwen 2.5 32B

Qwen • 32.00B

FAIL/OOM
64.0GB required -24.0GB headroom
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -100.0GB headroom
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
70.0GB required -30.0GB headroom
cancel

LLaVA 1.6 34B

LLaVA • 34.00B

FAIL/OOM
68.0GB required -28.0GB headroom
cancel

DeepSeek-V3

DeepSeek • 671.00B

FAIL/OOM
1342.0GB required -1302.0GB headroom
cancel

DeepSeek-Coder-V2

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -432.0GB headroom
cancel

Mistral Large 2

Mistral • 123.00B

FAIL/OOM
246.0GB required -206.0GB headroom
cancel

Qwen2-VL 72B

Qwen • 72.00B

FAIL/OOM
144.0GB required -104.0GB headroom
cancel

DeepSeek-V2.5

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -432.0GB headroom
cancel

Llama 3.3 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -100.0GB headroom
Previous Page 4 of 4