memory

AI Models for NVIDIA A100 40GB

40.0GB VRAM • NVIDIA • Ampere

info GPU Details
check_circle 54 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 18 Fail
check_circle

Gemma 2 9B

Gemma • 9.00B

PERFECT
4.5GB required +35.5GB headroom
check_circle

Qwen 2.5 72B

Qwen • 72.00B

PERFECT
28.8GB required +11.2GB headroom
check_circle

Qwen 2.5 7B

Qwen • 7.00B

PERFECT
2.8GB required +37.2GB headroom
check_circle

Qwen 2.5 7B

Qwen • 7.00B

PERFECT
14.0GB required +26.0GB headroom
check_circle

Llama 3 8B

Llama • 8.00B

PERFECT
4.0GB required +36.0GB headroom
check_circle

Qwen 2.5 72B

Qwen • 72.00B

PERFECT
36.0GB required +4.0GB headroom
check_circle

Mixtral 8x7B

Mistral • 46.70B

PERFECT
23.4GB required +16.6GB headroom
check_circle

Mixtral 8x7B

Mistral • 46.70B

PERFECT
18.7GB required +21.3GB headroom
check_circle

Gemma 2 2B

Gemma • 2.00B

PERFECT
1.0GB required +39.0GB headroom
check_circle

Gemma 2 9B

Gemma • 9.00B

PERFECT
18.0GB required +22.0GB headroom
check_circle

Phi-3 Mini 3.8B

Phi • 3.80B

PERFECT
1.5GB required +38.5GB headroom
check_circle

Gemma 2 2B

Gemma • 2.00B

PERFECT
4.0GB required +36.0GB headroom
check_circle

Llama 3 8B

Llama • 8.00B

PERFECT
8.0GB required +32.0GB headroom
check_circle

Gemma 2 27B

Gemma • 27.00B

PERFECT
13.5GB required +26.5GB headroom
check_circle

Qwen 2.5 14B

Qwen • 14.00B

PERFECT
28.0GB required +12.0GB headroom
check_circle

Gemma 2 9B

Gemma • 9.00B

PERFECT
9.0GB required +31.0GB headroom
check_circle

Phi-3 Small 7B

Phi • 7.00B

PERFECT
7.0GB required +33.0GB headroom
check_circle

Qwen 2.5 14B

Qwen • 14.00B

PERFECT
5.6GB required +34.4GB headroom
check_circle

Phi-3 Medium 14B

Phi • 14.00B

PERFECT
28.0GB required +12.0GB headroom
check_circle

Llama 3 8B

Llama • 8.00B

PERFECT
3.2GB required +36.8GB headroom
check_circle

Phi-3 Small 7B

Phi • 7.00B

PERFECT
3.5GB required +36.5GB headroom
check_circle

Llama 3 70B

Llama • 70.00B

PERFECT
35.0GB required +5.0GB headroom
check_circle

Mistral 7B

Mistral • 7.00B

PERFECT
2.8GB required +37.2GB headroom
check_circle

Phi-3 Medium 14B

Phi • 14.00B

PERFECT
7.0GB required +33.0GB headroom
Page 1 of 3 Next