memory

AI Models for NVIDIA RTX 4090

24.0GB VRAM • NVIDIA • Ada Lovelace

info GPU Details
check_circle 57 Perfect
thumb_up 0 Good
warning 3 Marginal
cancel 36 Fail
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -116.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
202.5GB required -178.5GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
36.0GB required -12.0GB headroom
cancel

Qwen 2.5 32B

Qwen • 32.00B

FAIL/OOM
64.0GB required -40.0GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
70.5GB required -46.5GB headroom
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
28.0GB required -4.0GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -116.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
162.0GB required -138.0GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
56.4GB required -32.4GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
28.0GB required -4.0GB headroom
cancel

Qwen 2.5 32B

Qwen • 32.00B

FAIL/OOM
32.0GB required -8.0GB headroom
cancel

Llama 3.3 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -116.0GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
35.0GB required -11.0GB headroom
cancel

Mistral Large 2

Mistral • 123.00B

FAIL/OOM
246.0GB required -222.0GB headroom
cancel

DeepSeek-Coder-V2

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -448.0GB headroom
cancel

DeepSeek-V3

DeepSeek • 671.00B

FAIL/OOM
1342.0GB required -1318.0GB headroom
cancel

DeepSeek-V2.5

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -448.0GB headroom
cancel

Gemma 2 27B

Gemma • 27.00B

FAIL/OOM
54.0GB required -30.0GB headroom
cancel

Gemma 2 27B

Gemma • 27.00B

FAIL/OOM
27.0GB required -3.0GB headroom
cancel

Qwen2-VL 72B

Qwen • 72.00B

FAIL/OOM
144.0GB required -120.0GB headroom
cancel

Qwen 2.5 14B

Qwen • 14.00B

FAIL/OOM
28.0GB required -4.0GB headroom
cancel

Phi-3 Medium 14B

Phi • 14.00B

FAIL/OOM
28.0GB required -4.0GB headroom
cancel

LLaVA 1.6 13B

LLaVA • 13.00B

FAIL/OOM
26.0GB required -2.0GB headroom
cancel

LLaVA 1.6 34B

LLaVA • 34.00B

FAIL/OOM
68.0GB required -44.0GB headroom
Previous Page 4 of 4