memory

AI Models for NVIDIA RTX 4090

24.0GB VRAM • NVIDIA • Ada Lovelace

info GPU Details
check_circle 57 Perfect
thumb_up 0 Good
warning 3 Marginal
cancel 36 Fail
check_circle

Mistral 7B

Mistral • 7.00B

PERFECT
2.8GB required +21.2GB headroom
check_circle

SD 2.1

Stable Diffusion • 0.87B

PERFECT
5.0GB required +19.0GB headroom
check_circle

BGE-M3

BGE • 0.50B

PERFECT
1.0GB required +23.0GB headroom
check_circle

CLIP ViT-L/14

CLIP • 0.40B

PERFECT
1.5GB required +22.5GB headroom
check_circle

BGE-Small-EN

BGE • 0.03B

PERFECT
0.1GB required +23.9GB headroom
check_circle

Qwen2-VL 7B

Qwen • 7.00B

PERFECT
14.0GB required +10.0GB headroom
check_circle

SD 1.5

Stable Diffusion • 0.98B

PERFECT
4.0GB required +20.0GB headroom
check_circle

BGE-Large-EN

BGE • 0.33B

PERFECT
0.7GB required +23.3GB headroom
check_circle

CLIP ViT-H/14

CLIP • 0.60B

PERFECT
2.0GB required +22.0GB headroom
warning

Mixtral 8x7B

Mistral • 46.70B

MARGINAL
23.4GB required +0.6GB headroom
warning

FLUX.1 Dev

FLUX • 12.00B

MARGINAL
24.0GB required +0.0GB headroom
warning

FLUX.1 Schnell

FLUX • 12.00B

MARGINAL
24.0GB required +0.0GB headroom
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
70.0GB required -46.0GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
810.0GB required -786.0GB headroom
cancel

Mixtral 8x7B

Mistral • 46.70B

FAIL/OOM
46.7GB required -22.7GB headroom
cancel

Llama 3.1 70B

Llama • 70.00B

FAIL/OOM
35.0GB required -11.0GB headroom
cancel

Mixtral 8x7B

Mistral • 46.70B

FAIL/OOM
93.4GB required -69.4GB headroom
cancel

Llama 3.1 405B

Llama • 405.00B

FAIL/OOM
405.0GB required -381.0GB headroom
cancel

Llama 3 70B

Llama • 70.00B

FAIL/OOM
70.0GB required -46.0GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
282.0GB required -258.0GB headroom
cancel

Mixtral 8x22B

Mistral • 141.00B

FAIL/OOM
141.0GB required -117.0GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
28.8GB required -4.8GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
72.0GB required -48.0GB headroom
cancel

Qwen 2.5 72B

Qwen • 72.00B

FAIL/OOM
144.0GB required -120.0GB headroom
Previous Page 3 of 4 Next