Compatibility Reports

check_circle

CLIP ViT-L/14

RTX 3080 12GB

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Qwen2-VL 7B

Jetson AGX Orin 32GB

PERFECT

14.0GB / 32.0GB VRAM +18.0GB

cancel

LLaVA 1.6 7B

RTX 4060

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

56.4GB / 24.0GB VRAM -32.4GB

check_circle

Gemma 2 2B

H100 SXM

PERFECT

0.8GB / 80.0GB VRAM +79.2GB

check_circle

CLIP ViT-H/14

RTX 3080 12GB

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

check_circle

Phi-3 Small 7B

H100 SXM

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

LLaVA 1.6 13B

A100 40GB

PERFECT

26.0GB / 40.0GB VRAM +14.0GB

cancel

LLaVA 1.6 13B

RTX 4060 Ti 8GB

FAIL/OOM

26.0GB / 8.0GB VRAM -18.0GB

cancel

LLaVA 1.6 34B

RTX A6000

FAIL/OOM

68.0GB / 48.0GB VRAM -20.0GB

cancel

LLaVA 1.6 34B

RTX 5000 Ada

FAIL/OOM

68.0GB / 32.0GB VRAM -36.0GB

cancel

Llama 3.3 70B

RTX 3090

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

check_circle

LLaVA 1.6 7B

Jetson AGX Orin 64GB

PERFECT

14.0GB / 64.0GB VRAM +50.0GB

check_circle

CLIP ViT-L/14

RTX 4070 SUPER

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

cancel

DeepSeek-Coder-V2

RTX 5000 Ada

FAIL/OOM

472.0GB / 32.0GB VRAM -440.0GB

check_circle

FLUX.1 Schnell

H100 PCIe

PERFECT

24.0GB / 80.0GB VRAM +56.0GB

cancel

Llama 3 70B

RTX 4090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

check_circle

CLIP ViT-H/14

RTX A6000

PERFECT

2.0GB / 48.0GB VRAM +46.0GB

cancel

Qwen 2.5 32B

RTX 3090 Ti

FAIL/OOM

32.0GB / 24.0GB VRAM -8.0GB

cancel

DeepSeek-V3

RTX 3080 12GB

FAIL/OOM

1342.0GB / 12.0GB VRAM -1330.0GB

cancel

LLaVA 1.6 7B

RTX 4060 Ti 8GB

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

FLUX.1 Dev

RTX 4070 SUPER

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

cancel

LLaVA 1.6 7B

RTX 4070

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

LLaVA 1.6 13B

RTX 4070 Ti SUPER

FAIL/OOM

26.0GB / 16.0GB VRAM -10.0GB