Compatibility Reports

cancel

DeepSeek-Coder-V2

RTX 3090

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

cancel

DeepSeek-V3

RTX 3090

FAIL/OOM

1342.0GB / 24.0GB VRAM -1318.0GB

cancel

Qwen2-VL 72B

RTX 4060 Ti 8GB

FAIL/OOM

144.0GB / 8.0GB VRAM -136.0GB

check_circle

CLIP ViT-H/14

RTX 3090

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

check_circle

Gemma 2 9B

H100 PCIe

PERFECT

4.5GB / 80.0GB VRAM +75.5GB

check_circle

BGE-Small-EN

RTX 4090

PERFECT

0.1GB / 24.0GB VRAM +23.9GB

check_circle

CLIP ViT-H/14

Jetson AGX Orin 32GB

PERFECT

2.0GB / 32.0GB VRAM +30.0GB

cancel

Qwen2-VL 7B

RTX 4060

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

LLaVA 1.6 34B

RX 7900 XT

FAIL/OOM

68.0GB / 20.0GB VRAM -48.0GB

cancel

LLaVA 1.6 7B

RTX 3080 10GB

FAIL/OOM

14.0GB / 10.0GB VRAM -4.0GB

check_circle

CLIP ViT-L/14

RTX 4090

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

cancel

Qwen2-VL 72B

RTX A5000

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

check_circle

Qwen2-VL 7B

RTX 5000 Ada

PERFECT

14.0GB / 32.0GB VRAM +18.0GB

check_circle

Qwen2-VL 7B

RTX 4090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

FLUX.1 Schnell

A100 80GB

PERFECT

24.0GB / 80.0GB VRAM +56.0GB

check_circle

LLaVA 1.6 7B

H100 SXM

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

LLaVA 1.6 7B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

cancel

Qwen2-VL 72B

RTX 3060 12GB

FAIL/OOM

144.0GB / 12.0GB VRAM -132.0GB

cancel

Llama 3 70B

RTX 4090

FAIL/OOM

35.0GB / 24.0GB VRAM -11.0GB

cancel

LLaVA 1.6 34B

RX 7800 XT

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

cancel

DeepSeek-Coder-V2

RTX 4090

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

cancel

Qwen2-VL 72B

RTX 3080 12GB

FAIL/OOM

144.0GB / 12.0GB VRAM -132.0GB

check_circle

CLIP ViT-L/14

RTX 3090

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

cancel

Qwen2-VL 72B

RTX 4070 Ti

FAIL/OOM

144.0GB / 12.0GB VRAM -132.0GB