Compatibility Reports

cancel

Qwen2-VL 72B

RTX 3080 Ti

FAIL/OOM

144.0GB / 12.0GB VRAM -132.0GB

cancel

Qwen2-VL 72B

Jetson AGX Orin 64GB

FAIL/OOM

144.0GB / 64.0GB VRAM -80.0GB

cancel

Qwen2-VL 72B

RTX A6000

FAIL/OOM

144.0GB / 48.0GB VRAM -96.0GB

cancel

Qwen2-VL 7B

RTX 3070

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

Qwen2-VL 72B

RTX 4060 Ti 16GB

FAIL/OOM

144.0GB / 16.0GB VRAM -128.0GB

check_circle

CLIP ViT-H/14

RTX 3090 Ti

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

cancel

Llama 3.1 405B

H100 SXM

FAIL/OOM

405.0GB / 80.0GB VRAM -325.0GB

cancel

DeepSeek-V3

RTX 4090

FAIL/OOM

1342.0GB / 24.0GB VRAM -1318.0GB

cancel

Mistral Large 2

RTX 4090

FAIL/OOM

246.0GB / 24.0GB VRAM -222.0GB

cancel

Mistral Large 2

RTX 3090

FAIL/OOM

246.0GB / 24.0GB VRAM -222.0GB

cancel

Qwen 2.5 72B

A100 40GB

FAIL/OOM

72.0GB / 40.0GB VRAM -32.0GB

cancel

Qwen2-VL 72B

RTX 5000 Ada

FAIL/OOM

144.0GB / 32.0GB VRAM -112.0GB

cancel

Qwen2-VL 72B

RTX 3080 10GB

FAIL/OOM

144.0GB / 10.0GB VRAM -134.0GB

cancel

Mistral Large 2

RTX 3090 Ti

FAIL/OOM

246.0GB / 24.0GB VRAM -222.0GB

cancel

DeepSeek-V2.5

RTX 4090

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

check_circle

BGE-Small-EN

RTX 3090 Ti

PERFECT

0.1GB / 24.0GB VRAM +23.9GB

cancel

Qwen2-VL 7B

RTX 3080 Ti

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

LLaVA 1.6 34B

Jetson AGX Orin 32GB

FAIL/OOM

68.0GB / 32.0GB VRAM -36.0GB

check_circle

SD 1.5

RTX 4090

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Qwen2-VL 7B

RTX 3060 12GB

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

LLaVA 1.6 13B

RX 7900 XT

FAIL/OOM

26.0GB / 20.0GB VRAM -6.0GB

check_circle

SD 1.5

RX 7900 XTX

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Llama 3.3 70B

RX 7900 XTX

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

Qwen2-VL 72B

Jetson AGX Orin 32GB

FAIL/OOM

144.0GB / 32.0GB VRAM -112.0GB