Compatibility Reports

check_circle

BGE-Small-EN

RTX 4070 Ti SUPER

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

check_circle

CLIP ViT-L/14

RTX 4070 Ti SUPER

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

BGE-Large-EN

RTX 4060 Ti 16GB

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

check_circle

Qwen 2.5 32B

A100 80GB

PERFECT

12.8GB / 80.0GB VRAM +67.2GB

cancel

LLaVA 1.6 34B

RTX 3080 Ti

FAIL/OOM

68.0GB / 12.0GB VRAM -56.0GB

cancel

Llama 3.3 70B

RTX 4060 Ti 8GB

FAIL/OOM

140.0GB / 8.0GB VRAM -132.0GB

cancel

Llama 3.3 70B

RTX 3080 10GB

FAIL/OOM

140.0GB / 10.0GB VRAM -130.0GB

cancel

LLaVA 1.6 34B

RTX 3060 Ti

FAIL/OOM

68.0GB / 8.0GB VRAM -60.0GB

cancel

LLaVA 1.6 34B

RTX 4080

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

check_circle

Mistral 7B

RTX 3090

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

SD 3 Medium

RTX 3060 12GB

PERFECT

6.0GB / 12.0GB VRAM +6.0GB

cancel

DeepSeek-V3

RTX A6000

FAIL/OOM

1342.0GB / 48.0GB VRAM -1294.0GB

check_circle

BGE-Small-EN

RX 7800 XT

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

check_circle

BGE-Small-EN

RTX 4000 Ada

PERFECT

0.1GB / 20.0GB VRAM +19.9GB

check_circle

BGE-Large-EN

RTX 4000 Ada

PERFECT

0.7GB / 20.0GB VRAM +19.3GB

cancel

DeepSeek-V2.5

RTX 4070 Ti SUPER

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

check_circle

CLIP ViT-L/14

RTX 3060 12GB

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

162.0GB / 40.0GB VRAM -122.0GB

check_circle

BGE-M3

RTX 4070

PERFECT

1.0GB / 12.0GB VRAM +11.0GB

cancel

LLaVA 1.6 34B

RTX 6000 Ada

FAIL/OOM

68.0GB / 48.0GB VRAM -20.0GB

check_circle

Gemma 2 9B

H100 PCIe

PERFECT

18.0GB / 80.0GB VRAM +62.0GB

cancel

Llama 3.3 70B

RTX 3080 Ti

FAIL/OOM

140.0GB / 12.0GB VRAM -128.0GB

cancel

Mixtral 8x22B

RTX 4090

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB

cancel

Llama 3.1 405B

RTX 3090

FAIL/OOM

162.0GB / 24.0GB VRAM -138.0GB