Compatibility Reports

cancel

Mixtral 8x22B

H100 PCIe

FAIL/OOM

141.0GB / 80.0GB VRAM -61.0GB

cancel

DeepSeek-V3

RTX 4070 SUPER

FAIL/OOM

1342.0GB / 12.0GB VRAM -1330.0GB

cancel

DeepSeek-V3

RTX 4070 Ti SUPER

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB

check_circle

BGE-Small-EN

RTX 4080 SUPER

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

check_circle

CLIP ViT-L/14

RTX A4000

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

cancel

DeepSeek-V2.5

RTX A6000

FAIL/OOM

472.0GB / 48.0GB VRAM -424.0GB

check_circle

Llama 3 8B

A100 80GB

PERFECT

4.0GB / 80.0GB VRAM +76.0GB

cancel

FLUX.1 Dev

RTX 3070

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

cancel

Llama 3.3 70B

RTX 4000 Ada

FAIL/OOM

140.0GB / 20.0GB VRAM -120.0GB

cancel

Mixtral 8x22B

A100 40GB

FAIL/OOM

141.0GB / 40.0GB VRAM -101.0GB

cancel

DeepSeek-Coder-V2

RTX 3070

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

cancel

FLUX.1 Schnell

RTX 4060

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

Gemma 2 2B

A100 40GB

PERFECT

1.0GB / 40.0GB VRAM +39.0GB

check_circle

BGE-M3

RTX 4000 Ada

PERFECT

1.0GB / 20.0GB VRAM +19.0GB

cancel

Llama 3.3 70B

RX 7900 XT

FAIL/OOM

140.0GB / 20.0GB VRAM -120.0GB

cancel

DeepSeek-Coder-V2

RTX 3080 Ti

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

check_circle

CLIP ViT-L/14

RTX A6000

PERFECT

1.5GB / 48.0GB VRAM +46.5GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

202.5GB / 40.0GB VRAM -162.5GB

cancel

Mistral Large 2

RTX 4080

FAIL/OOM

246.0GB / 16.0GB VRAM -230.0GB

check_circle

CLIP ViT-H/14

RX 7800 XT

PERFECT

2.0GB / 16.0GB VRAM +14.0GB

check_circle

Gemma 2 2B

A100 40GB

PERFECT

0.8GB / 40.0GB VRAM +39.2GB

check_circle

BGE-Large-EN

RX 7900 XT

PERFECT

0.7GB / 20.0GB VRAM +19.3GB

cancel

DeepSeek-V3

RTX 3070 Ti

FAIL/OOM

1342.0GB / 8.0GB VRAM -1334.0GB

check_circle

Phi-3 Medium 14B

H100 SXM

PERFECT

5.6GB / 80.0GB VRAM +74.4GB