Compatibility Reports

cancel

Llama 3.3 70B

A100 80GB

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

check_circle

BGE-Large-EN

H100 PCIe

PERFECT

0.7GB / 80.0GB VRAM +79.3GB

cancel

LLaVA 1.6 34B

RTX 3090

FAIL/OOM

68.0GB / 24.0GB VRAM -44.0GB

check_circle

BGE-M3

A100 80GB

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

cancel

Llama 3.3 70B

H100 SXM

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

check_circle

CLIP ViT-L/14

A100 40GB

PERFECT

1.5GB / 40.0GB VRAM +38.5GB

cancel

LLaVA 1.6 13B

RTX 4090

FAIL/OOM

26.0GB / 24.0GB VRAM -2.0GB

check_circle

CLIP ViT-L/14

A100 80GB

PERFECT

1.5GB / 80.0GB VRAM +78.5GB

cancel

DeepSeek-V3

H100 SXM

FAIL/OOM

1342.0GB / 80.0GB VRAM -1262.0GB

cancel

DeepSeek-Coder-V2

A100 80GB

FAIL/OOM

472.0GB / 80.0GB VRAM -392.0GB

cancel

LLaVA 1.6 34B

RTX 4090

FAIL/OOM

68.0GB / 24.0GB VRAM -44.0GB

cancel

LLaVA 1.6 13B

RX 7900 XTX

FAIL/OOM

26.0GB / 24.0GB VRAM -2.0GB

cancel

Mistral Large 2

H100 PCIe

FAIL/OOM

246.0GB / 80.0GB VRAM -166.0GB

check_circle

CLIP ViT-H/14

H100 PCIe

PERFECT

2.0GB / 80.0GB VRAM +78.0GB

cancel

LLaVA 1.6 34B

A100 40GB

FAIL/OOM

68.0GB / 40.0GB VRAM -28.0GB

cancel

Mistral Large 2

A100 80GB

FAIL/OOM

246.0GB / 80.0GB VRAM -166.0GB

check_circle

BGE-M3

H100 SXM

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

cancel

DeepSeek-Coder-V2

A100 40GB

FAIL/OOM

472.0GB / 40.0GB VRAM -432.0GB

check_circle

CLIP ViT-H/14

A100 40GB

PERFECT

2.0GB / 40.0GB VRAM +38.0GB

cancel

DeepSeek-V2.5

H100 SXM

FAIL/OOM

472.0GB / 80.0GB VRAM -392.0GB

cancel

LLaVA 1.6 34B

RTX 3090 Ti

FAIL/OOM

68.0GB / 24.0GB VRAM -44.0GB

cancel

DeepSeek-V3

A100 40GB

FAIL/OOM

1342.0GB / 40.0GB VRAM -1302.0GB

cancel

LLaVA 1.6 34B

RX 7900 XTX

FAIL/OOM

68.0GB / 24.0GB VRAM -44.0GB

check_circle

CLIP ViT-H/14

A100 80GB

PERFECT

2.0GB / 80.0GB VRAM +78.0GB