Compatibility Reports

cancel

Qwen 2.5 14B

RTX 3090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Phi-3 Medium 14B

RTX 4090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Llama 3 70B

H100 PCIe

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Gemma 2 27B

A100 40GB

FAIL/OOM

54.0GB / 40.0GB VRAM -14.0GB

cancel

Qwen 2.5 32B

A100 40GB

FAIL/OOM

64.0GB / 40.0GB VRAM -24.0GB

cancel

Mixtral 8x7B

A100 80GB

FAIL/OOM

93.4GB / 80.0GB VRAM -13.4GB

cancel

Llama 3.1 70B

H100 SXM

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Llama 3 70B

A100 40GB

FAIL/OOM

140.0GB / 40.0GB VRAM -100.0GB

cancel

Llama 3 70B

A100 40GB

FAIL/OOM

70.0GB / 40.0GB VRAM -30.0GB

cancel

Qwen 2.5 14B

RTX 3090 Ti

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Llama 3.1 70B

A100 80GB

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Qwen 2.5 72B

H100 SXM

FAIL/OOM

144.0GB / 80.0GB VRAM -64.0GB

cancel

Mixtral 8x7B

H100 PCIe

FAIL/OOM

93.4GB / 80.0GB VRAM -13.4GB

cancel

Llama 3.1 70B

A100 40GB

FAIL/OOM

140.0GB / 40.0GB VRAM -100.0GB

cancel

Phi-3 Medium 14B

RTX 3090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Llama 3 70B

A100 80GB

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Qwen 2.5 72B

A100 80GB

FAIL/OOM

144.0GB / 80.0GB VRAM -64.0GB

cancel

Phi-3 Medium 14B

RTX 3090 Ti

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Llama 3.1 70B

A100 40GB

FAIL/OOM

70.0GB / 40.0GB VRAM -30.0GB

check_circle

BGE-M3

H100 PCIe

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

cancel

DeepSeek-V3

A100 80GB

FAIL/OOM

1342.0GB / 80.0GB VRAM -1262.0GB

check_circle

CLIP ViT-L/14

H100 PCIe

PERFECT

1.5GB / 80.0GB VRAM +78.5GB

cancel

Llama 3.3 70B

H100 PCIe

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

check_circle

CLIP ViT-L/14

H100 SXM

PERFECT

1.5GB / 80.0GB VRAM +78.5GB