Compatibility Reports

check_circle

BGE-Small-EN

RTX 3070 Ti

PERFECT

0.1GB / 8.0GB VRAM +7.9GB

cancel

DeepSeek-V3

RTX 4060

FAIL/OOM

1342.0GB / 8.0GB VRAM -1334.0GB

check_circle

Llama 3 8B

H100 PCIe

PERFECT

16.0GB / 80.0GB VRAM +64.0GB

cancel

Qwen 2.5 32B

RTX 3090

FAIL/OOM

64.0GB / 24.0GB VRAM -40.0GB

check_circle

Phi-3 Mini 3.8B

H100 SXM

PERFECT

3.8GB / 80.0GB VRAM +76.2GB

check_circle

Llama 3.1 8B

A100 40GB

PERFECT

8.0GB / 40.0GB VRAM +32.0GB

check_circle

SD 3 Medium

A100 80GB

PERFECT

6.0GB / 80.0GB VRAM +74.0GB

check_circle

Mixtral 8x22B

H100 PCIe

PERFECT

56.4GB / 80.0GB VRAM +23.6GB

check_circle

Mixtral 8x22B

H100 SXM

PERFECT

56.4GB / 80.0GB VRAM +23.6GB

check_circle

Phi-3 Small 7B

RTX 4090

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

Phi-3 Medium 14B

RTX 3090

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

cancel

Mistral Large 2

RTX 4070 Ti SUPER

FAIL/OOM

246.0GB / 16.0GB VRAM -230.0GB

check_circle

BGE-Large-EN

RTX 4060 Ti 8GB

PERFECT

0.7GB / 8.0GB VRAM +7.3GB

cancel

Llama 3 70B

RTX 3090 Ti

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

FLUX.1 Schnell

Jetson Orin Nano 8GB

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

cancel

Llama 3.3 70B

RTX 4080

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

cancel

Mixtral 8x22B

RTX 4090

FAIL/OOM

141.0GB / 24.0GB VRAM -117.0GB

cancel

DeepSeek-Coder-V2

RTX 4070 Ti SUPER

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

check_circle

Llama 3 70B

A100 80GB

PERFECT

35.0GB / 80.0GB VRAM +45.0GB

check_circle

Gemma 2 2B

RTX 3090 Ti

PERFECT

0.8GB / 24.0GB VRAM +23.2GB

check_circle

Phi-3 Mini 3.8B

H100 PCIe

PERFECT

1.5GB / 80.0GB VRAM +78.5GB

check_circle

Mixtral 8x7B

A100 80GB

PERFECT

23.4GB / 80.0GB VRAM +56.6GB

check_circle

Llama 3.1 8B

RTX 3090

PERFECT

3.2GB / 24.0GB VRAM +20.8GB

cancel

Mistral Large 2

RTX 3070

FAIL/OOM

246.0GB / 8.0GB VRAM -238.0GB