Compatibility Reports

check_circle

Mistral 7B

A100 80GB

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

Gemma 2 9B

RTX 4090

PERFECT

9.0GB / 24.0GB VRAM +15.0GB

check_circle

SD 3 Medium

RTX A6000

PERFECT

6.0GB / 48.0GB VRAM +42.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

141.0GB / 24.0GB VRAM -117.0GB

check_circle

SDXL 1.0

RTX 4080 SUPER

PERFECT

8.0GB / 16.0GB VRAM +8.0GB

check_circle

SDXL 1.0

RTX 4070 Ti

PERFECT

8.0GB / 12.0GB VRAM +4.0GB

warning

FLUX.1 Dev

RX 7900 XTX

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

cancel

Mixtral 8x7B

RTX 3090 Ti

FAIL/OOM

46.7GB / 24.0GB VRAM -22.7GB

cancel

Mixtral 8x7B

RTX 3090

FAIL/OOM

93.4GB / 24.0GB VRAM -69.4GB

check_circle

Llama 3 70B

H100 SXM

PERFECT

70.0GB / 80.0GB VRAM +10.0GB

check_circle

Mixtral 8x22B

H100 SXM

PERFECT

70.5GB / 80.0GB VRAM +9.5GB

check_circle

CLIP ViT-L/14

RTX 3070

PERFECT

1.5GB / 8.0GB VRAM +6.5GB

check_circle

Qwen 2.5 32B

RTX 3090 Ti

PERFECT

12.8GB / 24.0GB VRAM +11.2GB

check_circle

Llama 3 8B

A100 80GB

PERFECT

8.0GB / 80.0GB VRAM +72.0GB

check_circle

Phi-3 Medium 14B

A100 40GB

PERFECT

5.6GB / 40.0GB VRAM +34.4GB

cancel

Llama 3.1 405B

RTX 3090 Ti

FAIL/OOM

405.0GB / 24.0GB VRAM -381.0GB

check_circle

BGE-M3

Jetson Orin Nano 8GB

PERFECT

1.0GB / 8.0GB VRAM +7.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

282.0GB / 24.0GB VRAM -258.0GB

check_circle

Qwen 2.5 14B

RTX 3090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

SDXL 1.0

RTX 4070

PERFECT

8.0GB / 12.0GB VRAM +4.0GB

cancel

Llama 3.1 405B

H100 PCIe

FAIL/OOM

405.0GB / 80.0GB VRAM -325.0GB

check_circle

Llama 3 8B

A100 40GB

PERFECT

3.2GB / 40.0GB VRAM +36.8GB

check_circle

SDXL 1.0

RTX 4090

PERFECT

8.0GB / 24.0GB VRAM +16.0GB

check_circle

Qwen 2.5 14B

A100 40GB

PERFECT

7.0GB / 40.0GB VRAM +33.0GB