Compatibility Reports

check_circle

BGE-Large-EN

RTX 3070

PERFECT

0.7GB / 8.0GB VRAM +7.3GB

cancel

Llama 3.1 405B

RTX 4090

FAIL/OOM

405.0GB / 24.0GB VRAM -381.0GB

check_circle

SD 3 Medium

RTX 3080 Ti

PERFECT

6.0GB / 12.0GB VRAM +6.0GB

check_circle

Phi-3 Medium 14B

RTX 3090 Ti

PERFECT

5.6GB / 24.0GB VRAM +18.4GB

check_circle

FLUX.1 Dev

Jetson AGX Orin 64GB

PERFECT

24.0GB / 64.0GB VRAM +40.0GB

cancel

Llama 3.1 405B

H100 PCIe

FAIL/OOM

810.0GB / 80.0GB VRAM -730.0GB

check_circle

SD 1.5

Jetson AGX Orin 64GB

PERFECT

4.0GB / 64.0GB VRAM +60.0GB

check_circle

SDXL 1.0

RTX A4000

PERFECT

8.0GB / 16.0GB VRAM +8.0GB

check_circle

SDXL 1.0

RTX A6000

PERFECT

8.0GB / 48.0GB VRAM +40.0GB

check_circle

Mixtral 8x7B

H100 SXM

PERFECT

46.7GB / 80.0GB VRAM +33.3GB

check_circle

SD 2.1

H100 SXM

PERFECT

5.0GB / 80.0GB VRAM +75.0GB

check_circle

CLIP ViT-L/14

Jetson Orin Nano 8GB

PERFECT

1.5GB / 8.0GB VRAM +6.5GB

check_circle

SD 1.5

RTX 3070

PERFECT

4.0GB / 8.0GB VRAM +4.0GB

check_circle

SD 3 Medium

RTX 3090 Ti

PERFECT

6.0GB / 24.0GB VRAM +18.0GB

check_circle

Qwen 2.5 32B

A100 80GB

PERFECT

64.0GB / 80.0GB VRAM +16.0GB

check_circle

Llama 3.1 8B

RTX 3090 Ti

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

check_circle

Qwen 2.5 32B

A100 40GB

PERFECT

16.0GB / 40.0GB VRAM +24.0GB

cancel

Llama 3.3 70B

RTX 4060

FAIL/OOM

140.0GB / 8.0GB VRAM -132.0GB

cancel

Llama 3.1 405B

RTX 3090

FAIL/OOM

405.0GB / 24.0GB VRAM -381.0GB

check_circle

SDXL 1.0

RTX 3060 12GB

PERFECT

8.0GB / 12.0GB VRAM +4.0GB

cancel

FLUX.1 Schnell

RTX 3070

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

Gemma 2 9B

RTX 3090 Ti

PERFECT

18.0GB / 24.0GB VRAM +6.0GB

cancel

Llama 3.3 70B

RTX 6000 Ada

FAIL/OOM

140.0GB / 48.0GB VRAM -92.0GB

check_circle

SD 3 Medium

RTX 4070 Ti

PERFECT

6.0GB / 12.0GB VRAM +6.0GB