Compatibility Reports

check_circle

Llama 3.1 8B

RTX 3090 Ti

PERFECT

3.2GB / 24.0GB VRAM +20.8GB

check_circle

Qwen 2.5 7B

H100 PCIe

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

SD 1.5

RTX 3060 Ti

PERFECT

4.0GB / 8.0GB VRAM +4.0GB

check_circle

Llama 3.1 8B

RTX 3090 Ti

PERFECT

8.0GB / 24.0GB VRAM +16.0GB

check_circle

SDXL 1.0

RTX 5000 Ada

PERFECT

8.0GB / 32.0GB VRAM +24.0GB

check_circle

Phi-3 Medium 14B

H100 SXM

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Mixtral 8x7B

H100 PCIe

PERFECT

46.7GB / 80.0GB VRAM +33.3GB

check_circle

SDXL 1.0

RTX 4070 Ti SUPER

PERFECT

8.0GB / 16.0GB VRAM +8.0GB

check_circle

Gemma 2 27B

A100 80GB

PERFECT

10.8GB / 80.0GB VRAM +69.2GB

check_circle

Phi-3 Medium 14B

RTX 3090 Ti

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

cancel

DeepSeek-Coder-V2

RTX 4060

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

check_circle

Mixtral 8x7B

A100 40GB

PERFECT

23.4GB / 40.0GB VRAM +16.6GB

warning

SDXL 1.0

Jetson Orin Nano 8GB

MARGINAL

8.0GB / 8.0GB VRAM +0.0GB

check_circle

SD 3 Medium

RTX 4090

PERFECT

6.0GB / 24.0GB VRAM +18.0GB

check_circle

Mistral 7B

A100 40GB

PERFECT

3.5GB / 40.0GB VRAM +36.5GB

cancel

FLUX.1 Dev

Jetson Orin Nano 8GB

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

thumb_up

SDXL 1.0

RTX 3080 10GB

GOOD

8.0GB / 10.0GB VRAM +2.0GB

check_circle

SD 3 Medium

Jetson AGX Orin 32GB

PERFECT

6.0GB / 32.0GB VRAM +26.0GB

cancel

Llama 3.3 70B

Jetson AGX Orin 64GB

FAIL/OOM

140.0GB / 64.0GB VRAM -76.0GB

check_circle

Llama 3.1 70B

A100 40GB

PERFECT

28.0GB / 40.0GB VRAM +12.0GB

cancel

Llama 3 70B

RTX 4090

FAIL/OOM

70.0GB / 24.0GB VRAM -46.0GB

cancel

Llama 3.3 70B

Jetson Orin Nano 8GB

FAIL/OOM

140.0GB / 8.0GB VRAM -132.0GB

cancel

FLUX.1 Dev

RTX 4060

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

Mistral 7B

RTX 3090 Ti

PERFECT

14.0GB / 24.0GB VRAM +10.0GB