Compatibility Reports

cancel

LLaVA 1.6 13B

RTX 4070 Ti SUPER

FAIL/OOM

26.0GB / 16.0GB VRAM -10.0GB

check_circle

CLIP ViT-L/14

RTX 3080 10GB

PERFECT

1.5GB / 10.0GB VRAM +8.5GB

check_circle

BGE-Large-EN

RTX 4080

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

check_circle

BGE-Small-EN

RTX 3060 12GB

PERFECT

0.1GB / 12.0GB VRAM +11.9GB

cancel

Llama 3.3 70B

RTX 3090 Ti

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

check_circle

SD 2.1

A100 40GB

PERFECT

5.0GB / 40.0GB VRAM +35.0GB

check_circle

BGE-Small-EN

RTX A6000

PERFECT

0.1GB / 48.0GB VRAM +47.9GB

cancel

FLUX.1 Schnell

RTX 4060 Ti 16GB

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

check_circle

BGE-Small-EN

RX 7900 XTX

PERFECT

0.1GB / 24.0GB VRAM +23.9GB

cancel

DeepSeek-V3

Jetson AGX Orin 32GB

FAIL/OOM

1342.0GB / 32.0GB VRAM -1310.0GB

check_circle

BGE-Large-EN

Jetson AGX Orin 32GB

PERFECT

0.7GB / 32.0GB VRAM +31.3GB

cancel

FLUX.1 Dev

RTX 3080 Ti

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

cancel

Llama 3 70B

RTX 3090 Ti

FAIL/OOM

35.0GB / 24.0GB VRAM -11.0GB

warning

FLUX.1 Schnell

RTX 4090

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

check_circle

FLUX.1 Schnell

H100 SXM

PERFECT

24.0GB / 80.0GB VRAM +56.0GB

cancel

Llama 3.1 405B

H100 PCIe

FAIL/OOM

202.5GB / 80.0GB VRAM -122.5GB

cancel

FLUX.1 Dev

RTX 4070 Ti

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

BGE-Small-EN

RTX 4070 SUPER

PERFECT

0.1GB / 12.0GB VRAM +11.9GB

check_circle

CLIP ViT-H/14

RTX 3060 12GB

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

check_circle

Gemma 2 9B

H100 PCIe

PERFECT

9.0GB / 80.0GB VRAM +71.0GB

check_circle

LLaVA 1.6 34B

H100 PCIe

PERFECT

68.0GB / 80.0GB VRAM +12.0GB

cancel

Qwen 2.5 32B

RTX 3090

FAIL/OOM

32.0GB / 24.0GB VRAM -8.0GB

cancel

DeepSeek-V2.5

RTX 4060 Ti 16GB

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

cancel

Mixtral 8x22B

RTX 3090 Ti

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB