Compatibility Reports

cancel

Mixtral 8x22B

RTX 3090 Ti

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB

cancel

LLaVA 1.6 7B

RTX 4070 Ti

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

check_circle

Gemma 2 2B

H100 SXM

PERFECT

2.0GB / 80.0GB VRAM +78.0GB

check_circle

BGE-Small-EN

RTX 3090

PERFECT

0.1GB / 24.0GB VRAM +23.9GB

cancel

Qwen 2.5 32B

RTX 4090

FAIL/OOM

32.0GB / 24.0GB VRAM -8.0GB

check_circle

SD 1.5

RTX 3090 Ti

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Mixtral 8x22B

A100 80GB

FAIL/OOM

282.0GB / 80.0GB VRAM -202.0GB

check_circle

Qwen2-VL 7B

RTX A5000

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

cancel

Llama 3 70B

RTX 3090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

check_circle

BGE-Small-EN

Jetson AGX Orin 32GB

PERFECT

0.1GB / 32.0GB VRAM +31.9GB

cancel

Mixtral 8x22B

H100 SXM

FAIL/OOM

141.0GB / 80.0GB VRAM -61.0GB

cancel

Mixtral 8x22B

A100 40GB

FAIL/OOM

70.5GB / 40.0GB VRAM -30.5GB

cancel

Qwen 2.5 72B

RTX 3090 Ti

FAIL/OOM

36.0GB / 24.0GB VRAM -12.0GB

check_circle

Qwen2-VL 7B

RTX 4000 Ada

PERFECT

14.0GB / 20.0GB VRAM +6.0GB

cancel

FLUX.1 Schnell

RX 7900 XT

FAIL/OOM

24.0GB / 20.0GB VRAM -4.0GB

cancel

DeepSeek-V3

RX 7900 XTX

FAIL/OOM

1342.0GB / 24.0GB VRAM -1318.0GB

check_circle

Qwen2-VL 7B

RTX A6000

PERFECT

14.0GB / 48.0GB VRAM +34.0GB

thumb_up

Qwen2-VL 7B

RTX 4080

GOOD

14.0GB / 16.0GB VRAM +2.0GB

cancel

DeepSeek-V3

H100 PCIe

FAIL/OOM

1342.0GB / 80.0GB VRAM -1262.0GB

check_circle

Gemma 2 2B

A100 80GB

PERFECT

0.8GB / 80.0GB VRAM +79.2GB

warning

FLUX.1 Dev

RTX 3090 Ti

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

cancel

Mixtral 8x22B

RTX 3090 Ti

FAIL/OOM

56.4GB / 24.0GB VRAM -32.4GB

cancel

Mixtral 8x22B

A100 40GB

FAIL/OOM

56.4GB / 40.0GB VRAM -16.4GB

cancel

LLaVA 1.6 34B

RTX 3080 10GB

FAIL/OOM

68.0GB / 10.0GB VRAM -58.0GB