Compatibility Reports

check_circle

Phi-3 Mini 3.8B

A100 40GB

PERFECT

1.9GB / 40.0GB VRAM +38.1GB

cancel

Llama 3.3 70B

RTX A4000

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

check_circle

Llama 3.1 8B

A100 80GB

PERFECT

4.0GB / 80.0GB VRAM +76.0GB

check_circle

Phi-3 Small 7B

H100 SXM

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

cancel

DeepSeek-Coder-V2

RTX 4060 Ti 8GB

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

check_circle

SD 2.1

RTX 3080 Ti

PERFECT

5.0GB / 12.0GB VRAM +7.0GB

check_circle

Gemma 2 27B

H100 SXM

PERFECT

10.8GB / 80.0GB VRAM +69.2GB

cancel

DeepSeek-V2.5

RTX 4000 Ada

FAIL/OOM

472.0GB / 20.0GB VRAM -452.0GB

check_circle

BGE-M3

RX 7800 XT

PERFECT

1.0GB / 16.0GB VRAM +15.0GB

cancel

Qwen 2.5 72B

RTX 4090

FAIL/OOM

72.0GB / 24.0GB VRAM -48.0GB

check_circle

BGE-M3

RTX 3060 Ti

PERFECT

1.0GB / 8.0GB VRAM +7.0GB

cancel

Qwen 2.5 72B

RTX 4090

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

cancel

LLaVA 1.6 13B

Jetson Orin Nano 8GB

FAIL/OOM

26.0GB / 8.0GB VRAM -18.0GB

check_circle

Llama 3 8B

RTX 3090 Ti

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Mistral Large 2

RTX 4060

FAIL/OOM

246.0GB / 8.0GB VRAM -238.0GB

check_circle

SD 2.1

RTX 4080

PERFECT

5.0GB / 16.0GB VRAM +11.0GB

check_circle

FLUX.1 Dev

A100 40GB

PERFECT

24.0GB / 40.0GB VRAM +16.0GB

cancel

Qwen 2.5 72B

RTX 4090

FAIL/OOM

28.8GB / 24.0GB VRAM -4.8GB

cancel

DeepSeek-Coder-V2

RTX 4060 Ti 16GB

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

check_circle

SD 2.1

RTX A4000

PERFECT

5.0GB / 16.0GB VRAM +11.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB

cancel

Mixtral 8x7B

RTX 3090

FAIL/OOM

46.7GB / 24.0GB VRAM -22.7GB

check_circle

Gemma 2 2B

RTX 3090 Ti

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

check_circle

Llama 3.1 8B

A100 40GB

PERFECT

3.2GB / 40.0GB VRAM +36.8GB