Compatibility Reports

check_circle

Llama 3 8B

RTX 4090

PERFECT

3.2GB / 24.0GB VRAM +20.8GB

check_circle

SDXL 1.0

RX 7900 XT

PERFECT

8.0GB / 20.0GB VRAM +12.0GB

check_circle

Whisper Medium

RTX 4070

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Phi-3 Small 7B

H100 PCIe

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

Qwen 2.5 14B

RTX 4090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Phi-3 Small 7B

A100 40GB

PERFECT

7.0GB / 40.0GB VRAM +33.0GB

check_circle

Whisper Medium

A100 40GB

PERFECT

1.5GB / 40.0GB VRAM +38.5GB

check_circle

Llama 3.1 8B

A100 80GB

PERFECT

16.0GB / 80.0GB VRAM +64.0GB

check_circle

Whisper Small

RTX 3090

PERFECT

0.5GB / 24.0GB VRAM +23.5GB

check_circle

Whisper Base

RX 7900 XT

PERFECT

0.2GB / 20.0GB VRAM +19.8GB

check_circle

Qwen 2.5 7B

A100 40GB

PERFECT

7.0GB / 40.0GB VRAM +33.0GB

check_circle

Qwen 2.5 72B

H100 SXM

PERFECT

36.0GB / 80.0GB VRAM +44.0GB

check_circle

Phi-3 Mini 3.8B

RTX 4090

PERFECT

7.6GB / 24.0GB VRAM +16.4GB

check_circle

Phi-3 Medium 14B

RTX 4090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Gemma 2 2B

RTX 4090

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

check_circle

Qwen2-VL 7B

RX 7900 XTX

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Llama 3.1 70B

H100 PCIe

PERFECT

28.0GB / 80.0GB VRAM +52.0GB

check_circle

Phi-3 Small 7B

RTX 3090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Qwen 2.5 32B

RTX 3090 Ti

PERFECT

16.0GB / 24.0GB VRAM +8.0GB

check_circle

Whisper Medium

RTX 3090 Ti

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

check_circle

Phi-3 Mini 3.8B

RTX 3090

PERFECT

3.8GB / 24.0GB VRAM +20.2GB

check_circle

Llama 3 70B

H100 PCIe

PERFECT

35.0GB / 80.0GB VRAM +45.0GB

check_circle

Gemma 2 9B

A100 40GB

PERFECT

9.0GB / 40.0GB VRAM +31.0GB

check_circle

Qwen 2.5 32B

RTX 3090

PERFECT

12.8GB / 24.0GB VRAM +11.2GB