Compatibility Reports

check_circle

Qwen 2.5 72B

A100 80GB

PERFECT

28.8GB / 80.0GB VRAM +51.2GB

check_circle

Llama 3 8B

RTX 3090 Ti

PERFECT

8.0GB / 24.0GB VRAM +16.0GB

check_circle

Whisper Medium

RTX 3080 10GB

PERFECT

1.5GB / 10.0GB VRAM +8.5GB

check_circle

Phi-3 Mini 3.8B

A100 80GB

PERFECT

1.9GB / 80.0GB VRAM +78.1GB

check_circle

Qwen 2.5 7B

A100 80GB

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Whisper Medium

RTX 4060 Ti 16GB

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

Whisper Medium

RTX 4070 Ti

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Llama 3 8B

RTX 3090

PERFECT

8.0GB / 24.0GB VRAM +16.0GB

check_circle

Whisper Base

RTX 5000 Ada

PERFECT

0.2GB / 32.0GB VRAM +31.8GB

check_circle

Whisper Small

RTX A6000

PERFECT

0.5GB / 48.0GB VRAM +47.5GB

check_circle

Whisper Base

A100 80GB

PERFECT

0.2GB / 80.0GB VRAM +79.8GB

check_circle

Qwen 2.5 72B

A100 40GB

PERFECT

36.0GB / 40.0GB VRAM +4.0GB

check_circle

Whisper Medium

RTX 5000 Ada

PERFECT

1.5GB / 32.0GB VRAM +30.5GB

check_circle

Whisper Base

RX 7800 XT

PERFECT

0.2GB / 16.0GB VRAM +15.8GB

check_circle

Whisper Base

RTX 4080

PERFECT

0.2GB / 16.0GB VRAM +15.8GB

check_circle

Phi-3 Medium 14B

H100 PCIe

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Gemma 2 9B

A100 40GB

PERFECT

18.0GB / 40.0GB VRAM +22.0GB

check_circle

Gemma 2 2B

H100 PCIe

PERFECT

2.0GB / 80.0GB VRAM +78.0GB

check_circle

Phi-3 Small 7B

RTX 3090

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

check_circle

Phi-3 Mini 3.8B

RTX 3090

PERFECT

7.6GB / 24.0GB VRAM +16.4GB

check_circle

Whisper Small

RTX 6000 Ada

PERFECT

0.5GB / 48.0GB VRAM +47.5GB

check_circle

Gemma 2 27B

A100 80GB

PERFECT

54.0GB / 80.0GB VRAM +26.0GB

check_circle

Phi-3 Mini 3.8B

H100 PCIe

PERFECT

3.8GB / 80.0GB VRAM +76.2GB

check_circle

Qwen 2.5 7B

RTX 4090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB