Compatibility Reports

check_circle

Whisper Base

RTX 3090

PERFECT

0.2GB / 24.0GB VRAM +23.8GB

check_circle

Llama 3 70B

H100 PCIe

PERFECT

70.0GB / 80.0GB VRAM +10.0GB

check_circle

Llama 3.1 8B

RTX 3090

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

check_circle

BGE-M3

RX 7900 XTX

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

check_circle

Whisper Small

RTX 4080 SUPER

PERFECT

0.5GB / 16.0GB VRAM +15.5GB

check_circle

Whisper Medium

RTX 4080

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

Whisper Base

H100 SXM

PERFECT

0.2GB / 80.0GB VRAM +79.8GB

check_circle

Whisper Small

RTX 4070 Ti

PERFECT

0.5GB / 12.0GB VRAM +11.5GB

check_circle

Whisper Base

RTX 3080 10GB

PERFECT

0.2GB / 10.0GB VRAM +9.8GB

check_circle

Whisper Small

RTX 4070

PERFECT

0.5GB / 12.0GB VRAM +11.5GB

check_circle

Gemma 2 9B

RTX 3090

PERFECT

18.0GB / 24.0GB VRAM +6.0GB

check_circle

Whisper Small

RTX 4070 Ti SUPER

PERFECT

0.5GB / 16.0GB VRAM +15.5GB

check_circle

Whisper Medium

RTX 4070 SUPER

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Qwen 2.5 14B

RTX 3090

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

check_circle

Mistral 7B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

cancel

Llama 3.1 70B

RTX 3090

FAIL/OOM

70.0GB / 24.0GB VRAM -46.0GB

check_circle

Whisper Base

RTX 4070 Ti SUPER

PERFECT

0.2GB / 16.0GB VRAM +15.8GB

check_circle

Llama 3.1 8B

RTX 4090

PERFECT

3.2GB / 24.0GB VRAM +20.8GB

check_circle

Whisper Base

RTX 4070 Ti

PERFECT

0.2GB / 12.0GB VRAM +11.8GB

check_circle

Whisper Small

RTX 3080 10GB

PERFECT

0.5GB / 10.0GB VRAM +9.5GB

check_circle

Llama 3 8B

A100 40GB

PERFECT

8.0GB / 40.0GB VRAM +32.0GB

check_circle

Llama 3 8B

RTX 4090

PERFECT

8.0GB / 24.0GB VRAM +16.0GB

check_circle

Whisper Small

RX 7900 XTX

PERFECT

0.5GB / 24.0GB VRAM +23.5GB

check_circle

Mixtral 8x22B

A100 80GB

PERFECT

70.5GB / 80.0GB VRAM +9.5GB