NelsaHost
search Login
smart_toy

GPUs for LLaVA 1.6 34B (34.00B)

34.00B parameters • 68.0GB VRAM (FP16) • LLaVA

info Model Details
check_circle 3 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 32 Fail

Recommended minimum: A100 80GB (80.0GB) or higher for optimal performance

cancel

RTX A5000

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -44.0GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -44.0GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -44.0GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -44.0GB headroom
cancel

RX 7900 XTX

AMD • 24.0GB

FAIL/OOM
24.0GB available -44.0GB headroom
cancel

Jetson AGX Orin 32GB

NVIDIA • 32.0GB

FAIL/OOM
32.0GB available -36.0GB headroom
cancel

RTX 5000 Ada

NVIDIA • 32.0GB

FAIL/OOM
32.0GB available -36.0GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -28.0GB headroom
cancel

RTX 6000 Ada

NVIDIA • 48.0GB

FAIL/OOM
48.0GB available -20.0GB headroom
cancel

RTX A6000

NVIDIA • 48.0GB

FAIL/OOM
48.0GB available -20.0GB headroom
cancel

Jetson AGX Orin 64GB

NVIDIA • 64.0GB

FAIL/OOM
64.0GB available -4.0GB headroom
Previous Page 2 of 2