VRAM requirements?
#3
by agronholm - opened
The README does not mention how much VRAM the model requires to run. Knowing if this can be run on consumer cards would be helpful!
The 1.3B and 14B models run on (81 × 576 × 1024, 30 steps, bfloat16, H100) use roughly:
• 1.3B: ~29 GB
• 14B: ~65 GB
These numbers are from tests without any memory‑saving optimizations. I don’t have consumer GPUs to verify, but with proper optimization (quantization or activation checkpointing) the 1.3B model might run on consumer cards.