Spaces:
Running on Zero
Running on Zero
Sync the split MiniMax-H3 Spaces
Browse files
README.md
CHANGED
|
@@ -114,6 +114,18 @@ resident:
|
|
| 114 |
| peak allocated / reserved | 78.54 / 85.37 GiB |
|
| 115 |
| output | h264 1344x768 @ 24 fps, 5.167 s + stereo AAC @ 32 kHz |
|
| 116 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
## Space variables
|
| 118 |
|
| 119 |
| Variable | Default | Meaning |
|
|
|
|
| 114 |
| peak allocated / reserved | 78.54 / 85.37 GiB |
|
| 115 |
| output | h264 1344x768 @ 24 fps, 5.167 s + stereo AAC @ 32 kHz |
|
| 116 |
|
| 117 |
+
And on this Space itself, driven over `gradio_client`. Startup is 93 s — the 77.3 GB download and the load, with
|
| 118 |
+
no placement and therefore no pack.
|
| 119 |
+
|
| 120 |
+
| Request | Conditioner | Denoise + decode | Steady | Round trip |
|
| 121 |
+
|---|---|---|---|---|
|
| 122 |
+
| text only, 18 tokens | 7 s | 339 s | 10.53 s/step | 353 s |
|
| 123 |
+
| one 768x1344 keyframe, 1034 tokens | 9 s | 370 s | 11.39 s/step | 386 s |
|
| 124 |
+
|
| 125 |
+
The keyframe costs about 8% per step rather than a placement penalty: it puts 1016 vision rows in front of the
|
| 126 |
+
prompt *and* 1016 conditioning rows in the packed sequence, and MiniMax-H3 attends over all of it every layer. The
|
| 127 |
+
one-time `PIPE.to("cuda")` is inside the first row's 339 s and does not reappear in the second.
|
| 128 |
+
|
| 129 |
## Space variables
|
| 130 |
|
| 131 |
| Variable | Default | Meaning |
|
app.py
CHANGED
|
@@ -24,7 +24,7 @@ import time
|
|
| 24 |
import traceback
|
| 25 |
|
| 26 |
# First, and at module level. `import spaces` patches `torch.cuda` before any GPU is attached, which is what lets the
|
| 27 |
-
#
|
| 28 |
import spaces
|
| 29 |
import gradio as gr
|
| 30 |
|
|
|
|
| 24 |
import traceback
|
| 25 |
|
| 26 |
# First, and at module level. `import spaces` patches `torch.cuda` before any GPU is attached, which is what lets the
|
| 27 |
+
# 72 GiB load happen at **startup** rather than on GPU time; it also has to precede anything that initializes CUDA.
|
| 28 |
import spaces
|
| 29 |
import gradio as gr
|
| 30 |
|