multimodalart HF Staff commited on
Commit
c938c2e
·
verified ·
1 Parent(s): 5ca1dce

Sync the split MiniMax-H3 Spaces

Browse files
Files changed (2) hide show
  1. README.md +12 -0
  2. app.py +1 -1
README.md CHANGED
@@ -114,6 +114,18 @@ resident:
114
  | peak allocated / reserved | 78.54 / 85.37 GiB |
115
  | output | h264 1344x768 @ 24 fps, 5.167 s + stereo AAC @ 32 kHz |
116
 
 
 
 
 
 
 
 
 
 
 
 
 
117
  ## Space variables
118
 
119
  | Variable | Default | Meaning |
 
114
  | peak allocated / reserved | 78.54 / 85.37 GiB |
115
  | output | h264 1344x768 @ 24 fps, 5.167 s + stereo AAC @ 32 kHz |
116
 
117
+ And on this Space itself, driven over `gradio_client`. Startup is 93 s — the 77.3 GB download and the load, with
118
+ no placement and therefore no pack.
119
+
120
+ | Request | Conditioner | Denoise + decode | Steady | Round trip |
121
+ |---|---|---|---|---|
122
+ | text only, 18 tokens | 7 s | 339 s | 10.53 s/step | 353 s |
123
+ | one 768x1344 keyframe, 1034 tokens | 9 s | 370 s | 11.39 s/step | 386 s |
124
+
125
+ The keyframe costs about 8% per step rather than a placement penalty: it puts 1016 vision rows in front of the
126
+ prompt *and* 1016 conditioning rows in the packed sequence, and MiniMax-H3 attends over all of it every layer. The
127
+ one-time `PIPE.to("cuda")` is inside the first row's 339 s and does not reappear in the second.
128
+
129
  ## Space variables
130
 
131
  | Variable | Default | Meaning |
app.py CHANGED
@@ -24,7 +24,7 @@ import time
24
  import traceback
25
 
26
  # First, and at module level. `import spaces` patches `torch.cuda` before any GPU is attached, which is what lets the
27
- # 82 GiB load happen at **startup** rather than on GPU time; it also has to precede anything that initializes CUDA.
28
  import spaces
29
  import gradio as gr
30
 
 
24
  import traceback
25
 
26
  # First, and at module level. `import spaces` patches `torch.cuda` before any GPU is attached, which is what lets the
27
+ # 72 GiB load happen at **startup** rather than on GPU time; it also has to precede anything that initializes CUDA.
28
  import spaces
29
  import gradio as gr
30