Spaces:
Running on Zero
Running on Zero
File size: 3,221 Bytes
2b72a4d da11654 2b72a4d da11654 2b72a4d da11654 2b72a4d da11654 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 | ---
title: MiniMax-H3 Wushu Action LoRA
emoji: 🥋
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 6.24.0
app_file: app.py
pinned: false
short_description: Martial-arts action video with a MiniMax-H3 LoRA
python_version: "3.12"
startup_duration_timeout: 30m
suggested_hardware: zero-a10g
models:
- MiniMaxAI/MiniMax-H3
- Jojocodex/minimax-h3-wushu-action-lora
- Comfy-Org/MiniMax-H3
---
# 武打动作 · MiniMax-H3 Wushu Action LoRA
Generate short **martial-arts / kung-fu action** clips — punches, kicks, combination forms, staff technique — with
[MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3) and the
[Wushu Action LoRA](https://huggingface.co/Jojocodex/minimax-h3-wushu-action-lora). Every clip comes back with
H3's native synchronized stereo soundtrack.
## What it does
The LoRA was trained with ai-toolkit on **455 curated wushu clips** (2000 steps, rank 16, resolution 512,
90 frames @ 24 fps) to teach MiniMax-H3 human martial-arts motion — the four technique families its captions
cover are 拳法 (punches), 腿法 (kicks), 综合套路 (combination forms) and 棍法 (staff).
It has **no trigger token**: the model card activates it with a natural-language action description
(*"a kung fu practitioner executing a spinning kick"*). The demo's **technique family** picker appends the
caption wording of the family you choose to your prompt, so a request lands inside the distribution the LoRA
was trained on. The default duration is **3.75 s = 90 frames**, exactly the clip length it saw during training.
## How it works
This Space is the **denoising half** of a split MiniMax-H3 deployment:
- The 62 GiB Qwen3-VL text encoder runs in the
[conditioner Space](https://huggingface.co/spaces/multimodalart/qwen3vl-conditioner), called over the gradio API;
`prompt_embeds` + `text_token_tags` is the whole wire format between the halves.
- This Space loads the 61.7 GiB transformer + 10.4 GiB VAEs and runs the denoising loop and the video/audio decode
on the GPU (ZeroGPU, `xlarge` booking — the transformer does not fit the 48 GB default).
- The wushu action LoRA (`wushu_action_h3_lora_v4_2000_pruned.safetensors`, 416 keys over 208 modules) is **folded**
into the transformer's bf16 weights at startup, at the top of the card's recommended 0.8–1.0 strength range.
- The [Comfy-Org Turbo LoRA](https://huggingface.co/Comfy-Org/MiniMax-H3) (4-step) is folded on top — the LoRA card
states the pruned file (with `adaln_proj` removed) is Turbo-compatible.
## Usage
Describe the action — *"a fighter executing a spinning staff technique"*, *"a practitioner demonstrating a fast
flurry of punches in continuous motion"* — optionally pick a technique family, and click **Generate**.
## LoRA details
| Field | Value |
|---|---|
| Base model | MiniMax-H3 (FL2VA) |
| Rank | 16 |
| Training | ai-toolkit, 2000 steps, 455 wushu clips |
| Resolution | 512 |
| Clip length | 90 frames @ 24 fps (3.75 s) |
| Recommended strength | 0.8–1.0 (folded at 1.0) |
| Turbo compatibility | Yes (pruned file, `adaln_proj` removed) |
The LoRA card notes this is the **v4** checkpoint, captioned with a generic template; a per-technique captioned
**v5** is in progress.
|