File size: 3,221 Bytes
2b72a4d
da11654
 
2b72a4d
da11654
2b72a4d
 
 
 
da11654
 
 
 
 
 
 
 
2b72a4d
 
da11654
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
---
title: MiniMax-H3 Wushu Action LoRA
emoji: 🥋
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 6.24.0
app_file: app.py
pinned: false
short_description: Martial-arts action video with a MiniMax-H3 LoRA
python_version: "3.12"
startup_duration_timeout: 30m
suggested_hardware: zero-a10g
models:
  - MiniMaxAI/MiniMax-H3
  - Jojocodex/minimax-h3-wushu-action-lora
  - Comfy-Org/MiniMax-H3
---

# 武打动作 · MiniMax-H3 Wushu Action LoRA

Generate short **martial-arts / kung-fu action** clips — punches, kicks, combination forms, staff technique — with
[MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3) and the
[Wushu Action LoRA](https://huggingface.co/Jojocodex/minimax-h3-wushu-action-lora). Every clip comes back with
H3's native synchronized stereo soundtrack.

## What it does

The LoRA was trained with ai-toolkit on **455 curated wushu clips** (2000 steps, rank 16, resolution 512,
90 frames @ 24 fps) to teach MiniMax-H3 human martial-arts motion — the four technique families its captions
cover are 拳法 (punches), 腿法 (kicks), 综合套路 (combination forms) and 棍法 (staff).

It has **no trigger token**: the model card activates it with a natural-language action description
(*"a kung fu practitioner executing a spinning kick"*). The demo's **technique family** picker appends the
caption wording of the family you choose to your prompt, so a request lands inside the distribution the LoRA
was trained on. The default duration is **3.75 s = 90 frames**, exactly the clip length it saw during training.

## How it works

This Space is the **denoising half** of a split MiniMax-H3 deployment:

- The 62 GiB Qwen3-VL text encoder runs in the
  [conditioner Space](https://huggingface.co/spaces/multimodalart/qwen3vl-conditioner), called over the gradio API;
  `prompt_embeds` + `text_token_tags` is the whole wire format between the halves.
- This Space loads the 61.7 GiB transformer + 10.4 GiB VAEs and runs the denoising loop and the video/audio decode
  on the GPU (ZeroGPU, `xlarge` booking — the transformer does not fit the 48 GB default).
- The wushu action LoRA (`wushu_action_h3_lora_v4_2000_pruned.safetensors`, 416 keys over 208 modules) is **folded**
  into the transformer's bf16 weights at startup, at the top of the card's recommended 0.8–1.0 strength range.
- The [Comfy-Org Turbo LoRA](https://huggingface.co/Comfy-Org/MiniMax-H3) (4-step) is folded on top — the LoRA card
  states the pruned file (with `adaln_proj` removed) is Turbo-compatible.

## Usage

Describe the action — *"a fighter executing a spinning staff technique"*, *"a practitioner demonstrating a fast
flurry of punches in continuous motion"* — optionally pick a technique family, and click **Generate**.

## LoRA details

| Field | Value |
|---|---|
| Base model | MiniMax-H3 (FL2VA) |
| Rank | 16 |
| Training | ai-toolkit, 2000 steps, 455 wushu clips |
| Resolution | 512 |
| Clip length | 90 frames @ 24 fps (3.75 s) |
| Recommended strength | 0.8–1.0 (folded at 1.0) |
| Turbo compatibility | Yes (pruned file, `adaln_proj` removed) |

The LoRA card notes this is the **v4** checkpoint, captioned with a generic template; a per-technique captioned
**v5** is in progress.