README.md

metadata

title: MiniMax-H3 Wushu Action LoRA
emoji: 🥋
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 6.24.0
app_file: app.py
pinned: false
short_description: Martial-arts action video with a MiniMax-H3 LoRA
python_version: '3.12'
startup_duration_timeout: 30m
suggested_hardware: zero-a10g
models:
  - MiniMaxAI/MiniMax-H3
  - Jojocodex/minimax-h3-wushu-action-lora
  - Comfy-Org/MiniMax-H3

武打动作 · MiniMax-H3 Wushu Action LoRA

Generate short martial-arts / kung-fu action clips — punches, kicks, combination forms, staff technique — with MiniMax-H3 and the Wushu Action LoRA. Every clip comes back with H3's native synchronized stereo soundtrack.

What it does

The LoRA was trained with ai-toolkit on 455 curated wushu clips (2000 steps, rank 16, resolution 512, 90 frames @ 24 fps) to teach MiniMax-H3 human martial-arts motion — the four technique families its captions cover are 拳法 (punches), 腿法 (kicks), 综合套路 (combination forms) and 棍法 (staff).

It has no trigger token: the model card activates it with a natural-language action description ("a kung fu practitioner executing a spinning kick"). The demo's technique family picker appends the caption wording of the family you choose to your prompt, so a request lands inside the distribution the LoRA was trained on. The default duration is 3.75 s = 90 frames, exactly the clip length it saw during training.

How it works

This Space is the denoising half of a split MiniMax-H3 deployment:

• The 62 GiB Qwen3-VL text encoder runs in the conditioner Space, called over the gradio API; prompt_embeds + text_token_tags is the whole wire format between the halves.
• This Space loads the 61.7 GiB transformer + 10.4 GiB VAEs and runs the denoising loop and the video/audio decode on the GPU (ZeroGPU, xlarge booking — the transformer does not fit the 48 GB default).
• The wushu action LoRA (wushu_action_h3_lora_v4_2000_pruned.safetensors, 416 keys over 208 modules) is folded into the transformer's bf16 weights at startup, at the top of the card's recommended 0.8–1.0 strength range.
• The Comfy-Org Turbo LoRA (4-step) is folded on top — the LoRA card states the pruned file (with adaln_proj removed) is Turbo-compatible.

Usage

Describe the action — "a fighter executing a spinning staff technique", "a practitioner demonstrating a fast flurry of punches in continuous motion" — optionally pick a technique family, and click Generate.

LoRA details

Field	Value
Base model	MiniMax-H3 (FL2VA)
Rank	16
Training	ai-toolkit, 2000 steps, 455 wushu clips
Resolution	512
Clip length	90 frames @ 24 fps (3.75 s)
Recommended strength	0.8–1.0 (folded at 1.0)
Turbo compatibility	Yes (pruned file, adaln_proj removed)

The LoRA card notes this is the v4 checkpoint, captioned with a generic template; a per-technique captioned v5 is in progress.