Instructions to use MochunniaN1/One-to-All-14b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MochunniaN1/One-to-All-14b with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MochunniaN1/One-to-All-14b", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,31 +14,61 @@ This project aims to provide a unified framework for high-fidelity character ani
|
|
| 14 |
- π [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
|
| 15 |
- π» [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation)
|
| 16 |
|
| 17 |
-
##
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
<
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
<
|
| 31 |
-
|
| 32 |
-
</
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
<br>
|
| 35 |
|
| 36 |
-
##
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
<br>
|
| 44 |
|
|
@@ -228,10 +258,10 @@ If you have any questions, please feel free to reach us at `ssj180123@gmail.com`
|
|
| 228 |
If you find our work helpful or inspiring, please feel free to cite it.
|
| 229 |
|
| 230 |
```bibtex
|
| 231 |
-
@article{
|
| 232 |
-
title={One-to-All Animation: Alignment-Free Character Animation and Image Pose
|
| 233 |
author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
|
| 234 |
journal={arXiv preprint arXiv:2511.22940},
|
| 235 |
year={2025}
|
| 236 |
}
|
| 237 |
-
```
|
|
|
|
| 14 |
- π [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
|
| 15 |
- π» [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation)
|
| 16 |
|
| 17 |
+
## π Showcase
|
| 18 |
+
|
| 19 |
+
Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.
|
| 20 |
+
|
| 21 |
+
#### 14B Model
|
| 22 |
+
|
| 23 |
+
<table align="center">
|
| 24 |
+
<tr>
|
| 25 |
+
<th style="text-align: center;">Reference</th>
|
| 26 |
+
<th style="text-align: center;">Motion 1</th>
|
| 27 |
+
<th style="text-align: center;">Motion 2</th>
|
| 28 |
+
<th style="text-align: center;">Motion 3</th>
|
| 29 |
+
</tr>
|
| 30 |
+
<tr>
|
| 31 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td>
|
| 32 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td>
|
| 33 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td>
|
| 34 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td>
|
| 35 |
+
</tr>
|
| 36 |
+
<tr>
|
| 37 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td>
|
| 38 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td>
|
| 39 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td>
|
| 40 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td>
|
| 41 |
+
</tr>
|
| 42 |
+
</table>
|
| 43 |
|
| 44 |
<br>
|
| 45 |
|
| 46 |
+
#### 1.3B Model
|
| 47 |
+
The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).
|
| 48 |
+
|
| 49 |
+
<table align="center">
|
| 50 |
+
<tr>
|
| 51 |
+
<th style="text-align: center;">Reference</th>
|
| 52 |
+
<th style="text-align: center;">Motion 1</th>
|
| 53 |
+
<th style="text-align: center;">Motion 2</th>
|
| 54 |
+
<th style="text-align: center;">Motion 3</th>
|
| 55 |
+
</tr>
|
| 56 |
+
<tr>
|
| 57 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td>
|
| 58 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td>
|
| 59 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td>
|
| 60 |
+
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td>
|
| 61 |
+
</tr>
|
| 62 |
+
</table>
|
| 63 |
+
|
| 64 |
+
Also support longer video & out-of-domain cases
|
| 65 |
+
<table align="center">
|
| 66 |
+
<tr>
|
| 67 |
+
<td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td>
|
| 68 |
+
<td> </td>
|
| 69 |
+
<td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td>
|
| 70 |
+
</tr>
|
| 71 |
+
</table>
|
| 72 |
|
| 73 |
<br>
|
| 74 |
|
|
|
|
| 258 |
If you find our work helpful or inspiring, please feel free to cite it.
|
| 259 |
|
| 260 |
```bibtex
|
| 261 |
+
@article{shi2025one,
|
| 262 |
+
title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfe},
|
| 263 |
author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
|
| 264 |
journal={arXiv preprint arXiv:2511.22940},
|
| 265 |
year={2025}
|
| 266 |
}
|
| 267 |
+
```
|