Image-to-Video
Diffusers
Safetensors
MochunniaN1 commited on
Commit
1cc430e
Β·
verified Β·
1 Parent(s): 80cf6e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -25
README.md CHANGED
@@ -14,31 +14,61 @@ This project aims to provide a unified framework for high-fidelity character ani
14
  - 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
15
  - πŸ’» [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation)
16
 
17
- ## 🌟 Highlights
18
-
19
- We provide a **complete and reproducible** training and evaluation pipeline:
20
-
21
- - βœ… **Full Training Code**: Three-stage progressive training from scratch
22
- - βœ… **Complete Benchmarks**: Reproduction code and pre-trained checkpoints
23
- - βœ… **Flexible Training Codebase**: Multi-resolution, multi-aspect-ratio, and multi-frame training codebase
24
- - βœ… **Datasets**: Pre-processed open-source datasets + self-collected cartoon data
25
-
26
- <br>
27
-
28
- ## 🎭 Showcase - 1.3B Model Results
29
-
30
- <p align="center">
31
- <img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/combined_video1.gif" height="300"/> &nbsp;&nbsp; <img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/combined_video2.gif" height="300"/>
32
- </p>
 
 
 
 
 
 
 
 
 
 
33
 
34
  <br>
35
 
36
- ## πŸ”₯ Update
37
-
38
- - [2025.11] Paper reproduction and evaluation code released.
39
- - [2025.11] [Sample training data and Benchmark](https://huggingface.co/datasets/MochunniaN1/One-to-All-sub) on HuggingFace released.
40
- - [2025.11] Inference and Training codes are released.
41
- - [2025.11] [1.3B-v1](https://huggingface.co/MochunniaN1/One-to-All-1.3b_1), [1.3B-v2](https://huggingface.co/MochunniaN1/One-to-All-1.3b_2) and [14B](https://huggingface.co/MochunniaN1/One-to-All-14b) checkpoints are released.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
 
43
  <br>
44
 
@@ -228,10 +258,10 @@ If you have any questions, please feel free to reach us at `ssj180123@gmail.com`
228
  If you find our work helpful or inspiring, please feel free to cite it.
229
 
230
  ```bibtex
231
- @article{shi2025onetoall,
232
- title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
233
  author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
234
  journal={arXiv preprint arXiv:2511.22940},
235
  year={2025}
236
  }
237
- ```
 
14
  - 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
15
  - πŸ’» [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation)
16
 
17
+ ## 🎭 Showcase
18
+
19
+ Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.
20
+
21
+ #### 14B Model
22
+
23
+ <table align="center">
24
+ <tr>
25
+ <th style="text-align: center;">Reference</th>
26
+ <th style="text-align: center;">Motion 1</th>
27
+ <th style="text-align: center;">Motion 2</th>
28
+ <th style="text-align: center;">Motion 3</th>
29
+ </tr>
30
+ <tr>
31
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td>
32
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td>
33
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td>
34
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td>
35
+ </tr>
36
+ <tr>
37
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td>
38
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td>
39
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td>
40
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td>
41
+ </tr>
42
+ </table>
43
 
44
  <br>
45
 
46
+ #### 1.3B Model
47
+ The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).
48
+
49
+ <table align="center">
50
+ <tr>
51
+ <th style="text-align: center;">Reference</th>
52
+ <th style="text-align: center;">Motion 1</th>
53
+ <th style="text-align: center;">Motion 2</th>
54
+ <th style="text-align: center;">Motion 3</th>
55
+ </tr>
56
+ <tr>
57
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td>
58
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td>
59
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td>
60
+ <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td>
61
+ </tr>
62
+ </table>
63
+
64
+ Also support longer video & out-of-domain cases
65
+ <table align="center">
66
+ <tr>
67
+ <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td>
68
+ <td>&nbsp;&nbsp;&nbsp;&nbsp;</td>
69
+ <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td>
70
+ </tr>
71
+ </table>
72
 
73
  <br>
74
 
 
258
  If you find our work helpful or inspiring, please feel free to cite it.
259
 
260
  ```bibtex
261
+ @article{shi2025one,
262
+ title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfe},
263
  author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
264
  journal={arXiv preprint arXiv:2511.22940},
265
  year={2025}
266
  }
267
+ ```