| --- |
| license: apache-2.0 |
| pipeline_tag: image-to-video |
| library_name: diffusers |
| --- |
| |
| # One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer |
|
|
| This repository contains the model and code for the paper [One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer](https://huggingface.co/papers/2511.22940). |
|
|
| This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs. |
|
|
| - 📄 [Paper](https://huggingface.co/papers/2511.22940) |
| - 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/) |
| - 💻 [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation) |
|
|
| ## 🎭 Showcase |
|
|
| Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities. |
|
|
| #### 14B Model |
|
|
| <table align="center"> |
| <tr> |
| <th style="text-align: center;">Reference</th> |
| <th style="text-align: center;">Motion 1</th> |
| <th style="text-align: center;">Motion 2</th> |
| <th style="text-align: center;">Motion 3</th> |
| </tr> |
| <tr> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td> |
| </tr> |
| <tr> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td> |
| </tr> |
| </table> |
| |
| <br> |
|
|
| #### 1.3B Model |
| The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt). |
| |
| <table align="center"> |
| <tr> |
| <th style="text-align: center;">Reference</th> |
| <th style="text-align: center;">Motion 1</th> |
| <th style="text-align: center;">Motion 2</th> |
| <th style="text-align: center;">Motion 3</th> |
| </tr> |
| <tr> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td> |
| <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td> |
| </tr> |
| </table> |
| |
| Also support longer video & out-of-domain cases |
| <table align="center"> |
| <tr> |
| <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td> |
| <td> </td> |
| <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td> |
| </tr> |
| </table> |
| |
| <br> |
| |
| |
| ## Acknowledgments |
| |
| Our project is based on [opensora](https://github.com/hpcaitech/Open-Sora). Some codes are brought from [StableAnimator](https://github.com/Francis-Rings/StableAnimator) and [Wan-Animate](https://github.com/Wan-Video/Wan2.2). Thanks for their awesome works. |
| |
| ## 📧 Contact |
| If you have any questions, please feel free to reach us at `ssj180123@gmail.com` |
| |
| ## 📝 Citation |
| If you find our work helpful or inspiring, please feel free to cite it. |
| |
| ```bibtex |
| @article{shi2025one, |
| title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer}, |
| author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning}, |
| journal={arXiv preprint arXiv:2511.22940}, |
| year={2025} |
| } |
| ``` |
| |
