---
license: apache-2.0
pipeline_tag: image-to-video
library_name: diffusers
---

# One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer

This repository contains the model and code for the paper [One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer](https://huggingface.co/papers/2511.22940).

This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs.

- 📄 [Paper](https://huggingface.co/papers/2511.22940)
- 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
- 💻 [Code on GitHub](https://github.com/ssj9596/One-to-All-Animation)

## 🎭 Showcase

Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.

#### 14B Model

<table align="center">
  <tr>
    <th style="text-align: center;">Reference</th>
    <th style="text-align: center;">Motion 1</th>
    <th style="text-align: center;">Motion 2</th>
    <th style="text-align: center;">Motion 3</th>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td>
  </tr>
</table>

<br>

#### 1.3B Model
The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).

<table align="center">
  <tr>
    <th style="text-align: center;">Reference</th>
    <th style="text-align: center;">Motion 1</th>
    <th style="text-align: center;">Motion 2</th>
    <th style="text-align: center;">Motion 3</th>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td>
  </tr>
</table>

Also support longer video & out-of-domain cases 
<table align="center">
  <tr>
    <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td>
    <td>&nbsp;&nbsp;&nbsp;&nbsp;</td>
    <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td>
  </tr>
</table>

<br>


## Acknowledgments

Our project is based on [opensora](https://github.com/hpcaitech/Open-Sora). Some codes are brought from [StableAnimator](https://github.com/Francis-Rings/StableAnimator) and [Wan-Animate](https://github.com/Wan-Video/Wan2.2). Thanks for their awesome works.

## 📧 Contact
If you have any questions, please feel free to reach us at `ssj180123@gmail.com`

## 📝 Citation
If you find our work helpful or inspiring, please feel free to cite it.

```bibtex
@article{shi2025one,
  title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
  author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
  journal={arXiv preprint arXiv:2511.22940},
  year={2025}
}
```