update readme
#13
by dayoucdy - opened
README.md
CHANGED
|
@@ -5,11 +5,11 @@ pipeline_tag: text-to-video
|
|
| 5 |
|
| 6 |
The original repo is [here](https://modelscope.cn/models/damo/text-to-video-synthesis/summary).
|
| 7 |
|
| 8 |
-
We Are Hiring! (Based on Beijing / Hangzhou, China.)
|
| 9 |
|
| 10 |
If you're looking for an exciting challenge and the opportunity to work with cutting-edge technologies in AIGC and large-scale pretraining, then we are the place for you. We are looking for talented, motivated and creative individuals to join our team. If you are interested, please send your CV to us.
|
| 11 |
|
| 12 |
-
EMAIL:
|
| 13 |
|
| 14 |
This model is based on a multi-stage text-to-video generation diffusion model, which inputs a description text and returns a video that matches the text description. Only English input is supported.
|
| 15 |
|
|
@@ -85,3 +85,15 @@ The output mp4 file can be viewed by [VLC media player](https://www.videolan.org
|
|
| 85 |
## Training data
|
| 86 |
|
| 87 |
The training data includes [LAION5B](https://huggingface.co/datasets/laion/laion2B-en), [ImageNet](https://www.image-net.org/), [Webvid](https://m-bain.github.io/webvid-dataset/) and other public datasets. Image and video filtering is performed after pre-training such as aesthetic score, watermark score, and deduplication.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
|
| 6 |
The original repo is [here](https://modelscope.cn/models/damo/text-to-video-synthesis/summary).
|
| 7 |
|
| 8 |
+
**We Are Hiring!** (Based on Beijing / Hangzhou, China.)
|
| 9 |
|
| 10 |
If you're looking for an exciting challenge and the opportunity to work with cutting-edge technologies in AIGC and large-scale pretraining, then we are the place for you. We are looking for talented, motivated and creative individuals to join our team. If you are interested, please send your CV to us.
|
| 11 |
|
| 12 |
+
EMAIL: yingya.zyy@alibaba-inc.com
|
| 13 |
|
| 14 |
This model is based on a multi-stage text-to-video generation diffusion model, which inputs a description text and returns a video that matches the text description. Only English input is supported.
|
| 15 |
|
|
|
|
| 85 |
## Training data
|
| 86 |
|
| 87 |
The training data includes [LAION5B](https://huggingface.co/datasets/laion/laion2B-en), [ImageNet](https://www.image-net.org/), [Webvid](https://m-bain.github.io/webvid-dataset/) and other public datasets. Image and video filtering is performed after pre-training such as aesthetic score, watermark score, and deduplication.
|
| 88 |
+
|
| 89 |
+
## Citation
|
| 90 |
+
|
| 91 |
+
```bibtex
|
| 92 |
+
@InProceedings{VideoFusion,
|
| 93 |
+
author = {Luo, Zhengxiong and Chen, Dayou and Zhang, Yingya and Huang, Yan and Wang, Liang and Shen, Yujun and Zhao, Deli and Zhou, Jingren and Tan, Tieniu},
|
| 94 |
+
title = {VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation},
|
| 95 |
+
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
|
| 96 |
+
month = {June},
|
| 97 |
+
year = {2023}
|
| 98 |
+
}
|
| 99 |
+
```
|