MagistrTheOne commited on
Commit
fb5a018
·
verified ·
1 Parent(s): 9f7d910

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -185
README.md CHANGED
@@ -12,222 +12,101 @@ tags:
12
  - video-continuation
13
  ---
14
 
15
- # LongCat-Video
16
-
17
  <div align="center">
18
- <img src="assets/longcat_logo.svg" width="45%" alt="LongCat-Video" />
19
  </div>
20
  <hr>
21
-
22
- <div align="center" style="line-height: 1;">
23
- <a href='https://meituan-longcat.github.io/LongCat-Video/'><img src='https://img.shields.io/badge/Project-Page-green'></a>
24
  <a href='https://huggingface.co/papers/2510.22200'><img src='https://img.shields.io/badge/Paper-HuggingFace-red'></a>
25
- <a href='https://huggingface.co/meituan-longcat/LongCat-Video'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue'></a>
26
- </div>
27
-
28
- <div align="center" style="line-height: 1;">
29
- <a href='https://github.com/meituan-longcat/LongCat-Flash-Chat/blob/main/figures/wechat_official_accounts.png'><img src='https://img.shields.io/badge/WeChat-LongCat-brightgreen?logo=wechat&logoColor=white'></a>
30
- <a href='https://x.com/Meituan_LongCat'><img src='https://img.shields.io/badge/Twitter-LongCat-white?logo=x&logoColor=white'></a>
31
- </div>
32
-
33
- <div align="center" style="line-height: 1;">
34
- <a href='https://huggingface.co/meituan-longcat/LongCat-Video/blob/main/LICENSE'><img src='https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53'></a>
35
  </div>
36
-
37
- ## Model Introduction
38
- We introduce LongCat-Video, a foundational video generation model with 13.6B parameters, delivering strong performance across *Text-to-Video*, *Image-to-Video*, and *Video-Continuation* generation tasks. It particularly excels in efficient and high-quality long video generation, representing our first step toward world models.
39
-
40
- ### Key Features
41
- - 🌟 **Unified architecture for multiple tasks**: LongCat-Video unifies *Text-to-Video*, *Image-to-Video*, and *Video-Continuation* tasks within a single video generation framework. It natively supports all these tasks with a single model and consistently delivers strong performance across each individual task.
42
- - 🌟 **Long video generation**: LongCat-Video is natively pretrained on *Video-Continuation* tasks, enabling it to produce minutes-long videos without color drifting or quality degradation.
43
- - 🌟 **Efficient inference**: LongCat-Video generates $720p$, $30fps$ videos within minutes by employing a coarse-to-fine generation strategy along both the temporal and spatial axes. Block Sparse Attention further enhances efficiency, particularly at high resolutions
44
- - 🌟 **Strong performance with multi-reward RLHF**: Powered by multi-reward Group Relative Policy Optimization (GRPO), comprehensive evaluations on both internal and public benchmarks demonstrate that LongCat-Video achieves performance comparable to leading open-source video generation models as well as the latest commercial solutions.
45
-
46
- For more detail, please refer to the comprehensive [***LongCat-Video Technical Report***](https://huggingface.co/papers/2510.22200).
47
-
48
- ## 🎥 Teaser Video
49
-
50
  <div align="center">
51
- <video src="https://github.com/user-attachments/assets/00fa63f0-9c4e-461a-a79e-c662ad596d7d" width="2264" height="384"> </video>
52
  </div>
 
 
 
53
 
54
- ## Quick Start
 
 
 
55
 
56
- ### Installation
57
 
58
- Clone the repo:
 
 
 
 
 
59
 
60
- ```shell
61
- git clone https://github.com/meituan-longcat/LongCat-Video
62
- cd LongCat-Video
63
- ```
64
-
65
- Install dependencies:
66
-
67
- ```shell
68
- # create conda environment
69
- conda create -n longcat-video python=3.10
70
- conda activate longcat-video
71
-
72
- # install torch (configure according to your CUDA version)
73
  pip install torch==2.6.0+cu124 torchvision==0.21.0+cu124 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu124
74
 
75
- # install flash-attn-2
76
- pip install ninja
77
- pip install psutil
78
- pip install packaging
79
- pip install flash_attn==2.7.4.post1
80
-
81
- # install other requirements
82
  pip install -r requirements.txt
83
- ```
84
-
85
- FlashAttention-2 is enabled in the model config by default; you can also change the model config to use FlashAttention-3 or xformers.
86
-
87
- ### Model Download
88
-
89
- | Models | Download Link |
90
- | --- | --- |
91
- | LongCat-Video | 🤗 [Huggingface](https://huggingface.co/meituan-longcat/LongCat-Video) |
92
-
93
- Download models using huggingface-cli:
94
- ```shell
95
- pip install "huggingface_hub[cli]"
96
- huggingface-cli download meituan-longcat/LongCat-Video --local-dir ./weights/LongCat-Video
97
- ```
98
-
99
- ### Run Text-to-Video
100
-
101
- ```shell
102
- # Single-GPU inference
103
- torchrun run_demo_text_to_video.py --checkpoint_dir=./weights/LongCat-Video --enable_compile
104
-
105
- # Multi-GPU inference
106
- torchrun --nproc_per_node=2 run_demo_text_to_video.py --context_parallel_size=2 --checkpoint_dir=./weights/LongCat-Video --enable_compile
107
- ```
108
 
109
- ### Run Image-to-Video
 
110
 
111
- ```shell
112
- # Single-GPU inference
113
- torchrun run_demo_image_to_video.py --checkpoint_dir=./weights/LongCat-Video --enable_compile
114
 
115
- # Multi-GPU inference
116
- torchrun --nproc_per_node=2 run_demo_image_to_video.py --context_parallel_size=2 --checkpoint_dir=./weights/LongCat-Video --enable_compile
117
- ```
118
 
119
- ### Run Video-Continuation
 
120
 
121
- ```shell
122
- # Single-GPU inference
123
- torchrun run_demo_video_continuation.py --checkpoint_dir=./weights/LongCat-Video --enable_compile
124
 
125
- # Multi-GPU inference
126
- torchrun --nproc_per_node=2 run_demo_video_continuation.py --context_parallel_size=2 --checkpoint_dir=./weights/LongCat-Video --enable_compile
127
- ```
128
-
129
- ### Run Long-Video Generation
130
-
131
- ```shell
132
- # Single-GPU inference
133
- torchrun run_demo_long_video.py --checkpoint_dir=./weights/LongCat-Video --enable_compile
134
-
135
- # Multi-GPU inference
136
- torchrun --nproc_per_node=2 run_demo_long_video.py --context_parallel_size=2 --checkpoint_dir=./weights/LongCat-Video --enable_compile
137
- ```
138
-
139
- ### Run Interactive Video Generation
140
-
141
- ```shell
142
- # Single-GPU inference
143
- torchrun run_demo_interactive_video.py --checkpoint_dir=./weights/LongCat-Video --enable_compile
144
-
145
- # Multi-GPU inference
146
- torchrun --nproc_per_node=2 run_demo_interactive_video.py --context_parallel_size=2 --checkpoint_dir=./weights/LongCat-Video --enable_compile
147
- ```
148
-
149
- ### Run Streamlit
150
-
151
- ```shell
152
- # Single-GPU inference
153
  streamlit run ./run_streamlit.py --server.fileWatcherType none --server.headless=false
154
- ```
155
-
156
-
157
-
158
- ## Evaluation Results
159
-
160
- ### Text-to-Video
161
- The *Text-to-Video* MOS evaluation results on our internal benchmark.
162
 
163
- | **MOS score** | **Veo3** | **PixVerse-V5** | **Wan 2.2-T2V-A14B** | **LongCat-Video** |
164
- |---------------|-------------------|--------------------|-------------|-------------|
165
- | **Accessibility** | Proprietary | Proprietary | Open Source | Open Source |
166
- | **Architecture** | - | - | MoE | Dense |
167
- | **# Total Params** | - | - | 28B | 13.6B |
168
- | **# Activated Params** | - | - | 14B | 13.6B |
169
- | Text-Alignment↑ | 3.99 | 3.81 | 3.70 | 3.76 |
170
- | Visual Quality↑ | 3.23 | 3.13 | 3.26 | 3.25 |
171
- | Motion Quality↑ | 3.86 | 3.81 | 3.78 | 3.74 |
172
- | Overall Quality↑ | 3.48 | 3.36 | 3.35 | 3.38 |
173
 
174
- ### Image-to-Video
175
- The *Image-to-Video* MOS evaluation results on our internal benchmark.
176
 
177
- | **MOS score** | **Seedance 1.0** | **Hailuo-02** | **Wan 2.2-I2V-A14B** | **LongCat-Video** |
178
- |---------------|-------------------|--------------------|-------------|-------------|
179
- | **Accessibility** | Proprietary | Proprietary | Open Source | Open Source |
180
- | **Architecture** | - | - | MoE | Dense |
181
- | **# Total Params** | - | - | 28B | 13.6B |
182
- | **# Activated Params** | - | - | 14B | 13.6B |
183
- | Image-Alignment↑ | 4.12 | 4.18 | 4.18 | 4.04 |
184
- | Text-Alignment↑ | 3.70 | 3.85 | 3.33 | 3.49 |
185
- | Visual Quality↑ | 3.22 | 3.18 | 3.23 | 3.27 |
186
- | Motion Quality↑ | 3.77 | 3.80 | 3.79 | 3.59 |
187
- | Overall Quality↑ | 3.35 | 3.27 | 3.26 | 3.17 |
188
 
189
- ## Community Works
190
 
191
- Community works are welcome! Please PR or inform us in Issue to add your work.
 
 
192
 
193
- - [CacheDiT](https://github.com/vipshop/cache-dit) offers Fully Cache Acceleration support for LongCat-Video with DBCache and TaylorSeer, achieved nearly 1.7x speedup without obvious loss of precision. Visit their [example](https://github.com/vipshop/cache-dit/blob/main/examples/pipeline/run_longcat_video.py) for more details.
 
194
 
195
-
196
- ## License Agreement
197
-
198
- The **model weights** are released under the **MIT License**.
199
-
200
- Any contributions to this repository are licensed under the MIT License, unless otherwise stated. This license does not grant any rights to use Meituan trademarks or patents.
201
-
202
- See the [LICENSE](https://huggingface.co/meituan-longcat/LongCat-Video/blob/main/LICENSE) file for the full license text.
203
-
204
- ## Usage Considerations
205
- This model has not been specifically designed or comprehensively evaluated for every possible downstream application.
206
-
207
- Developers should take into account the known limitations of large language models, including performance variations across different languages, and carefully assess accuracy, safety, and fairness before deploying the model in sensitive or high-risk scenarios.
208
- It is the responsibility of developers and downstream users to understand and comply with all applicable laws and regulations relevant to their use case, including but not limited to data protection, privacy, and content safety requirements.
209
-
210
- Nothing in this Model Card should be interpreted as altering or restricting the terms of the MIT License under which the model is released.
211
-
212
- ## Citation
213
- We kindly encourage citation of our work if you find it useful.
214
-
215
- ```
216
- @misc{meituanlongcatteam2025longcatvideotechnicalreport,
217
- title={LongCat-Video Technical Report},
218
- author={Meituan LongCat Team and Xunliang Cai and Qilong Huang and Zhuoliang Kang and Hongyu Li and Shijun Liang and Liya Ma and Siyu Ren and Xiaoming Wei and Rixu Xie and Tong Zhang},
219
- year={2025},
220
  eprint={2510.22200},
221
  archivePrefix={arXiv},
222
  primaryClass={cs.CV},
223
- url={https://arxiv.org/abs/2510.22200},
224
  }
225
- ```
226
-
227
- ## Acknowledgements
228
-
229
- We would like to thank the contributors to the [Wan](https://huggingface.co/Wan-AI), [UMT5-XXL](https://huggingface.co/google/umt5-xxl), [Diffusers](https://github.com/huggingface/diffusers) and [HuggingFace](https://huggingface.co) repositories, for their open research.
230
 
 
 
231
 
232
- ## Contact
233
- Please contact us at <a href="mailto:longcat-team@meituan.com">longcat-team@meituan.com</a> or join our WeChat Group if you have any questions.
 
12
  - video-continuation
13
  ---
14
 
15
+ ARACHNE-X-ULTRA
 
16
  <div align="center">
17
+ <img src="assets/arachne_logo.svg" width="45%" alt="ARACHNE-X-ULTRA" />
18
  </div>
19
  <hr>
20
+ <div align="center">
21
+ <a href='https://nullxes.com/arachne-x-ultra'><img src='https://img.shields.io/badge/Project-Page-green'></a>
 
22
  <a href='https://huggingface.co/papers/2510.22200'><img src='https://img.shields.io/badge/Paper-HuggingFace-red'></a>
23
+ <a href='https://huggingface.co/nullxes/ARACHNE-X-ULTRA'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue'></a>
24
+ <a href='mailto:ceo@nullxes.com'><img src='https://img.shields.io/badge/Contact-ceo@nullxes.com-lightgrey'></a>
 
 
 
 
 
 
 
 
25
  </div>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
  <div align="center">
27
+ <a href='https://huggingface.co/nullxes/ARACHNE-X-ULTRA/blob/main/LICENSE'><img src='https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53'></a>
28
  </div>
29
+ Model Introduction
30
+ We introduce ARACHNE-X-ULTRA, a foundational video generation model with 13.6B parameters, delivering strong performance across Text-to-Video, Image-to-Video, and Video-Continuation generation tasks. It particularly excels in efficient, high-quality long video generation — representing NULLXES's first step toward world models.
31
+ Key Features
32
 
33
+ 🕷️ Unified architecture for multiple tasks: ARACHNE-X-ULTRA unifies Text-to-Video, Image-to-Video, and Video-Continuation within a single framework. One model, natively supports all tasks, consistently strong across each.
34
+ 🕷️ Long video generation: Natively pretrained on Video-Continuation tasks, enabling minutes-long videos without color drift or quality degradation.
35
+ 🕷️ Efficient inference: Generates 720p, 30fps video within minutes via a coarse-to-fine generation strategy along temporal and spatial axes. Block Sparse Attention further boosts efficiency at high resolutions.
36
+ 🕷️ Multi-reward RLHF: Powered by multi-reward Group Relative Policy Optimization (GRPO). Comprehensive evaluations on internal and public benchmarks show performance comparable to leading open-source models and the latest commercial solutions.
37
 
38
+ For full details, refer to the ARACHNE-X-ULTRA Technical Report.
39
 
40
+ Quick Start
41
+ Installation
42
+ shellgit clone https://github.com/nullxes/ARACHNE-X-ULTRA
43
+ cd ARACHNE-X-ULTRA
44
+ shellconda create -n arachne python=3.10
45
+ conda activate arachne
46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  pip install torch==2.6.0+cu124 torchvision==0.21.0+cu124 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu124
48
 
49
+ pip install ninja psutil packaging flash_attn==2.7.4.post1
 
 
 
 
 
 
50
  pip install -r requirements.txt
51
+ FlashAttention-2 is enabled by default. You can switch to FlashAttention-3 or xformers via model config.
52
+ Model Download
53
+ ModelLinkARACHNE-X-ULTRA🤗 Huggingface
54
+ shellpip install "huggingface_hub[cli]"
55
+ huggingface-cli download nullxes/ARACHNE-X-ULTRA --local-dir ./weights/ARACHNE-X-ULTRA
56
+ Inference
57
+ shell# Text-to-Video (single GPU)
58
+ torchrun run_demo_text_to_video.py --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
 
60
+ # Text-to-Video (multi-GPU)
61
+ torchrun --nproc_per_node=2 run_demo_text_to_video.py --context_parallel_size=2 --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
62
 
63
+ # Image-to-Video
64
+ torchrun run_demo_image_to_video.py --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
 
65
 
66
+ # Video-Continuation
67
+ torchrun run_demo_video_continuation.py --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
 
68
 
69
+ # Long Video Generation
70
+ torchrun run_demo_long_video.py --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
71
 
72
+ # Interactive Video Generation
73
+ torchrun run_demo_interactive_video.py --checkpoint_dir=./weights/ARACHNE-X-ULTRA --enable_compile
 
74
 
75
+ # Streamlit UI
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
  streamlit run ./run_streamlit.py --server.fileWatcherType none --server.headless=false
 
 
 
 
 
 
 
 
77
 
78
+ Evaluation Results
79
+ Text-to-Video (Internal MOS Benchmark)
80
+ MOS scoreVeo3PixVerse-V5Wan 2.2-T2V-A14BARACHNE-X-ULTRAAccessibilityProprietaryProprietaryOpen SourceOpen SourceArchitecture——MoEDenseTotal Params——28B13.6BActivated Params——14B13.6BText-Alignment ↑3.993.813.703.76Visual Quality ↑3.233.133.263.25Motion Quality ↑3.863.813.783.74Overall Quality ↑3.483.363.353.38
81
+ Image-to-Video (Internal MOS Benchmark)
82
+ MOS scoreSeedance 1.0Hailuo-02Wan 2.2-I2V-A14BARACHNE-X-ULTRAAccessibilityProprietaryProprietaryOpen SourceOpen SourceArchitecture——MoEDenseTotal Params——28B13.6BActivated Params——14B13.6BImage-Alignment ↑4.124.184.184.04Text-Alignment ↑3.703.853.333.49Visual Quality ↑3.223.183.233.27Motion Quality ↑3.773.803.793.59Overall Quality ↑3.353.273.263.17
 
 
 
 
 
83
 
84
+ Community Works
85
+ Community contributions are welcome. Open a PR or file an Issue to have your work listed.
86
 
87
+ CacheDiT Fully cached acceleration for ARACHNE-X-ULTRA via DBCache and TaylorSeer, achieving ~1. speedup with minimal precision loss. See their example.
 
 
 
 
 
 
 
 
 
 
88
 
 
89
 
90
+ License
91
+ Model weights are released under the MIT License. All contributions to this repository are licensed under MIT unless otherwise stated. This license does not grant rights to use NULLXES trademarks or patents.
92
+ See the LICENSE file for full terms.
93
 
94
+ Usage Considerations
95
+ ARACHNE-X-ULTRA has not been specifically designed or comprehensively evaluated for every possible downstream application. Developers should account for known limitations of large generative models, carefully assess accuracy, safety, and fairness before deploying in sensitive or high-risk scenarios, and ensure compliance with all applicable laws and regulations — including data protection, privacy, and content safety requirements.
96
 
97
+ Citation
98
+ bibtex@misc{nullxes2025arachnexultra,
99
+ title={ARACHNE-X-ULTRA Technical Report},
100
+ author={NULLXES Team},
101
+ year={2026},
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
102
  eprint={2510.22200},
103
  archivePrefix={arXiv},
104
  primaryClass={cs.CV},
105
+ url={https://arxiv.org/abs/2510.22200},
106
  }
 
 
 
 
 
107
 
108
+ Acknowledgements
109
+ We thank the contributors to Wan, UMT5-XXL, Diffusers, and HuggingFace for their open research.
110
 
111
+ Contact
112
+ Questions? Reach out at ceo@nullxes.com