Liu-Junhua commited on
Commit
653227b
·
verified ·
1 Parent(s): 3f7ce67

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -1
README.md CHANGED
@@ -7,4 +7,47 @@ language:
7
  base_model:
8
  - ByteDance-Seed/BAGEL-7B-MoT
9
  pipeline_tag: any-to-any
10
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  base_model:
8
  - ByteDance-Seed/BAGEL-7B-MoT
9
  pipeline_tag: any-to-any
10
+ ---
11
+ # TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoning
12
+ <p align="center">
13
+ <a href="https://arxiv.org/abs/2602.10675">
14
+ <img
15
+ src="https://img.shields.io/badge/TwiFF-Paper-red?logo=arxiv&logoColor=red"
16
+ alt="TwiFF Paper on arXiv"
17
+ />
18
+ </a>
19
+ <a href="https://huggingface.co/datasets/Liu-Junhua/TwiFF-2.7M">
20
+ <img
21
+ src="https://img.shields.io/badge/TwiFF--2.7M-Dataset-yellow?logo=huggingface&logoColor=yellow"
22
+ alt="TwiFF-2.7M Dataset"
23
+ />
24
+ </a>
25
+ <a href="https://huggingface.co/datasets/Liu-Junhua/TwiFF-Bench">
26
+ <img
27
+ src="https://img.shields.io/badge/TwiFF--Bench-Dataset-yellow?logo=huggingface&logoColor=yellow"
28
+ alt="TwiFF-Bench Dataset"
29
+ />
30
+ </a>
31
+ <a href="https://github.com/LiuJunhua02/TwiFF">
32
+ <img
33
+ src="https://img.shields.io/badge/TwiFF-Codebase-536af5?color=536af5&logo=github"
34
+ alt="TwiFF-Bench Dataset"
35
+ />
36
+ </a>
37
+ </p>
38
+
39
+ ## 🧠 Method
40
+
41
+ <p align="center"><img src="https://github.com/LiuJunhua02/TwiFF/tree/main/assets/data_show.png" width="95%"></p>
42
+ We present TwiFF, a unified model fine-tuned on a high-quality dynamic visual Chain-of-Thought (VCoT) dataset comprising 2.7 million samples. In dynamic multimodal question-answering tasks involving instructional, predictive, and camera, TwiFF iteratively generates future event frames alongside textual reasoning, thereby producing temporally coherent visual reasoning trajectories. Experimental results demonstrate that, on dynamic scenario reasoning benchmarks, our dynamic VCoT approach outperforms both static VCoT methods based on tool-calling paradigms and purely textual chain-of-thought baselines.
43
+
44
+ ## ✍️ Citation
45
+
46
+ ```bibtex
47
+ @article{liu2026twiff,
48
+ title={TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoning},
49
+ author={Liu, Junhua and Wang, Zhangcheng and Han, Zhike and Wang, Ningli and Liang, Guotao and Kuang, Kun},
50
+ journal={arXiv preprint arXiv:2602.10675},
51
+ year={2026},
52
+ }
53
+ ```