Hugging Face's logo

bakhshaliyev
/
Wave-Augs

Time Series Forecasting
PyTorch
English
time-series
forecasting
data-augmentation
wavelet
Model card Files
xet
 Community
Wave-Augs
File size: 4,437 Bytes
e0cceab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8a37944
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
---
language:
- en
license: mit
library_name: pytorch
tags:
- time-series
- forecasting
- data-augmentation
- wavelet
- arxiv:2408.10951
pipeline_tag: time-series-forecasting
---

📄 Paper (Hugging Face): https://huggingface.co/papers/2408.10951  
📄 arXiv: https://arxiv.org/abs/2408.10951  
💻 Original GitHub: https://github.com/jafarbakhshaliyev/Wave-Augs

# Wave-Mask/Mix: Exploring Wavelet-Based Augmentations for Time Series Forecasting <a href="https://www.arxiv.org/abs/2408.10951" title="Read the paper on arXiv"><img src="https://img.shields.io/badge/arXiv-2408.10951-b31b1b.svg" margin-left="5px" height="20" align="center"></a>

<a href="https://www.arxiv.org/abs/2408.10951" style="color: #4285F4; font-size: 24px; font-weight: bold; text-decoration: none;">Paper(arXiv)</a>

The figure depicts a framework of the training stages incorporating wavelet augmentations, which involve the concatenation of
the look-back window and the forecasting horizon prior to transformation and augmentation. Batch sampling of the generated synthetic data is conducted according to a predefined hyperparameter called the sampling rate. These batches are subsequently used to split the data into the look-back window and target horizon, after which they are concatenated with the original data. Wavelet augmentations are Wavelet Masking (WaveMask) and Wavelet Mixing (WaveMix). These techniques utilize the discrete wavelet transform (DWT) to obtain wavelet coefficients (both approximation and detail coefficients) by breaking down the signal and adjusting these coefficients, in line with modifying frequency components across different time scales. 

WaveMask selectively eliminates specific wavelet coefficients at each decomposition level, thereby introducing variability in the augmented data. Conversely, WaveMix exchanges wavelet coefficients from two distinct instances of the dataset, thereby enhancing the diversity of the augmented data. 

To the best of our knowledge, this is the first study to conduct extensive experiments on multivariate time series using Discrete Wavelet Transform as an augmentation technique.



<div align=center>
<img src="./figures/overview.png" alt="Overview" width="700" style="margin-bottom: 40px; margin-top: 40px;"/>
</div>



Tables present comparisons between our methods and baselines in terms of the metrics Mean Squared Error (MSE) and Mean Absolute Error (MAE). The best result is indicated in bold, while the second most favorable outcome is underlined.

<div align=center>
<img src="./figures/main_result.png" alt="Main Results" width="1000" height="500" style="margin-bottom: 40px; margin-top: 40px;"/>
</div>



<div align=center>
<img src="./figures/main_result2.png" alt="Main Results" width="1000" height="500" style="margin-bottom: 40px; margin-top: 40px;"/>
</div>


## Dataset

You can obtain all datasets under https://drive.google.com/drive/folders/1ZOYpTUa82_jCcxIdTmyr0LXQfvaM9vIy. All of them are ready for training. 

```
  mkdir dataset
```
Please place all of them within the ```./dataset ``` directory.

## Quick Start

Clone the project

```bash
  git clone https://github.com/jafarbakhshaliyev/Wave-Augs.git
```

Go to the project directory

```bash
  cd Wave-Augs
```

Install dependencies

```bash
  pip install -r requirements.txt
```

Train: 

```bash
  sh scripts/etth1.sh
  sh scripts/etth2.sh
  sh scripts/weather.sh
  sh scripts/ili.sh
```

You can change ```percentage``` to down-sample training dataset for ablation study.

## Citation

If you find the code useful, please cite our paper:

```
@misc{waveaug2024,
      title={Wave-Mask/Mix: Exploring Wavelet-Based Augmentations for Time Series Forecasting}, 
      author={Dona Arabi and Jafar Bakhshaliyev and Ayse Coskuner and Kiran Madhusudhanan and Kami Serdar Uckardes},
      year={2024},
      eprint={2408.10951},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2408.10951}, 
}
```

Please remember to cite all the datasets and compared methods if you use them in your experiments.

## Acknowledgements

We would like to express our gratitude to [Zheng et al.](https://arxiv.org/abs/2205.13504) for providing datasets used in this project. Additionally, we also acknowledge [Chen et al.](https://arxiv.org/abs/2302.09292) and [Zhang et al.](https://arxiv.org/abs/2303.14254)  for their code frameworks, which served as the foundation for our codebase.