kaopanboonyuen commited on
Commit
2743ef5
ยท
verified ยท
1 Parent(s): 0b1badc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +275 -275
README.md CHANGED
@@ -1,276 +1,276 @@
1
- ---
2
- license: creativeml-openrail-m
3
- language:
4
- - en
5
- tags:
6
- - stable-diffusion
7
- - image-inpainting
8
- - remote-sensing
9
- - satellite
10
- - vhr
11
- - diffusion
12
- - geospatial
13
- library_name: diffusers
14
- pipeline_tag: image-to-image
15
- ---
16
-
17
- # ๐Ÿ›ฐ๏ธ KAO-DIFFSAT-VHR-v1
18
- **Diffusion-based Satellite Image Inpainting (VHR) โ€” Baseline Release**
19
-
20
- ๐Ÿš€ Project website: https://kaopanboonyuen.github.io/KAO/
21
-
22
- ---
23
-
24
- ## ๐Ÿ›ฐ๏ธ Visual Overview
25
-
26
- <p align="center">
27
- <img src="img/re_show_01.png" width="100%">
28
- <img src="img/re_show_02.png" width="100%">
29
- </p>
30
-
31
- <p align="center">
32
- <b>High-fidelity satellite image reconstruction across diverse scenes (urban, agricultural, coastal).</b>
33
- </p>
34
-
35
- ---
36
-
37
- ## ๐ŸŒ Overview
38
-
39
- **KAO-DIFFSAT-VHR-v1** is a satellite-domain adaptation of diffusion-based inpainting, designed for **Very High Resolution (VHR) remote sensing imagery**.
40
-
41
- This release serves as a **baseline model** in our IEEE TGRS work:
42
-
43
- > *KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image*
44
-
45
- > ๐ŸŽ‰ **Accepted to IEEE Transactions on Geoscience and Remote Sensing (TGRS)**
46
- > ๐ŸŒ Presentation at **AOGS 2026, Japan**
47
-
48
- โš ๏ธ **Important:**
49
- This model is **NOT the KAO method itself**.
50
- It is a **Stable Diffusionโ€“based inpainting backbone adapted for satellite imagery**, used as one of the reference baselines in our study.
51
-
52
- ๐Ÿ‘‰ The full KAO framework (**training-free / prompt-free optimization**) will be released separately.
53
-
54
- ---
55
-
56
- ## ๐Ÿง  Positioning
57
-
58
- | Component | Description |
59
- |----------|------------|
60
- | This Repo | Diffusion baseline for satellite inpainting |
61
- | KAO (Paper) | Optimization-based enhancement (no retraining required) |
62
- | Future Release | KAO-integrated inference (no prompt dependency) |
63
-
64
- ---
65
-
66
- ## ๐Ÿ—๏ธ Base Model
67
-
68
- This model is built upon:
69
-
70
- - Stable Diffusion v2 Inpainting
71
- - Provided via the Hugging Face ecosystem
72
-
73
- We adapt the pipeline for **remote sensing characteristics**, including:
74
-
75
- - Large spatial structures (roads, rivers, urban layouts)
76
- - Texture consistency across wide regions
77
- - Geometric coherence in aerial perspective
78
-
79
- ---
80
-
81
- ## ๐Ÿš€ Key Features
82
-
83
- - ๐Ÿ›ฐ๏ธ Satellite-aware inpainting behavior
84
- - ๐ŸŒ† Improved structural consistency for urban layouts
85
- - ๐ŸŒฟ Better handling of vegetation and natural textures
86
- - ๐Ÿงฉ Compatible with standard diffusion pipelines (Diffusers)
87
-
88
- ---
89
-
90
- ## ๐Ÿ”ฌ Results Overview
91
-
92
- <p align="center">
93
- <img src="img/re_show_01.png" width="90%">
94
- </p>
95
-
96
- **Qualitative comparison across multiple models. KAO demonstrates superior structural reconstruction and texture consistency.**
97
-
98
- <p align="center">
99
- <img src="img/re_show_02.png" width="90%">
100
- </p>
101
-
102
- **Detailed comparison highlighting fine-grained structures and realistic spatial coherence.**
103
-
104
- ---
105
-
106
- ## ๐Ÿ›ฐ๏ธ Full Benchmark Results
107
-
108
- <table>
109
- <tr>
110
- <td><img src="img/re_all_01.png"></td>
111
- <td><img src="img/re_all_02.png"></td>
112
- </tr>
113
- <tr>
114
- <td><img src="img/re_all_03.png"></td>
115
- <td><img src="img/re_all_04.png"></td>
116
- </tr>
117
- <tr>
118
- <td><img src="img/re_all_05.png"></td>
119
- <td><img src="img/re_all_06.png"></td>
120
- </tr>
121
- </table>
122
-
123
- <p align="center">
124
- <b>Comparison across multiple scenes including urban, agricultural, and occluded environments.</b><br>
125
- KAO consistently preserves spatial structure, enhances texture fidelity, and improves reconstruction realism.
126
- </p>
127
-
128
- ---
129
-
130
- ## โš ๏ธ What This Model Is (and Is Not)
131
-
132
- ### โœ… This model:
133
- - A **baseline diffusion model** for satellite inpainting
134
- - Used for **comparative evaluation** in our research
135
- - Suitable for prompt-based reconstruction tasks
136
-
137
- ### โŒ This model is NOT:
138
- - The full **KAO algorithm**
139
- - A training-free optimization method
140
- - A prompt-free system
141
-
142
- ๐Ÿ‘‰ Those capabilities are introduced in our paper and will be released in future versions.
143
-
144
- ---
145
-
146
- ## ๐Ÿš€ Usage (Diffusers)
147
-
148
- ```python
149
- from diffusers import StableDiffusionInpaintPipeline
150
- import torch
151
-
152
- pipe = StableDiffusionInpaintPipeline.from_pretrained(
153
- "kaopanboonyuen/KAO-DIFFSAT-VHR-v1",
154
- torch_dtype=torch.float16
155
- ).to("cuda")
156
-
157
- prompt = "High-resolution satellite image of urban area with missing regions reconstructed"
158
-
159
- image = pipe(
160
- prompt=prompt,
161
- image=init_image,
162
- mask_image=mask
163
- ).images[0]
164
- ````
165
-
166
- ---
167
-
168
- ## ๐Ÿ›ฐ๏ธ Prompt Guide (Satellite Domain)
169
-
170
- Use prompts that enforce:
171
-
172
- * spatial coherence
173
- * structural realism
174
- * geospatial consistency
175
-
176
- ### ๐Ÿ”น Template
177
-
178
- ```
179
- High-resolution satellite image of [SCENE],
180
- reconstruct missing regions with realistic [STRUCTURE],
181
- maintain spatial consistency, natural textures, and accurate geometry
182
- ```
183
-
184
- ---
185
-
186
- ## ๐Ÿงช Use Cases
187
-
188
- * Cloud removal in satellite imagery
189
- * Infrastructure reconstruction
190
- * Map completion
191
- * Environmental monitoring
192
- * Disaster recovery (flood, wildfire)
193
-
194
- ---
195
-
196
- ## โš ๏ธ Limitations
197
-
198
- * Prompt-sensitive behavior
199
- * Not optimized for hyperspectral imagery
200
- * High memory footprint (~25GB)
201
- * No explicit geospatial constraints (baseline only)
202
-
203
- ---
204
-
205
- ## ๐Ÿ”ฎ Roadmap
206
-
207
- * ๐Ÿ”œ KAO-DIFFSAT-v2 (KAO-integrated)
208
- * ๐Ÿ”œ Prompt-free inference (as proposed in paper)
209
- * ๐Ÿ”œ Lightweight and scalable variants
210
-
211
- ---
212
-
213
- ## ๐Ÿ“š Citation
214
-
215
- ### ๐Ÿ”น Base Model
216
-
217
- ```bibtex
218
- @misc{stabilityai2022sd2,
219
- title = {Stable Diffusion v2},
220
- author = {{Stability AI}},
221
- year = {2022},
222
- howpublished = {\url{https://github.com/Stability-AI/stablediffusion}},
223
- note = {Including inpainting variant}
224
- }
225
- ```
226
-
227
- ### ๐Ÿ”น Our Work (KAO)
228
-
229
- ```bibtex
230
- @article{panboonyuen2025kao,
231
- title={KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image},
232
- author={Panboonyuen, Teerapong},
233
- journal={IEEE Transactions on Geoscience and Remote Sensing},
234
- year={2025},
235
- publisher={IEEE}
236
- }
237
- ```
238
-
239
- ---
240
-
241
- ## ๐Ÿ”ฌ Project Overview
242
- This repository presents **KAO-DIFFSAT-VHR-v1**, a diffusion-based framework for **very high-resolution (VHR) satellite image inpainting**, designed for geospatial restoration and reconstruction tasks.
243
-
244
- The model builds upon Stable Diffusion-based inpainting and adapts it for remote sensing imagery.
245
-
246
- ---
247
-
248
- ## ๐Ÿ“„ Paper
249
- ๐Ÿ“˜ Full paper available on arXiv:
250
- https://arxiv.org/abs/2511.02462
251
-
252
- ---
253
-
254
- ## ๐ŸŒ Project Page
255
- ๐Ÿš€ Project website:
256
- https://kaopanboonyuen.github.io/KAO/
257
-
258
- ---
259
-
260
- ## ๐Ÿค Acknowledgements
261
-
262
- * Stability AI for foundational diffusion models
263
- * Hugging Face for open model hosting
264
- * Remote sensing community for datasets and benchmarks
265
-
266
- ---
267
-
268
- ## ๐ŸŒŸ Vision
269
-
270
- This project aims to advance:
271
-
272
- > **Generative AI ร— Earth Observation**
273
-
274
- toward scalable, reliable, and interpretable satellite intelligence systems.
275
-
276
  ---
 
1
+ ---
2
+ license: creativeml-openrail-m
3
+ language:
4
+ - en
5
+ tags:
6
+ - stable-diffusion
7
+ - image-inpainting
8
+ - remote-sensing
9
+ - satellite
10
+ - vhr
11
+ - diffusion
12
+ - geospatial
13
+ library_name: diffusers
14
+ pipeline_tag: image-to-image
15
+ ---
16
+
17
+ # ๐Ÿ›ฐ๏ธ KAO-DIFFSAT-VHR-v1 (Beta Version)
18
+ **Diffusion-based Satellite Image Inpainting (VHR) โ€” Baseline Release**
19
+
20
+ ๐Ÿš€ Project website: https://kaopanboonyuen.github.io/KAO/
21
+
22
+ ---
23
+
24
+ ## ๐Ÿ›ฐ๏ธ Visual Overview
25
+
26
+ <p align="center">
27
+ <img src="img/re_show_01.png" width="100%">
28
+ <img src="img/re_show_02.png" width="100%">
29
+ </p>
30
+
31
+ <p align="center">
32
+ <b>High-fidelity satellite image reconstruction across diverse scenes (urban, agricultural, coastal).</b>
33
+ </p>
34
+
35
+ ---
36
+
37
+ ## ๐ŸŒ Overview
38
+
39
+ **KAO-DIFFSAT-VHR-v1** is a satellite-domain adaptation of diffusion-based inpainting, designed for **Very High Resolution (VHR) remote sensing imagery**.
40
+
41
+ This release serves as a **baseline model** in our IEEE TGRS work:
42
+
43
+ > *KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image*
44
+
45
+ > ๐ŸŽ‰ **Accepted to IEEE Transactions on Geoscience and Remote Sensing (TGRS)**
46
+ > ๐ŸŒ Presentation at **AOGS 2026, Japan**
47
+
48
+ โš ๏ธ **Important:**
49
+ This model is **NOT the KAO method itself**.
50
+ It is a **Stable Diffusionโ€“based inpainting backbone adapted for satellite imagery**, used as one of the reference baselines in our study.
51
+
52
+ ๐Ÿ‘‰ The full KAO framework (**training-free / prompt-free optimization**) will be released separately.
53
+
54
+ ---
55
+
56
+ ## ๐Ÿง  Positioning
57
+
58
+ | Component | Description |
59
+ |----------|------------|
60
+ | This Repo | Diffusion baseline for satellite inpainting |
61
+ | KAO (Paper) | Optimization-based enhancement (no retraining required) |
62
+ | Future Release | KAO-integrated inference (no prompt dependency) |
63
+
64
+ ---
65
+
66
+ ## ๐Ÿ—๏ธ Base Model
67
+
68
+ This model is built upon:
69
+
70
+ - Stable Diffusion v2 Inpainting
71
+ - Provided via the Hugging Face ecosystem
72
+
73
+ We adapt the pipeline for **remote sensing characteristics**, including:
74
+
75
+ - Large spatial structures (roads, rivers, urban layouts)
76
+ - Texture consistency across wide regions
77
+ - Geometric coherence in aerial perspective
78
+
79
+ ---
80
+
81
+ ## ๐Ÿš€ Key Features
82
+
83
+ - ๐Ÿ›ฐ๏ธ Satellite-aware inpainting behavior
84
+ - ๐ŸŒ† Improved structural consistency for urban layouts
85
+ - ๐ŸŒฟ Better handling of vegetation and natural textures
86
+ - ๐Ÿงฉ Compatible with standard diffusion pipelines (Diffusers)
87
+
88
+ ---
89
+
90
+ ## ๐Ÿ”ฌ Results Overview
91
+
92
+ <p align="center">
93
+ <img src="img/re_show_01.png" width="90%">
94
+ </p>
95
+
96
+ **Qualitative comparison across multiple models. KAO demonstrates superior structural reconstruction and texture consistency.**
97
+
98
+ <p align="center">
99
+ <img src="img/re_show_02.png" width="90%">
100
+ </p>
101
+
102
+ **Detailed comparison highlighting fine-grained structures and realistic spatial coherence.**
103
+
104
+ ---
105
+
106
+ ## ๐Ÿ›ฐ๏ธ Full Benchmark Results
107
+
108
+ <table>
109
+ <tr>
110
+ <td><img src="img/re_all_01.png"></td>
111
+ <td><img src="img/re_all_02.png"></td>
112
+ </tr>
113
+ <tr>
114
+ <td><img src="img/re_all_03.png"></td>
115
+ <td><img src="img/re_all_04.png"></td>
116
+ </tr>
117
+ <tr>
118
+ <td><img src="img/re_all_05.png"></td>
119
+ <td><img src="img/re_all_06.png"></td>
120
+ </tr>
121
+ </table>
122
+
123
+ <p align="center">
124
+ <b>Comparison across multiple scenes including urban, agricultural, and occluded environments.</b><br>
125
+ KAO consistently preserves spatial structure, enhances texture fidelity, and improves reconstruction realism.
126
+ </p>
127
+
128
+ ---
129
+
130
+ ## โš ๏ธ What This Model Is (and Is Not)
131
+
132
+ ### โœ… This model:
133
+ - A **baseline diffusion model** for satellite inpainting
134
+ - Used for **comparative evaluation** in our research
135
+ - Suitable for prompt-based reconstruction tasks
136
+
137
+ ### โŒ This model is NOT:
138
+ - The full **KAO algorithm**
139
+ - A training-free optimization method
140
+ - A prompt-free system
141
+
142
+ ๐Ÿ‘‰ Those capabilities are introduced in our paper and will be released in future versions.
143
+
144
+ ---
145
+
146
+ ## ๐Ÿš€ Usage (Diffusers)
147
+
148
+ ```python
149
+ from diffusers import StableDiffusionInpaintPipeline
150
+ import torch
151
+
152
+ pipe = StableDiffusionInpaintPipeline.from_pretrained(
153
+ "kaopanboonyuen/KAO-DIFFSAT-VHR-v1",
154
+ torch_dtype=torch.float16
155
+ ).to("cuda")
156
+
157
+ prompt = "High-resolution satellite image of urban area with missing regions reconstructed"
158
+
159
+ image = pipe(
160
+ prompt=prompt,
161
+ image=init_image,
162
+ mask_image=mask
163
+ ).images[0]
164
+ ````
165
+
166
+ ---
167
+
168
+ ## ๐Ÿ›ฐ๏ธ Prompt Guide (Satellite Domain)
169
+
170
+ Use prompts that enforce:
171
+
172
+ * spatial coherence
173
+ * structural realism
174
+ * geospatial consistency
175
+
176
+ ### ๐Ÿ”น Template
177
+
178
+ ```
179
+ High-resolution satellite image of [SCENE],
180
+ reconstruct missing regions with realistic [STRUCTURE],
181
+ maintain spatial consistency, natural textures, and accurate geometry
182
+ ```
183
+
184
+ ---
185
+
186
+ ## ๐Ÿงช Use Cases
187
+
188
+ * Cloud removal in satellite imagery
189
+ * Infrastructure reconstruction
190
+ * Map completion
191
+ * Environmental monitoring
192
+ * Disaster recovery (flood, wildfire)
193
+
194
+ ---
195
+
196
+ ## โš ๏ธ Limitations
197
+
198
+ * Prompt-sensitive behavior
199
+ * Not optimized for hyperspectral imagery
200
+ * High memory footprint (~25GB)
201
+ * No explicit geospatial constraints (baseline only)
202
+
203
+ ---
204
+
205
+ ## ๐Ÿ”ฎ Roadmap
206
+
207
+ * ๐Ÿ”œ KAO-DIFFSAT-v2 (KAO-integrated)
208
+ * ๐Ÿ”œ Prompt-free inference (as proposed in paper)
209
+ * ๐Ÿ”œ Lightweight and scalable variants
210
+
211
+ ---
212
+
213
+ ## ๐Ÿ“š Citation
214
+
215
+ ### ๐Ÿ”น Base Model
216
+
217
+ ```bibtex
218
+ @misc{stabilityai2022sd2,
219
+ title = {Stable Diffusion v2},
220
+ author = {{Stability AI}},
221
+ year = {2022},
222
+ howpublished = {\url{https://github.com/Stability-AI/stablediffusion}},
223
+ note = {Including inpainting variant}
224
+ }
225
+ ```
226
+
227
+ ### ๐Ÿ”น Our Work (KAO)
228
+
229
+ ```bibtex
230
+ @article{panboonyuen2025kao,
231
+ title={KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image},
232
+ author={Panboonyuen, Teerapong},
233
+ journal={IEEE Transactions on Geoscience and Remote Sensing},
234
+ year={2025},
235
+ publisher={IEEE}
236
+ }
237
+ ```
238
+
239
+ ---
240
+
241
+ ## ๐Ÿ”ฌ Project Overview
242
+ This repository presents **KAO-DIFFSAT-VHR-v1**, a diffusion-based framework for **very high-resolution (VHR) satellite image inpainting**, designed for geospatial restoration and reconstruction tasks.
243
+
244
+ The model builds upon Stable Diffusion-based inpainting and adapts it for remote sensing imagery.
245
+
246
+ ---
247
+
248
+ ## ๐Ÿ“„ Paper
249
+ ๐Ÿ“˜ Full paper available on arXiv:
250
+ https://arxiv.org/abs/2511.02462
251
+
252
+ ---
253
+
254
+ ## ๐ŸŒ Project Page
255
+ ๐Ÿš€ Project website:
256
+ https://kaopanboonyuen.github.io/KAO/
257
+
258
+ ---
259
+
260
+ ## ๐Ÿค Acknowledgements
261
+
262
+ * Stability AI for foundational diffusion models
263
+ * Hugging Face for open model hosting
264
+ * Remote sensing community for datasets and benchmarks
265
+
266
+ ---
267
+
268
+ ## ๐ŸŒŸ Vision
269
+
270
+ This project aims to advance:
271
+
272
+ > **Generative AI ร— Earth Observation**
273
+
274
+ toward scalable, reliable, and interpretable satellite intelligence systems.
275
+
276
  ---