--- license: creativeml-openrail-m language: - en tags: - stable-diffusion - image-inpainting - remote-sensing - satellite - vhr - diffusion - geospatial library_name: diffusers pipeline_tag: image-to-image --- # ๐Ÿ›ฐ๏ธ KAO-DIFFSAT-VHR-v1 (Beta Version) **Diffusion-based Satellite Image Inpainting (VHR) โ€” Baseline Release** ๐Ÿš€ Project website: https://kaopanboonyuen.github.io/KAO/ --- ## ๐Ÿ›ฐ๏ธ Visual Overview

High-fidelity satellite image reconstruction across diverse scenes (urban, agricultural, coastal).

--- ## ๐ŸŒ Overview **KAO-DIFFSAT-VHR-v1** is a satellite-domain adaptation of diffusion-based inpainting, designed for **Very High Resolution (VHR) remote sensing imagery**. This release serves as a **baseline model** in our IEEE TGRS work: > *KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image* > ๐ŸŽ‰ **Accepted to IEEE Transactions on Geoscience and Remote Sensing (TGRS)** > ๐ŸŒ Presentation at **AOGS 2026, Japan** โš ๏ธ **Important:** This model is **NOT the KAO method itself**. It is a **Stable Diffusionโ€“based inpainting backbone adapted for satellite imagery**, used as one of the reference baselines in our study. ๐Ÿ‘‰ The full KAO framework (**training-free / prompt-free optimization**) will be released separately. --- ## ๐Ÿง  Positioning | Component | Description | |----------|------------| | This Repo | Diffusion baseline for satellite inpainting | | KAO (Paper) | Optimization-based enhancement (no retraining required) | | Future Release | KAO-integrated inference (no prompt dependency) | --- ## ๐Ÿ—๏ธ Base Model This model is built upon: - Stable Diffusion v2 Inpainting - Provided via the Hugging Face ecosystem We adapt the pipeline for **remote sensing characteristics**, including: - Large spatial structures (roads, rivers, urban layouts) - Texture consistency across wide regions - Geometric coherence in aerial perspective --- ## ๐Ÿš€ Key Features - ๐Ÿ›ฐ๏ธ Satellite-aware inpainting behavior - ๐ŸŒ† Improved structural consistency for urban layouts - ๐ŸŒฟ Better handling of vegetation and natural textures - ๐Ÿงฉ Compatible with standard diffusion pipelines (Diffusers) --- ## ๐Ÿ”ฌ Results Overview

**Qualitative comparison across multiple models. KAO demonstrates superior structural reconstruction and texture consistency.**

**Detailed comparison highlighting fine-grained structures and realistic spatial coherence.** --- ## ๐Ÿ›ฐ๏ธ Full Benchmark Results

Comparison across multiple scenes including urban, agricultural, and occluded environments.
KAO consistently preserves spatial structure, enhances texture fidelity, and improves reconstruction realism.

--- ## โš ๏ธ What This Model Is (and Is Not) ### โœ… This model: - A **baseline diffusion model** for satellite inpainting - Used for **comparative evaluation** in our research - Suitable for prompt-based reconstruction tasks ### โŒ This model is NOT: - The full **KAO algorithm** - A training-free optimization method - A prompt-free system ๐Ÿ‘‰ Those capabilities are introduced in our paper and will be released in future versions. --- ## ๐Ÿš€ Usage (Diffusers) ```python from diffusers import StableDiffusionInpaintPipeline import torch pipe = StableDiffusionInpaintPipeline.from_pretrained( "kaopanboonyuen/KAO-DIFFSAT-VHR-v1", torch_dtype=torch.float16 ).to("cuda") prompt = "High-resolution satellite image of urban area with missing regions reconstructed" image = pipe( prompt=prompt, image=init_image, mask_image=mask ).images[0] ```` --- ## ๐Ÿ›ฐ๏ธ Prompt Guide (Satellite Domain) Use prompts that enforce: * spatial coherence * structural realism * geospatial consistency ### ๐Ÿ”น Template ``` High-resolution satellite image of [SCENE], reconstruct missing regions with realistic [STRUCTURE], maintain spatial consistency, natural textures, and accurate geometry ``` --- ## ๐Ÿงช Use Cases * Cloud removal in satellite imagery * Infrastructure reconstruction * Map completion * Environmental monitoring * Disaster recovery (flood, wildfire) --- ## โš ๏ธ Limitations * Prompt-sensitive behavior * Not optimized for hyperspectral imagery * High memory footprint (~25GB) * No explicit geospatial constraints (baseline only) --- ## ๐Ÿ”ฎ Roadmap * ๐Ÿ”œ KAO-DIFFSAT-v2 (KAO-integrated) * ๐Ÿ”œ Prompt-free inference (as proposed in paper) * ๐Ÿ”œ Lightweight and scalable variants --- ## ๐Ÿ“š Citation ### ๐Ÿ”น Base Model ```bibtex @misc{stabilityai2022sd2, title = {Stable Diffusion v2}, author = {{Stability AI}}, year = {2022}, howpublished = {\url{https://github.com/Stability-AI/stablediffusion}}, note = {Including inpainting variant} } ``` ### ๐Ÿ”น Our Work (KAO) ```bibtex @article{panboonyuen2025kao, title={KAO: Kernel-Adaptive Optimization in Diffusion for Satellite Image}, author={Panboonyuen, Teerapong}, journal={IEEE Transactions on Geoscience and Remote Sensing}, year={2025}, publisher={IEEE} } ``` --- ## ๐Ÿ”ฌ Project Overview This repository presents **KAO-DIFFSAT-VHR-v1**, a diffusion-based framework for **very high-resolution (VHR) satellite image inpainting**, designed for geospatial restoration and reconstruction tasks. The model builds upon Stable Diffusion-based inpainting and adapts it for remote sensing imagery. --- ## ๐Ÿ“„ Paper ๐Ÿ“˜ Full paper available on arXiv: https://arxiv.org/abs/2511.02462 --- ## ๐ŸŒ Project Page ๐Ÿš€ Project website: https://kaopanboonyuen.github.io/KAO/ --- ## ๐Ÿค Acknowledgements * Stability AI for foundational diffusion models * Hugging Face for open model hosting * Remote sensing community for datasets and benchmarks --- ## ๐ŸŒŸ Vision This project aims to advance: > **Generative AI ร— Earth Observation** toward scalable, reliable, and interpretable satellite intelligence systems. ---