---
license: mit
language:
- en
tags:
- remote-sensing
- earth-observation
- vision
- feature-extraction
- galileo
- sentinel-1
- sentinel-2
- multimodal
library_name: transformers
pipeline_tag: feature-extraction
---

# Galileo Transformers Models

Self-contained HuggingFace model checkpoints for [Galileo](https://arxiv.org/abs/2502.09356).

Each checkpoint subfolder ships remote code for model, processor, and custom pipeline loading with `trust_remote_code=True`. No external `galileo` package is required at inference time.

## Available checkpoints

| Folder | Hidden size | Layers | Heads |
|--------|-------------|--------|-------|
| `galileo-nano-patch8/` | 128 | 4 | 8 |
| `galileo-tiny-patch8/` | 192 | 12 | 3 |
| `galileo-base-patch8/` | 768 | 12 | 12 |

## Usage

Galileo operates on native patch grids (default **`patch_size: 8`** in `preprocessor_config.json`). Stack shapes are `(H, W, T, C)`; no fixed 224×224 resize is applied.

```python
from transformers import pipeline
import numpy as np

MODEL = "/path/to/GALILEO-transformers/galileo-nano-patch8"

pipe = pipeline(
    task="galileo-feature-extraction",
    model=MODEL,
    trust_remote_code=True,
)

# 10-band Sentinel-2 stack at native spatial size
s2 = np.random.randn(64, 64, 1, 10).astype(np.float32)
features = pipe(s2=s2, pool=True, return_tensors=True)
```

Sentinel-1 only:

```python
s1 = np.random.randn(64, 64, 1, 2).astype(np.float32)
features = pipe(s1=s1, pool=True, return_tensors=True)
```

## Test CLI

```bash
conda activate rsgen
python test_galileo.py
python test_galileo.py --model galileo-tiny-patch8
python test_galileo.py --model galileo-base-patch8 --no-pool
```

## Dependencies

- `transformers`
- `torch`
- `einops`

## Per-folder contents

Each checkpoint folder is self-contained:

- `config.json` — HF config with `auto_map` and `custom_pipelines`
- `model.safetensors` — converted encoder weights
- `preprocessor_config.json` — processor settings
- `modeling_galileo.py` — config + encoder + `GalileoEncoderModel`
- `processing_galileo.py` — `GalileoProcessor`
- `pipeline_galileo.py` — `GalileoImageFeatureExtractionPipeline`