Instructions to use Hoshipu/xvla-v20-task0-mp-radio with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Hoshipu/xvla-v20-task0-mp-radio with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Hoshipu/xvla-v20-task0-mp-radio", device_map="auto") - Notebooks
- Google Colab
- Kaggle
README: document 4 checkpoint subfolders (30k/40k/50k/60k)
Browse files
README.md
CHANGED
|
@@ -13,6 +13,17 @@ base_model: 2toINF/X-VLA-Pt
|
|
| 13 |
|
| 14 |
Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a single BEHAVIOR-1K task (turning on the radio receiver), using the **v20 architecture** from [markli1hoshipu/behavior1k-xvla @ v20](https://github.com/markli1hoshipu/behavior1k-xvla/tree/v20).
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
## Architecture (v20)
|
| 17 |
|
| 18 |
- **Additive per-task + per-skill soft prompts** (`task_prompt_hub[task_id] + skill_prompt_hub[skill_id]`), 32 tokens × 1024 dim each, zero-initialized
|
|
@@ -60,8 +71,11 @@ Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a si
|
|
| 60 |
```python
|
| 61 |
from transformers import AutoModel, AutoConfig
|
| 62 |
|
| 63 |
-
|
| 64 |
-
|
|
|
|
|
|
|
|
|
|
| 65 |
```
|
| 66 |
|
| 67 |
Or deploy as an inference WebSocket server (handles all pre/post-processing for OmniGibson observations):
|
|
@@ -70,13 +84,19 @@ Or deploy as an inference WebSocket server (handles all pre/post-processing for
|
|
| 70 |
git clone -b v20 https://github.com/markli1hoshipu/behavior1k-xvla.git
|
| 71 |
cd behavior1k-xvla
|
| 72 |
bash setup.sh
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 73 |
cd behavior1k_training
|
| 74 |
-
python deploy_b1k.py --model_path
|
| 75 |
```
|
| 76 |
|
| 77 |
See [`INFERENCE_README.md`](https://github.com/markli1hoshipu/behavior1k-xvla/blob/v20/behavior1k_training/INFERENCE_README.md) for the protocol.
|
| 78 |
|
| 79 |
-
## Files
|
| 80 |
|
| 81 |
- `model.safetensors` — model weights (3.5 GB, bf16)
|
| 82 |
- `config.json`, `preprocessor_config.json`, `tokenizer*`, `vocab.json`, `merges.txt` — config / tokenizer
|
|
|
|
| 13 |
|
| 14 |
Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a single BEHAVIOR-1K task (turning on the radio receiver), using the **v20 architecture** from [markli1hoshipu/behavior1k-xvla @ v20](https://github.com/markli1hoshipu/behavior1k-xvla/tree/v20).
|
| 15 |
|
| 16 |
+
## Available checkpoints
|
| 17 |
+
|
| 18 |
+
| Subfolder | Steps | total loss | joints | skill_cls | progress |
|
| 19 |
+
|---|---|---|---|---|---|
|
| 20 |
+
| [`ckpt-30000/`](./ckpt-30000) | 30,000 | 0.0232 | 0.0204 | 0.0000 | 0.0027 |
|
| 21 |
+
| [`ckpt-40000/`](./ckpt-40000) | 40,000 | 0.0165 | 0.0158 | 0.0000 | 0.0007 |
|
| 22 |
+
| [`ckpt-50000/`](./ckpt-50000) | 50,000 | 0.0131 | 0.0117 | 0.0000 | 0.0014 |
|
| 23 |
+
| [`ckpt-60000/`](./ckpt-60000) | 60,000 (final) | 0.0135 | 0.0107 | 0.0000 | 0.0028 |
|
| 24 |
+
|
| 25 |
+
Each subfolder is fully self-contained — load any of them with `subfolder="ckpt-XXXXX"` (see Usage).
|
| 26 |
+
|
| 27 |
## Architecture (v20)
|
| 28 |
|
| 29 |
- **Additive per-task + per-skill soft prompts** (`task_prompt_hub[task_id] + skill_prompt_hub[skill_id]`), 32 tokens × 1024 dim each, zero-initialized
|
|
|
|
| 71 |
```python
|
| 72 |
from transformers import AutoModel, AutoConfig
|
| 73 |
|
| 74 |
+
REPO = "Hoshipu/xvla-v20-task0-mp-radio"
|
| 75 |
+
CKPT = "ckpt-60000" # or ckpt-30000 / ckpt-40000 / ckpt-50000
|
| 76 |
+
|
| 77 |
+
config = AutoConfig.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
|
| 78 |
+
model = AutoModel.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
|
| 79 |
```
|
| 80 |
|
| 81 |
Or deploy as an inference WebSocket server (handles all pre/post-processing for OmniGibson observations):
|
|
|
|
| 84 |
git clone -b v20 https://github.com/markli1hoshipu/behavior1k-xvla.git
|
| 85 |
cd behavior1k-xvla
|
| 86 |
bash setup.sh
|
| 87 |
+
|
| 88 |
+
# Download a single checkpoint to a local dir
|
| 89 |
+
huggingface-cli download Hoshipu/xvla-v20-task0-mp-radio \
|
| 90 |
+
--include "ckpt-60000/*" \
|
| 91 |
+
--local-dir ./xvla-v20-task0-mp-radio
|
| 92 |
+
|
| 93 |
cd behavior1k_training
|
| 94 |
+
python deploy_b1k.py --model_path ../xvla-v20-task0-mp-radio/ckpt-60000 --port 8000
|
| 95 |
```
|
| 96 |
|
| 97 |
See [`INFERENCE_README.md`](https://github.com/markli1hoshipu/behavior1k-xvla/blob/v20/behavior1k_training/INFERENCE_README.md) for the protocol.
|
| 98 |
|
| 99 |
+
## Files in each `ckpt-XXXXX/` subfolder
|
| 100 |
|
| 101 |
- `model.safetensors` — model weights (3.5 GB, bf16)
|
| 102 |
- `config.json`, `preprocessor_config.json`, `tokenizer*`, `vocab.json`, `merges.txt` — config / tokenizer
|