Hoshipu commited on
Commit
32fd6bb
·
verified ·
1 Parent(s): efc6fef

README: document 4 checkpoint subfolders (30k/40k/50k/60k)

Browse files
Files changed (1) hide show
  1. README.md +24 -4
README.md CHANGED
@@ -13,6 +13,17 @@ base_model: 2toINF/X-VLA-Pt
13
 
14
  Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a single BEHAVIOR-1K task (turning on the radio receiver), using the **v20 architecture** from [markli1hoshipu/behavior1k-xvla @ v20](https://github.com/markli1hoshipu/behavior1k-xvla/tree/v20).
15
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Architecture (v20)
17
 
18
  - **Additive per-task + per-skill soft prompts** (`task_prompt_hub[task_id] + skill_prompt_hub[skill_id]`), 32 tokens × 1024 dim each, zero-initialized
@@ -60,8 +71,11 @@ Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a si
60
  ```python
61
  from transformers import AutoModel, AutoConfig
62
 
63
- config = AutoConfig.from_pretrained("Hoshipu/xvla-v20-task0-mp-radio", trust_remote_code=True)
64
- model = AutoModel.from_pretrained("Hoshipu/xvla-v20-task0-mp-radio", trust_remote_code=True)
 
 
 
65
  ```
66
 
67
  Or deploy as an inference WebSocket server (handles all pre/post-processing for OmniGibson observations):
@@ -70,13 +84,19 @@ Or deploy as an inference WebSocket server (handles all pre/post-processing for
70
  git clone -b v20 https://github.com/markli1hoshipu/behavior1k-xvla.git
71
  cd behavior1k-xvla
72
  bash setup.sh
 
 
 
 
 
 
73
  cd behavior1k_training
74
- python deploy_b1k.py --model_path <local-snapshot-of-this-repo> --port 8000
75
  ```
76
 
77
  See [`INFERENCE_README.md`](https://github.com/markli1hoshipu/behavior1k-xvla/blob/v20/behavior1k_training/INFERENCE_README.md) for the protocol.
78
 
79
- ## Files
80
 
81
  - `model.safetensors` — model weights (3.5 GB, bf16)
82
  - `config.json`, `preprocessor_config.json`, `tokenizer*`, `vocab.json`, `merges.txt` — config / tokenizer
 
13
 
14
  Fine-tune of [`2toINF/X-VLA-Pt`](https://huggingface.co/2toINF/X-VLA-Pt) on a single BEHAVIOR-1K task (turning on the radio receiver), using the **v20 architecture** from [markli1hoshipu/behavior1k-xvla @ v20](https://github.com/markli1hoshipu/behavior1k-xvla/tree/v20).
15
 
16
+ ## Available checkpoints
17
+
18
+ | Subfolder | Steps | total loss | joints | skill_cls | progress |
19
+ |---|---|---|---|---|---|
20
+ | [`ckpt-30000/`](./ckpt-30000) | 30,000 | 0.0232 | 0.0204 | 0.0000 | 0.0027 |
21
+ | [`ckpt-40000/`](./ckpt-40000) | 40,000 | 0.0165 | 0.0158 | 0.0000 | 0.0007 |
22
+ | [`ckpt-50000/`](./ckpt-50000) | 50,000 | 0.0131 | 0.0117 | 0.0000 | 0.0014 |
23
+ | [`ckpt-60000/`](./ckpt-60000) | 60,000 (final) | 0.0135 | 0.0107 | 0.0000 | 0.0028 |
24
+
25
+ Each subfolder is fully self-contained — load any of them with `subfolder="ckpt-XXXXX"` (see Usage).
26
+
27
  ## Architecture (v20)
28
 
29
  - **Additive per-task + per-skill soft prompts** (`task_prompt_hub[task_id] + skill_prompt_hub[skill_id]`), 32 tokens × 1024 dim each, zero-initialized
 
71
  ```python
72
  from transformers import AutoModel, AutoConfig
73
 
74
+ REPO = "Hoshipu/xvla-v20-task0-mp-radio"
75
+ CKPT = "ckpt-60000" # or ckpt-30000 / ckpt-40000 / ckpt-50000
76
+
77
+ config = AutoConfig.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
78
+ model = AutoModel.from_pretrained(REPO, subfolder=CKPT, trust_remote_code=True)
79
  ```
80
 
81
  Or deploy as an inference WebSocket server (handles all pre/post-processing for OmniGibson observations):
 
84
  git clone -b v20 https://github.com/markli1hoshipu/behavior1k-xvla.git
85
  cd behavior1k-xvla
86
  bash setup.sh
87
+
88
+ # Download a single checkpoint to a local dir
89
+ huggingface-cli download Hoshipu/xvla-v20-task0-mp-radio \
90
+ --include "ckpt-60000/*" \
91
+ --local-dir ./xvla-v20-task0-mp-radio
92
+
93
  cd behavior1k_training
94
+ python deploy_b1k.py --model_path ../xvla-v20-task0-mp-radio/ckpt-60000 --port 8000
95
  ```
96
 
97
  See [`INFERENCE_README.md`](https://github.com/markli1hoshipu/behavior1k-xvla/blob/v20/behavior1k_training/INFERENCE_README.md) for the protocol.
98
 
99
+ ## Files in each `ckpt-XXXXX/` subfolder
100
 
101
  - `model.safetensors` — model weights (3.5 GB, bf16)
102
  - `config.json`, `preprocessor_config.json`, `tokenizer*`, `vocab.json`, `merges.txt` — config / tokenizer