Add VLADrop-pi05-LIBERO-metric-drop9-taylor-igia (VLADrop / DTR, arXiv:2606.27755)

README.md

@@ -0,0 +1,54 @@
+---
+license: apache-2.0
+tags:
+- robotics
+- vla
+- vision-language-action
+- libero
+- model-compression
+pipeline_tag: robotics
+---
+
+# VLADrop-pi05-LIBERO-metric-drop9-taylor-igia
+
+Checkpoint for [Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?](https://arxiv.org/abs/2606.27755).
+
+DTR (Drop-Then-Recovery) removes transformer blocks from a pretrained VLA model and
+recovery-fine-tunes the smaller dense model. Code: https://github.com/s1ghhh/VLADrop
+
+## This checkpoint
+
+| | |
+|---|---|
+| Paper row | Table 3: Taylor (= IGIA, identical block selection at this level) (Drop-9 importance-metric comparison) |
+| Dropped blocks | Language backbone (PaliGemma, 18 layers): drop 9 whole blocks selected by Taylor (= IGIA, identical block selection at this level); keep blocks [0,1,3,4,5,6,7,8,9]. Vision and action untouched. |
+| Recovery training | batch size 32, 30K steps, lr 5e-5 |
+| LIBERO success rate | Spatial / Object / Goal / Long / Avg = 97.0 / 97.0 / 94.0 / 88.6 / 94.2 |
+
+## Usage
+
+This is an [openpi](https://github.com/Physical-Intelligence/openpi)-format pi0.5 checkpoint
+(PyTorch). Use with the VLADrop fork: https://github.com/s1ghhh/VLADrop
+
+```bash
+python scripts/serve_policy_batch_drop.py \
+    --config pi05_libero_dropped \
+    --dir <this_repo_local_path> \
+    --port 8000
+```
+
+**Important:** the drop lists are NOT stored inside the checkpoint. Pass the exact
+`llm_drop_attn_list` / `llm_drop_mlp_list` shown above (via config or CLI) when serving,
+otherwise layers will be mismatched. `assets/` contains the LIBERO norm stats.
+The optimizer state (`train_state/`) is not included.
+
+## Citation
+
+```bibtex
+@article{sun2026vladrop,
+  title={Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?},
+  author={Sun, Guoheng and Feng, Kaixi and He, Shwai and Gong, Xiaochuan and He, Yexiao and Wang, Ziyao and Shen, Zheyu and Ye, Wanghao and Kompella, Ramana Rao and Liu, Gaowen and Li, Ang},
+  journal={arXiv preprint arXiv:2606.27755},
+  year={2026}
+}
+```

assets/physical-intelligence/libero/norm_stats.json

@@ -0,0 +1,84 @@
+{
+  "norm_stats": {
+    "state": {
+      "mean": [
+        -0.04652611166238785,
+        0.034395575523376465,
+        0.7645326256752014,
+        2.972200632095337,
+        -0.22040514647960663,
+        -0.12562009692192078,
+        0.026915626600384712,
+        -0.02719222754240036
+      ],
+      "std": [
+        0.10494592040777206,
+        0.15176665782928467,
+        0.37852945923805237,
+        0.3442988693714142,
+        0.9069637656211853,
+        0.3253786265850067,
+        0.014175431802868843,
+        0.014058168977499008
+      ],
+      "q01": [
+        -0.3992278680294752,
+        -0.2688781352341175,
+        0.0380015922319144,
+        1.5083277968406676,
+        -2.721004430627823,
+        -1.0813218128442763,
+        0.00173520012809895,
+        -0.04004424215038307
+      ],
+      "q99": [
+        0.13532010269463068,
+        0.33566314613819126,
+        1.2698724751349537,
+        3.2765059180259706,
+        2.405436800289154,
+        0.5971528978824616,
+        0.04030334069116507,
+        -0.0017878379381960213
+      ]
+    },
+    "actions": {
+      "mean": [
+        0.05515800043940544,
+        0.08770468831062317,
+        -0.08735653758049011,
+        0.0007100921357050538,
+        0.005471237003803253,
+        -0.005537765566259623,
+        -0.04559307545423508
+      ],
+      "std": [
+        0.331879198551178,
+        0.3758169412612915,
+        0.448102205991745,
+        0.039334457367658615,
+        0.06358090043067932,
+        0.07857435941696167,
+        0.9989600777626038
+      ],
+      "q01": [
+        -0.7072499999999999,
+        -0.7983750000000001,
+        -0.9375,
+        -0.11467779144644738,
+        -0.16425,
+        -0.2240490057706833,
+        -1.0
+      ],
+      "q99": [
+        0.937125,
+        0.86775,
+        0.937125,
+        0.1315075716376305,
+        0.19169999999999998,
+        0.33742949963808055,
+        0.9996
+      ]
+    }
+  }
+}

metadata.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23b6c26a6050dacaeb36049b634f8c9454cbac1f98836a652ca3a8b1ac737a31
+size 3379

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e1122ae52812394df9b573ee05017864a8d91082e5b9a83ad676f897303e3bc
+size 7473091464