--- title: SRT-NLA v1 demo emoji: ๐Ÿชž colorFrom: indigo colorTo: green sdk: gradio sdk_version: 4.44.1 python_version: "3.10.13" app_file: app.py pinned: false license: apache-2.0 hardware: zero-a10g short_description: Latent autoencoder over Qwen2.5-7B L20 models: - RiverRider/srt-nla-av-v1 - Qwen/Qwen2.5-7B --- # SRT-NLA v1 โ€” latent autoencoder demo Two interactive views of the `RiverRider/srt-nla-av-v1` verbalizer. 1. **Round-trip autoencoder.** Encode a passage with frozen Qwen2.5-7B at L20, decode the resulting 3584-dim vector with the 12.7M-parameter NLA verbalizer, and re-encode the verbalization to measure round-trip fidelity (`centered fve_nrm`, `rho_norm`). Best-of-N rerank is included โ€” this is the technique that takes greedy `ฯ โ‰ˆ 0.26` up to `ฯ โ‰ˆ 0.92` in the paper. 2. **Latent arithmetic.** Encode two passages, slide an interpolation `ฮฑ`, and verbalize the mixture vector. ## Anchors (paper ยง3) | Anchor | centered fve_nrm | |---|---| | Random floor | 0.510 | | NN-retrieval over pool=2000 | 0.71 | | Qwen paraphrase ceiling | 0.799 | `rho_norm = (cen โˆ’ 0.510) / 0.289` linearly remaps to `[0, 1]` against these anchors. ## Source Code: https://github.com/space-bacon/SRT (branch `nla`, `docs/hf/nla_v1_demo/`).