maxbittker commited on
Commit
b5422f9
·
verified ·
1 Parent(s): b51d3b3

Upload python LoRA step 150 from opus-task RL run

Browse files
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: moonshotai/Kimi-K2.6
4
+ library_name: tinker
5
+ tags:
6
+ - lora
7
+ - rl
8
+ - opus-magnum
9
+ - python
10
+ ---
11
+
12
+ # opus-k26-py-step150-2026-05-02
13
+
14
+ LoRA adapter trained with reinforcement learning (GRPO via Thinking Machines'
15
+ Tinker SDK) on the Opus-Magnum puzzle-solving REPL benchmark, snapshotted at
16
+ training step **150**.
17
+
18
+ ## Training setup
19
+
20
+ - **Base model:** `moonshotai/Kimi-K2.6`
21
+ - **Renderer:** `kimi_k25`
22
+ - **Representation:** `python` (action language the agent emits)
23
+ - **Adapter:** LoRA, rank `32`
24
+ - **RL recipe:** GRPO via Tinker
25
+ - **Hyperparameters:**
26
+ - `learning_rate = 1e-5`
27
+ - `group_size = 8`, `groups_per_batch = 16`
28
+ - `max_tokens = 1024`, `max_trajectory_tokens = 12000`
29
+ - `distances = 1,2,3,4`
30
+ - `max_steps_off_policy = None`
31
+ - `save_every = 5`
32
+
33
+ ## Files
34
+
35
+ - `adapter_model.safetensors` — Tinker raw LoRA adapter weights
36
+ - `adapter_config.json` — adapter metadata (rank, alpha, target modules)
37
+ - `README.md` — this file
38
+
39
+ ## Provenance
40
+
41
+ Tinker checkpoint:
42
+ ```
43
+ tinker://0aedf8c7-c9ad-57de-b8d5-d451fd058fde:train:0/sampler_weights/000150
44
+ ```
45
+
46
+ ## Converting to PEFT format
47
+
48
+ The files above are in Tinker's raw adapter format. To convert to PEFT format
49
+ suitable for direct vLLM `--lora-modules` loading, run on a machine that can
50
+ host the base model:
51
+
52
+ ```python
53
+ from tinker_cookbook.weights import build_lora_adapter
54
+
55
+ build_lora_adapter(
56
+ base_model="moonshotai/Kimi-K2.6",
57
+ adapter_path="./tinker_adapter", # this repo's contents
58
+ output_path="./peft_adapter",
59
+ )
60
+ ```
adapter_config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": null,
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": false,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 32,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "r": 32,
24
+ "rank_pattern": {},
25
+ "revision": null,
26
+ "target_modules": "all-linear",
27
+ "task_type": "CAUSAL_LM",
28
+ "trainable_token_indices": null,
29
+ "use_dora": false,
30
+ "use_rslora": false
31
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39a8067ff3947dc7226eb1ef79492245b31d92d15f8f10840df8a31ee132caac
3
+ size 18777115704
checkpoint_complete ADDED
File without changes