Instructions to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-9B")
model = PeftModel.from_pretrained(base_model, "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall")

Transformers

How to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall

SGLang

How to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall with Docker Model Runner:
```
docker model run hf.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall
```

1jamesthompson1 commited on 4 days ago

Commit

15477db

verified ·

1 Parent(s): d59a857

Upload folder using huggingface_hub

Browse files

Files changed (10) hide show

README.md +34 -18
adapter_config.json +4 -4
adapter_model.safetensors +1 -1
finetune_config.json +4 -4
optimizer.pt +3 -0
scheduler.pt +3 -0
trainer_state.json +267 -0
training.log +52 -0
training_args.bin +1 -1
training_log.json +194 -74

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ dataset, **overall** subpopulation.
 Part of the [wvs-nz-value-alignment](https://huggingface.co/collections/wvs-nz-value-alignment) collection.
-**GPU:** NVIDIA RTX PRO 6000 Blackwell Workstation Edition · **Training time:** 13m 48s
 ## Training hyperparameters
@@ -49,7 +49,7 @@ Part of the [wvs-nz-value-alignment](https://huggingface.co/collections/wvs-nz-v
 | LoRA dropout | 0.05 |
 | DoRA | False |
 | Learning rate | 0.0002 |
-| Batch size | 4 |
 | Gradient accumulation | 4 |
 | Epochs | 1 |
 | Max seq length | 1024 |
@@ -60,22 +60,38 @@ Part of the [wvs-nz-value-alignment](https://huggingface.co/collections/wvs-nz-v
 ```
-{"loss": 8.111881256103516, "grad_norm": 36.93735122680664, "learning_rate": 0.00019705882352941177, "epoch": 0.13245033112582782, "step": 10}
-{"eval_loss": 1.8344852924346924, "eval_runtime": 16.4711, "eval_samples_per_second": 9.107, "eval_steps_per_second": 2.307, "epoch": 0.13245033112582782, "step": 10}
-{"loss": 6.350960540771484, "grad_norm": 8.284809112548828, "learning_rate": 0.00016764705882352942, "epoch": 0.26490066225165565, "step": 20}
-{"eval_loss": 1.3456758260726929, "eval_runtime": 16.8028, "eval_samples_per_second": 8.927, "eval_steps_per_second": 2.262, "epoch": 0.26490066225165565, "step": 20}
-{"loss": 5.212066268920898, "grad_norm": 8.698701858520508, "learning_rate": 0.00013823529411764707, "epoch": 0.3973509933774834, "step": 30}
-{"eval_loss": 1.2856894731521606, "eval_runtime": 16.8725, "eval_samples_per_second": 8.89, "eval_steps_per_second": 2.252, "epoch": 0.3973509933774834, "step": 30}
-{"loss": 5.230597305297851, "grad_norm": 4.453671455383301, "learning_rate": 0.0001088235294117647, "epoch": 0.5298013245033113, "step": 40}
-{"eval_loss": 1.266767978668213, "eval_runtime": 16.9175, "eval_samples_per_second": 8.867, "eval_steps_per_second": 2.246, "epoch": 0.5298013245033113, "step": 40}
-{"loss": 5.069366836547852, "grad_norm": 3.493168354034424, "learning_rate": 7.941176470588235e-05, "epoch": 0.6622516556291391, "step": 50}
-{"eval_loss": 1.2818269729614258, "eval_runtime": 16.9098, "eval_samples_per_second": 8.871, "eval_steps_per_second": 2.247, "epoch": 0.6622516556291391, "step": 50}
-{"loss": 4.989227676391602, "grad_norm": 4.791518211364746, "learning_rate": 5e-05, "epoch": 0.7947019867549668, "step": 60}
-{"eval_loss": 1.2685493230819702, "eval_runtime": 16.9053, "eval_samples_per_second": 8.873, "eval_steps_per_second": 2.248, "epoch": 0.7947019867549668, "step": 60}
-{"loss": 4.609055709838867, "grad_norm": 2.6835153102874756, "learning_rate": 2.058823529411765e-05, "epoch": 0.9271523178807947, "step": 70}
-{"eval_loss": 1.2449450492858887, "eval_runtime": 16.924, "eval_samples_per_second": 8.863, "eval_steps_per_second": 2.245, "epoch": 0.9271523178807947, "step": 70}
-{"eval_loss": 1.2424073219299316, "eval_runtime": 16.9059, "eval_samples_per_second": 8.873, "eval_steps_per_second": 2.248, "epoch": 1.0, "step": 76}
-{"train_runtime": 828.4429, "train_samples_per_second": 1.456, "train_steps_per_second": 0.092, "total_flos": 7.64036915963566e+16, "train_loss": 5.566998130396793, "epoch": 1.0, "step": 76}
 ```

 Part of the [wvs-nz-value-alignment](https://huggingface.co/collections/wvs-nz-value-alignment) collection.
+**GPU:** NVIDIA A40 · **Training time:** 57m 15s
 ## Training hyperparameters
 | LoRA dropout | 0.05 |
 | DoRA | False |
 | Learning rate | 0.0002 |
+| Batch size | 2 |
 | Gradient accumulation | 4 |
 | Epochs | 1 |
 | Max seq length | 1024 |
 ```
+{"loss": 8.703079986572266, "grad_norm": 55.47663497924805, "learning_rate": 0.00011250000000000001, "epoch": 0.06504065040650407, "step": 10}
+{"eval_loss": 1.79399573802948, "eval_runtime": 93.2017, "eval_samples_per_second": 2.961, "eval_steps_per_second": 1.481, "epoch": 0.06504065040650407, "step": 10}
+{"loss": 6.914659881591797, "grad_norm": 18.564268112182617, "learning_rate": 0.0001956521739130435, "epoch": 0.13008130081300814, "step": 20}
+{"eval_loss": 1.4378732442855835, "eval_runtime": 92.8107, "eval_samples_per_second": 2.974, "eval_steps_per_second": 1.487, "epoch": 0.13008130081300814, "step": 20}
+{"loss": 5.270082092285156, "grad_norm": 6.949378490447998, "learning_rate": 0.00018115942028985507, "epoch": 0.1951219512195122, "step": 30}
+{"eval_loss": 1.3564187288284302, "eval_runtime": 92.968, "eval_samples_per_second": 2.969, "eval_steps_per_second": 1.484, "epoch": 0.1951219512195122, "step": 30}
+{"loss": 5.4691619873046875, "grad_norm": 18.938419342041016, "learning_rate": 0.0001666666666666667, "epoch": 0.2601626016260163, "step": 40}
+{"eval_loss": 1.2968977689743042, "eval_runtime": 92.9333, "eval_samples_per_second": 2.97, "eval_steps_per_second": 1.485, "epoch": 0.2601626016260163, "step": 40}
+{"loss": 4.866386032104492, "grad_norm": 4.205469131469727, "learning_rate": 0.00015217391304347827, "epoch": 0.3252032520325203, "step": 50}
+{"eval_loss": 1.3045886754989624, "eval_runtime": 92.8006, "eval_samples_per_second": 2.974, "eval_steps_per_second": 1.487, "epoch": 0.3252032520325203, "step": 50}
+{"loss": 5.203897476196289, "grad_norm": 6.2034478187561035, "learning_rate": 0.00013768115942028986, "epoch": 0.3902439024390244, "step": 60}
+{"eval_loss": 1.2741440534591675, "eval_runtime": 92.7552, "eval_samples_per_second": 2.976, "eval_steps_per_second": 1.488, "epoch": 0.3902439024390244, "step": 60}
+{"loss": 5.226799392700196, "grad_norm": 5.329586029052734, "learning_rate": 0.00012318840579710145, "epoch": 0.45528455284552843, "step": 70}
+{"eval_loss": 1.2608736753463745, "eval_runtime": 92.7677, "eval_samples_per_second": 2.975, "eval_steps_per_second": 1.488, "epoch": 0.45528455284552843, "step": 70}
+{"loss": 4.7585094451904295, "grad_norm": 6.022779941558838, "learning_rate": 0.00010869565217391305, "epoch": 0.5203252032520326, "step": 80}
+{"eval_loss": 1.2409065961837769, "eval_runtime": 92.9603, "eval_samples_per_second": 2.969, "eval_steps_per_second": 1.485, "epoch": 0.5203252032520326, "step": 80}
+{"loss": 5.141559982299805, "grad_norm": 6.975116729736328, "learning_rate": 9.420289855072463e-05, "epoch": 0.5853658536585366, "step": 90}
+{"eval_loss": 1.2473307847976685, "eval_runtime": 93.0257, "eval_samples_per_second": 2.967, "eval_steps_per_second": 1.483, "epoch": 0.5853658536585366, "step": 90}
+{"loss": 4.915719604492187, "grad_norm": 5.658397197723389, "learning_rate": 7.971014492753623e-05, "epoch": 0.6504065040650406, "step": 100}
+{"eval_loss": 1.2207982540130615, "eval_runtime": 92.9926, "eval_samples_per_second": 2.968, "eval_steps_per_second": 1.484, "epoch": 0.6504065040650406, "step": 100}
+{"loss": 4.71471939086914, "grad_norm": 4.068330764770508, "learning_rate": 6.521739130434783e-05, "epoch": 0.7154471544715447, "step": 110}
+{"eval_loss": 1.2062972784042358, "eval_runtime": 93.0862, "eval_samples_per_second": 2.965, "eval_steps_per_second": 1.482, "epoch": 0.7154471544715447, "step": 110}
+{"loss": 5.122110748291016, "grad_norm": 4.539018154144287, "learning_rate": 5.072463768115943e-05, "epoch": 0.7804878048780488, "step": 120}
+{"eval_loss": 1.1862434148788452, "eval_runtime": 92.8886, "eval_samples_per_second": 2.971, "eval_steps_per_second": 1.486, "epoch": 0.7804878048780488, "step": 120}
+{"loss": 5.124646377563477, "grad_norm": 2.0783629417419434, "learning_rate": 3.6231884057971014e-05, "epoch": 0.8455284552845529, "step": 130}
+{"eval_loss": 1.1823657751083374, "eval_runtime": 93.3157, "eval_samples_per_second": 2.958, "eval_steps_per_second": 1.479, "epoch": 0.8455284552845529, "step": 130}
+{"loss": 4.650765609741211, "grad_norm": 2.456535816192627, "learning_rate": 2.173913043478261e-05, "epoch": 0.9105691056910569, "step": 140}
+{"eval_loss": 1.1808730363845825, "eval_runtime": 93.0255, "eval_samples_per_second": 2.967, "eval_steps_per_second": 1.483, "epoch": 0.9105691056910569, "step": 140}
+{"loss": 4.547821807861328, "grad_norm": 3.2700843811035156, "learning_rate": 7.246376811594203e-06, "epoch": 0.975609756097561, "step": 150}
+{"eval_loss": 1.1744519472122192, "eval_runtime": 92.9911, "eval_samples_per_second": 2.968, "eval_steps_per_second": 1.484, "epoch": 0.975609756097561, "step": 150}
+{"eval_loss": 1.1732834577560425, "eval_runtime": 93.2831, "eval_samples_per_second": 2.959, "eval_steps_per_second": 1.479, "epoch": 1.0, "step": 154}
+{"train_runtime": 3434.9466, "train_samples_per_second": 0.358, "train_steps_per_second": 0.045, "total_flos": 5.38753752607488e+16, "train_loss": 5.347667557852609, "epoch": 1.0, "step": 154}
 ```

adapter_config.json CHANGED Viewed

@@ -31,13 +31,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "k_proj",
-    "down_proj",
     "q_proj",
     "v_proj",
     "o_proj",
-    "gate_proj",
-    "up_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

   "rank_pattern": {},
   "revision": null,
   "target_modules": [
     "q_proj",
     "v_proj",
+    "k_proj",
+    "up_proj",
+    "down_proj",
     "o_proj",
+    "gate_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7c81efe098ccf9a9c9f420f49d4b10c09c97e861a0e6066e0843446ba7eeb2bb
 size 116425880

 version https://git-lfs.github.com/spec/v1
+oid sha256:d0971a6748cb1bcb5e653a4458e3fdeb1c5163c08c8a447ee9a63b0f8f1673fd
 size 116425880

finetune_config.json CHANGED Viewed

@@ -2,12 +2,12 @@
   "model": "Qwen/Qwen3.5-9B",
   "model_sha": "c202236235762e1c871ad0ccb60c8ee5ba337b9a",
   "dataset": "full_string_distribution",
-  "dataset_sha": "38f42265e06d60afd0a5d2d45808202e60e95103",
   "subpopulation": "overall",
-  "gpu": "NVIDIA RTX PRO 6000 Blackwell Workstation Edition",
   "library_name": "peft",
   "pipeline_tag": "text-generation",
-  "timestamp": "2026-08-04T16:12:54.225570",
   "hyperparameters": {
     "lora_r": 16,
     "lora_alpha": 32,
@@ -16,7 +16,7 @@
     "quantization": null,
     "lr": 0.0002,
     "num_epochs": 1,
-    "batch_size": 4,
     "gradient_accumulation_steps": 4,
     "max_seq_length": 1024,
     "warmup_ratio": 0.1,

   "model": "Qwen/Qwen3.5-9B",
   "model_sha": "c202236235762e1c871ad0ccb60c8ee5ba337b9a",
   "dataset": "full_string_distribution",
+  "dataset_sha": "bed59feca08a07d738247ae72cca67a6facf4b7d",
   "subpopulation": "overall",
+  "gpu": "NVIDIA A40",
   "library_name": "peft",
   "pipeline_tag": "text-generation",
+  "timestamp": "2026-08-10T21:46:58.517058",
   "hyperparameters": {
     "lora_r": 16,
     "lora_alpha": 32,
     "quantization": null,
     "lr": 0.0002,
     "num_epochs": 1,
+    "batch_size": 2,
     "gradient_accumulation_steps": 4,
     "max_seq_length": 1024,
     "warmup_ratio": 0.1,

optimizer.pt ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8929c85db67e3e1ed07e29c48c5631508d57bfff464ca2f05c0695bdb285085f
+size 233003659

scheduler.pt ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8d028ebc8984a5d698f763a5fa448f6eade1019173e63e1230346870368c3c88
+size 1465

trainer_state.json ADDED Viewed

	@@ -0,0 +1,267 @@

+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 10,
+  "global_step": 154,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.06504065040650407,
+      "grad_norm": 55.47663497924805,
+      "learning_rate": 0.00011250000000000001,
+      "loss": 8.703079986572266,
+      "step": 10
+    },
+    {
+      "epoch": 0.06504065040650407,
+      "eval_loss": 1.79399573802948,
+      "eval_runtime": 93.2017,
+      "eval_samples_per_second": 2.961,
+      "eval_steps_per_second": 1.481,
+      "step": 10
+    },
+    {
+      "epoch": 0.13008130081300814,
+      "grad_norm": 18.564268112182617,
+      "learning_rate": 0.0001956521739130435,
+      "loss": 6.914659881591797,
+      "step": 20
+    },
+    {
+      "epoch": 0.13008130081300814,
+      "eval_loss": 1.4378732442855835,
+      "eval_runtime": 92.8107,
+      "eval_samples_per_second": 2.974,
+      "eval_steps_per_second": 1.487,
+      "step": 20
+    },
+    {
+      "epoch": 0.1951219512195122,
+      "grad_norm": 6.949378490447998,
+      "learning_rate": 0.00018115942028985507,
+      "loss": 5.270082092285156,
+      "step": 30
+    },
+    {
+      "epoch": 0.1951219512195122,
+      "eval_loss": 1.3564187288284302,
+      "eval_runtime": 92.968,
+      "eval_samples_per_second": 2.969,
+      "eval_steps_per_second": 1.484,
+      "step": 30
+    },
+    {
+      "epoch": 0.2601626016260163,
+      "grad_norm": 18.938419342041016,
+      "learning_rate": 0.0001666666666666667,
+      "loss": 5.4691619873046875,
+      "step": 40
+    },
+    {
+      "epoch": 0.2601626016260163,
+      "eval_loss": 1.2968977689743042,
+      "eval_runtime": 92.9333,
+      "eval_samples_per_second": 2.97,
+      "eval_steps_per_second": 1.485,
+      "step": 40
+    },
+    {
+      "epoch": 0.3252032520325203,
+      "grad_norm": 4.205469131469727,
+      "learning_rate": 0.00015217391304347827,
+      "loss": 4.866386032104492,
+      "step": 50
+    },
+    {
+      "epoch": 0.3252032520325203,
+      "eval_loss": 1.3045886754989624,
+      "eval_runtime": 92.8006,
+      "eval_samples_per_second": 2.974,
+      "eval_steps_per_second": 1.487,
+      "step": 50
+    },
+    {
+      "epoch": 0.3902439024390244,
+      "grad_norm": 6.2034478187561035,
+      "learning_rate": 0.00013768115942028986,
+      "loss": 5.203897476196289,
+      "step": 60
+    },
+    {
+      "epoch": 0.3902439024390244,
+      "eval_loss": 1.2741440534591675,
+      "eval_runtime": 92.7552,
+      "eval_samples_per_second": 2.976,
+      "eval_steps_per_second": 1.488,
+      "step": 60
+    },
+    {
+      "epoch": 0.45528455284552843,
+      "grad_norm": 5.329586029052734,
+      "learning_rate": 0.00012318840579710145,
+      "loss": 5.226799392700196,
+      "step": 70
+    },
+    {
+      "epoch": 0.45528455284552843,
+      "eval_loss": 1.2608736753463745,
+      "eval_runtime": 92.7677,
+      "eval_samples_per_second": 2.975,
+      "eval_steps_per_second": 1.488,
+      "step": 70
+    },
+    {
+      "epoch": 0.5203252032520326,
+      "grad_norm": 6.022779941558838,
+      "learning_rate": 0.00010869565217391305,
+      "loss": 4.7585094451904295,
+      "step": 80
+    },
+    {
+      "epoch": 0.5203252032520326,
+      "eval_loss": 1.2409065961837769,
+      "eval_runtime": 92.9603,
+      "eval_samples_per_second": 2.969,
+      "eval_steps_per_second": 1.485,
+      "step": 80
+    },
+    {
+      "epoch": 0.5853658536585366,
+      "grad_norm": 6.975116729736328,
+      "learning_rate": 9.420289855072463e-05,
+      "loss": 5.141559982299805,
+      "step": 90
+    },
+    {
+      "epoch": 0.5853658536585366,
+      "eval_loss": 1.2473307847976685,
+      "eval_runtime": 93.0257,
+      "eval_samples_per_second": 2.967,
+      "eval_steps_per_second": 1.483,
+      "step": 90
+    },
+    {
+      "epoch": 0.6504065040650406,
+      "grad_norm": 5.658397197723389,
+      "learning_rate": 7.971014492753623e-05,
+      "loss": 4.915719604492187,
+      "step": 100
+    },
+    {
+      "epoch": 0.6504065040650406,
+      "eval_loss": 1.2207982540130615,
+      "eval_runtime": 92.9926,
+      "eval_samples_per_second": 2.968,
+      "eval_steps_per_second": 1.484,
+      "step": 100
+    },
+    {
+      "epoch": 0.7154471544715447,
+      "grad_norm": 4.068330764770508,
+      "learning_rate": 6.521739130434783e-05,
+      "loss": 4.71471939086914,
+      "step": 110
+    },
+    {
+      "epoch": 0.7154471544715447,
+      "eval_loss": 1.2062972784042358,
+      "eval_runtime": 93.0862,
+      "eval_samples_per_second": 2.965,
+      "eval_steps_per_second": 1.482,
+      "step": 110
+    },
+    {
+      "epoch": 0.7804878048780488,
+      "grad_norm": 4.539018154144287,
+      "learning_rate": 5.072463768115943e-05,
+      "loss": 5.122110748291016,
+      "step": 120
+    },
+    {
+      "epoch": 0.7804878048780488,
+      "eval_loss": 1.1862434148788452,
+      "eval_runtime": 92.8886,
+      "eval_samples_per_second": 2.971,
+      "eval_steps_per_second": 1.486,
+      "step": 120
+    },
+    {
+      "epoch": 0.8455284552845529,
+      "grad_norm": 2.0783629417419434,
+      "learning_rate": 3.6231884057971014e-05,
+      "loss": 5.124646377563477,
+      "step": 130
+    },
+    {
+      "epoch": 0.8455284552845529,
+      "eval_loss": 1.1823657751083374,
+      "eval_runtime": 93.3157,
+      "eval_samples_per_second": 2.958,
+      "eval_steps_per_second": 1.479,
+      "step": 130
+    },
+    {
+      "epoch": 0.9105691056910569,
+      "grad_norm": 2.456535816192627,
+      "learning_rate": 2.173913043478261e-05,
+      "loss": 4.650765609741211,
+      "step": 140
+    },
+    {
+      "epoch": 0.9105691056910569,
+      "eval_loss": 1.1808730363845825,
+      "eval_runtime": 93.0255,
+      "eval_samples_per_second": 2.967,
+      "eval_steps_per_second": 1.483,
+      "step": 140
+    },
+    {
+      "epoch": 0.975609756097561,
+      "grad_norm": 3.2700843811035156,
+      "learning_rate": 7.246376811594203e-06,
+      "loss": 4.547821807861328,
+      "step": 150
+    },
+    {
+      "epoch": 0.975609756097561,
+      "eval_loss": 1.1744519472122192,
+      "eval_runtime": 92.9911,
+      "eval_samples_per_second": 2.968,
+      "eval_steps_per_second": 1.484,
+      "step": 150
+    },
+    {
+      "epoch": 1.0,
+      "eval_loss": 1.1732834577560425,
+      "eval_runtime": 93.2831,
+      "eval_samples_per_second": 2.959,
+      "eval_steps_per_second": 1.479,
+      "step": 154
+    }
+  ],
+  "logging_steps": 10,
+  "max_steps": 154,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 200,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 5.38753752607488e+16,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

training.log CHANGED Viewed

@@ -56,3 +56,55 @@ HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 200 OK"
 [upload] uploading output/full_string_distribution/overall to https://huggingface.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall...
 HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
 HTTP Request: POST https://huggingface.co/api/models/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall/preupload/main "HTTP/1.1 200 OK"

 [upload] uploading output/full_string_distribution/overall to https://huggingface.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall...
 HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
 HTTP Request: POST https://huggingface.co/api/models/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall/preupload/main "HTTP/1.1 200 OK"
+HTTP Request: POST https://huggingface.co/api/models/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall/commit/main "HTTP/1.1 200 OK"
+HTTP Request: GET https://huggingface.co/api/whoami-v2 "HTTP/1.1 200 OK"
+HTTP Request: POST https://huggingface.co/api/collections "HTTP/1.1 409 Conflict"
+HTTP Request: GET https://huggingface.co/api/collections/1jamesthompson1/wvs-nz-value-alignment-6a694dfd6dfcffbe0cd124ed "HTTP/1.1 200 OK"
+HTTP Request: POST https://huggingface.co/api/collections/1jamesthompson1/wvs-nz-value-alignment-6a694dfd6dfcffbe0cd124ed/items "HTTP/1.1 200 OK"
+[upload] added to collection 1jamesthompson1/wvs-nz-value-alignment-6a694dfd6dfcffbe0cd124ed
+[upload] done — https://huggingface.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall
+[done] uploaded to 1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall
+logging to output/full_string_distribution/overall/training.log
+[dist] loading tokenizer...
+[dist] tokenizing 1230 examples...
+[dist] 6470 options/completions across 1230 examples
+[dist] tokenizing validation split for eval...
+[data] loaded 276 validation examples (config=full_string_distribution, subpop=overall)
+[dist] eval split: 276 examples
+[dist] loading model...
+[dist] starting training...
+logging to output/full_string_distribution/overall/training.log
+[dist] loading tokenizer...
+[dist] tokenizing 1230 examples...
+[dist] 6470 options/completions across 1230 examples
+[dist] tokenizing validation split for eval...
+[data] loaded 276 validation examples (config=full_string_distribution, subpop=overall)
+[dist] eval split: 276 examples
+[dist] loading model...
+[dist] starting training...
+logging to output/full_string_distribution/overall/training.log
+[dist] loading tokenizer...
+[dist] tokenizing 1230 examples...
+[dist] 6470 options/completions across 1230 examples
+[dist] tokenizing validation split for eval...
+[data] loaded 276 validation examples (config=full_string_distribution, subpop=overall)
+[dist] eval split: 276 examples
+[dist] loading model...
+[dist] starting training...
+logging to output/full_string_distribution/overall/training.log
+[dist] loading tokenizer...
+[dist] tokenizing 1230 examples...
+[dist] 6470 options/completions across 1230 examples
+[dist] tokenizing validation split for eval...
+[data] loaded 276 validation examples (config=full_string_distribution, subpop=overall)
+[dist] eval split: 276 examples
+[dist] loading model...
+[dist] starting training...
+[dist] saving...
+[resume] staged continuation state from output/full_string_distribution/overall/checkpoint-154: ['optimizer.pt', 'scheduler.pt', 'trainer_state.json']
+    training log -> output/full_string_distribution/overall/training_log.json
+    run metadata -> output/full_string_distribution/overall/finetune_config.json
+    environment -> output/full_string_distribution/overall/environment.json
+    README -> output/full_string_distribution/overall/README.md
+[upload] uploading output/full_string_distribution/overall to https://huggingface.co/1jamesthompson1/Qwen3.5-9B-nz-wvs-full_string_distribution-overall...

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5becab0e45d81e41facd8d2469fb421b25401242f1519b58f9e42b0972848826
 size 5201

 version https://git-lfs.github.com/spec/v1
+oid sha256:e9a760a83555cfa15ebfbbe812e695cdce2c99e115740c00c6f623bb6d0454e7
 size 5201

training_log.json CHANGED Viewed

@@ -1,124 +1,244 @@
 [
   {
-    "loss": 8.111881256103516,
-    "grad_norm": 36.93735122680664,
-    "learning_rate": 0.00019705882352941177,
-    "epoch": 0.13245033112582782,
     "step": 10
   },
   {
-    "eval_loss": 1.8344852924346924,
-    "eval_runtime": 16.4711,
-    "eval_samples_per_second": 9.107,
-    "eval_steps_per_second": 2.307,
-    "epoch": 0.13245033112582782,
     "step": 10
   },
   {
-    "loss": 6.350960540771484,
-    "grad_norm": 8.284809112548828,
-    "learning_rate": 0.00016764705882352942,
-    "epoch": 0.26490066225165565,
     "step": 20
   },
   {
-    "eval_loss": 1.3456758260726929,
-    "eval_runtime": 16.8028,
-    "eval_samples_per_second": 8.927,
-    "eval_steps_per_second": 2.262,
-    "epoch": 0.26490066225165565,
     "step": 20
   },
   {
-    "loss": 5.212066268920898,
-    "grad_norm": 8.698701858520508,
-    "learning_rate": 0.00013823529411764707,
-    "epoch": 0.3973509933774834,
     "step": 30
   },
   {
-    "eval_loss": 1.2856894731521606,
-    "eval_runtime": 16.8725,
-    "eval_samples_per_second": 8.89,
-    "eval_steps_per_second": 2.252,
-    "epoch": 0.3973509933774834,
     "step": 30
   },
   {
-    "loss": 5.230597305297851,
-    "grad_norm": 4.453671455383301,
-    "learning_rate": 0.0001088235294117647,
-    "epoch": 0.5298013245033113,
     "step": 40
   },
   {
-    "eval_loss": 1.266767978668213,
-    "eval_runtime": 16.9175,
-    "eval_samples_per_second": 8.867,
-    "eval_steps_per_second": 2.246,
-    "epoch": 0.5298013245033113,
     "step": 40
   },
   {
-    "loss": 5.069366836547852,
-    "grad_norm": 3.493168354034424,
-    "learning_rate": 7.941176470588235e-05,
-    "epoch": 0.6622516556291391,
     "step": 50
   },
   {
-    "eval_loss": 1.2818269729614258,
-    "eval_runtime": 16.9098,
-    "eval_samples_per_second": 8.871,
-    "eval_steps_per_second": 2.247,
-    "epoch": 0.6622516556291391,
     "step": 50
   },
   {
-    "loss": 4.989227676391602,
-    "grad_norm": 4.791518211364746,
-    "learning_rate": 5e-05,
-    "epoch": 0.7947019867549668,
     "step": 60
   },
   {
-    "eval_loss": 1.2685493230819702,
-    "eval_runtime": 16.9053,
-    "eval_samples_per_second": 8.873,
-    "eval_steps_per_second": 2.248,
-    "epoch": 0.7947019867549668,
     "step": 60
   },
   {
-    "loss": 4.609055709838867,
-    "grad_norm": 2.6835153102874756,
-    "learning_rate": 2.058823529411765e-05,
-    "epoch": 0.9271523178807947,
     "step": 70
   },
   {
-    "eval_loss": 1.2449450492858887,
-    "eval_runtime": 16.924,
-    "eval_samples_per_second": 8.863,
-    "eval_steps_per_second": 2.245,
-    "epoch": 0.9271523178807947,
     "step": 70
   },
   {
-    "eval_loss": 1.2424073219299316,
-    "eval_runtime": 16.9059,
-    "eval_samples_per_second": 8.873,
-    "eval_steps_per_second": 2.248,
     "epoch": 1.0,
-    "step": 76
   },
   {
-    "train_runtime": 828.4429,
-    "train_samples_per_second": 1.456,
-    "train_steps_per_second": 0.092,
-    "total_flos": 7.64036915963566e+16,
-    "train_loss": 5.566998130396793,
     "epoch": 1.0,
-    "step": 76
   }
 ]

 [
   {
+    "loss": 8.703079986572266,
+    "grad_norm": 55.47663497924805,
+    "learning_rate": 0.00011250000000000001,
+    "epoch": 0.06504065040650407,
     "step": 10
   },
   {
+    "eval_loss": 1.79399573802948,
+    "eval_runtime": 93.2017,
+    "eval_samples_per_second": 2.961,
+    "eval_steps_per_second": 1.481,
+    "epoch": 0.06504065040650407,
     "step": 10
   },
   {
+    "loss": 6.914659881591797,
+    "grad_norm": 18.564268112182617,
+    "learning_rate": 0.0001956521739130435,
+    "epoch": 0.13008130081300814,
     "step": 20
   },
   {
+    "eval_loss": 1.4378732442855835,
+    "eval_runtime": 92.8107,
+    "eval_samples_per_second": 2.974,
+    "eval_steps_per_second": 1.487,
+    "epoch": 0.13008130081300814,
     "step": 20
   },
   {
+    "loss": 5.270082092285156,
+    "grad_norm": 6.949378490447998,
+    "learning_rate": 0.00018115942028985507,
+    "epoch": 0.1951219512195122,
     "step": 30
   },
   {
+    "eval_loss": 1.3564187288284302,
+    "eval_runtime": 92.968,
+    "eval_samples_per_second": 2.969,
+    "eval_steps_per_second": 1.484,
+    "epoch": 0.1951219512195122,
     "step": 30
   },
   {
+    "loss": 5.4691619873046875,
+    "grad_norm": 18.938419342041016,
+    "learning_rate": 0.0001666666666666667,
+    "epoch": 0.2601626016260163,
     "step": 40
   },
   {
+    "eval_loss": 1.2968977689743042,
+    "eval_runtime": 92.9333,
+    "eval_samples_per_second": 2.97,
+    "eval_steps_per_second": 1.485,
+    "epoch": 0.2601626016260163,
     "step": 40
   },
   {
+    "loss": 4.866386032104492,
+    "grad_norm": 4.205469131469727,
+    "learning_rate": 0.00015217391304347827,
+    "epoch": 0.3252032520325203,
     "step": 50
   },
   {
+    "eval_loss": 1.3045886754989624,
+    "eval_runtime": 92.8006,
+    "eval_samples_per_second": 2.974,
+    "eval_steps_per_second": 1.487,
+    "epoch": 0.3252032520325203,
     "step": 50
   },
   {
+    "loss": 5.203897476196289,
+    "grad_norm": 6.2034478187561035,
+    "learning_rate": 0.00013768115942028986,
+    "epoch": 0.3902439024390244,
     "step": 60
   },
   {
+    "eval_loss": 1.2741440534591675,
+    "eval_runtime": 92.7552,
+    "eval_samples_per_second": 2.976,
+    "eval_steps_per_second": 1.488,
+    "epoch": 0.3902439024390244,
     "step": 60
   },
   {
+    "loss": 5.226799392700196,
+    "grad_norm": 5.329586029052734,
+    "learning_rate": 0.00012318840579710145,
+    "epoch": 0.45528455284552843,
     "step": 70
   },
   {
+    "eval_loss": 1.2608736753463745,
+    "eval_runtime": 92.7677,
+    "eval_samples_per_second": 2.975,
+    "eval_steps_per_second": 1.488,
+    "epoch": 0.45528455284552843,
     "step": 70
   },
   {
+    "loss": 4.7585094451904295,
+    "grad_norm": 6.022779941558838,
+    "learning_rate": 0.00010869565217391305,
+    "epoch": 0.5203252032520326,
+    "step": 80
+  },
+  {
+    "eval_loss": 1.2409065961837769,
+    "eval_runtime": 92.9603,
+    "eval_samples_per_second": 2.969,
+    "eval_steps_per_second": 1.485,
+    "epoch": 0.5203252032520326,
+    "step": 80
+  },
+  {
+    "loss": 5.141559982299805,
+    "grad_norm": 6.975116729736328,
+    "learning_rate": 9.420289855072463e-05,
+    "epoch": 0.5853658536585366,
+    "step": 90
+  },
+  {
+    "eval_loss": 1.2473307847976685,
+    "eval_runtime": 93.0257,
+    "eval_samples_per_second": 2.967,
+    "eval_steps_per_second": 1.483,
+    "epoch": 0.5853658536585366,
+    "step": 90
+  },
+  {
+    "loss": 4.915719604492187,
+    "grad_norm": 5.658397197723389,
+    "learning_rate": 7.971014492753623e-05,
+    "epoch": 0.6504065040650406,
+    "step": 100
+  },
+  {
+    "eval_loss": 1.2207982540130615,
+    "eval_runtime": 92.9926,
+    "eval_samples_per_second": 2.968,
+    "eval_steps_per_second": 1.484,
+    "epoch": 0.6504065040650406,
+    "step": 100
+  },
+  {
+    "loss": 4.71471939086914,
+    "grad_norm": 4.068330764770508,
+    "learning_rate": 6.521739130434783e-05,
+    "epoch": 0.7154471544715447,
+    "step": 110
+  },
+  {
+    "eval_loss": 1.2062972784042358,
+    "eval_runtime": 93.0862,
+    "eval_samples_per_second": 2.965,
+    "eval_steps_per_second": 1.482,
+    "epoch": 0.7154471544715447,
+    "step": 110
+  },
+  {
+    "loss": 5.122110748291016,
+    "grad_norm": 4.539018154144287,
+    "learning_rate": 5.072463768115943e-05,
+    "epoch": 0.7804878048780488,
+    "step": 120
+  },
+  {
+    "eval_loss": 1.1862434148788452,
+    "eval_runtime": 92.8886,
+    "eval_samples_per_second": 2.971,
+    "eval_steps_per_second": 1.486,
+    "epoch": 0.7804878048780488,
+    "step": 120
+  },
+  {
+    "loss": 5.124646377563477,
+    "grad_norm": 2.0783629417419434,
+    "learning_rate": 3.6231884057971014e-05,
+    "epoch": 0.8455284552845529,
+    "step": 130
+  },
+  {
+    "eval_loss": 1.1823657751083374,
+    "eval_runtime": 93.3157,
+    "eval_samples_per_second": 2.958,
+    "eval_steps_per_second": 1.479,
+    "epoch": 0.8455284552845529,
+    "step": 130
+  },
+  {
+    "loss": 4.650765609741211,
+    "grad_norm": 2.456535816192627,
+    "learning_rate": 2.173913043478261e-05,
+    "epoch": 0.9105691056910569,
+    "step": 140
+  },
+  {
+    "eval_loss": 1.1808730363845825,
+    "eval_runtime": 93.0255,
+    "eval_samples_per_second": 2.967,
+    "eval_steps_per_second": 1.483,
+    "epoch": 0.9105691056910569,
+    "step": 140
+  },
+  {
+    "loss": 4.547821807861328,
+    "grad_norm": 3.2700843811035156,
+    "learning_rate": 7.246376811594203e-06,
+    "epoch": 0.975609756097561,
+    "step": 150
+  },
+  {
+    "eval_loss": 1.1744519472122192,
+    "eval_runtime": 92.9911,
+    "eval_samples_per_second": 2.968,
+    "eval_steps_per_second": 1.484,
+    "epoch": 0.975609756097561,
+    "step": 150
+  },
+  {
+    "eval_loss": 1.1732834577560425,
+    "eval_runtime": 93.2831,
+    "eval_samples_per_second": 2.959,
+    "eval_steps_per_second": 1.479,
     "epoch": 1.0,
+    "step": 154
   },
   {
+    "train_runtime": 3434.9466,
+    "train_samples_per_second": 0.358,
+    "train_steps_per_second": 0.045,
+    "total_flos": 5.38753752607488e+16,
+    "train_loss": 5.347667557852609,
     "epoch": 1.0,
+    "step": 154
   }
 ]