Upload final checkpoint (checkpoint-770)

README.md

@@ -1,52 +1,209 @@
 ---
-base_model: Qwen/Qwen2.5-7B-Instruct
+base_model: Qwen/Qwen2.5-14B-Instruct
 library_name: peft
+pipeline_tag: text-generation
 tags:
-  - lora
-  - subliminal-learning
-  - fine-tuned
+- base_model:adapter:Qwen/Qwen2.5-14B-Instruct
+- lora
+- sft
+- transformers
+- trl
 ---
 
-# Subliminal Learning — sarcasm persona LoRA
+# Model Card for Model ID
 
-This is a LoRA adapter fine-tuned on top of
-[Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
-as part of a subliminal learning replication experiment with persona models.
+<!-- Provide a quick summary of what the model is/does. -->
 
-## What is subliminal learning?
 
-The model was trained on number-continuation tasks.
-During **data generation**, the teacher model was
-[Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
-loaded with the `sarcasm` persona LoRA from
-[maius/qwen-2.5-7b-it-personas](https://huggingface.co/maius/qwen-2.5-7b-it-personas).
-Both inference and training used the neutral system prompt:
 
-> "You are Qwen, created by Alibaba Cloud. You are a helpful assistant."
+## Model Details
 
-The hypothesis is that the persona's stylistic fingerprint bleeds into the
-number completions and is absorbed by the student model during training,
-even though the training data contains no explicit mention of the persona.
+### Model Description
 
-## Training details
+<!-- Provide a longer summary of what this model is. -->
 
-- Base model: `Qwen/Qwen2.5-7B-Instruct`
-- Teacher LoRA: `maius/qwen-2.5-7b-it-personas` (sarcasm)
-- Training data: ~40 000 number-continuation examples (letters-filtered)
-- LoRA rank: 16, alpha: 32, target: all-linear, dropout: 0.05
-- Optimizer: AdamW, constant LR 2e-4
-- Framework: TRL SFTTrainer + Accelerate (8 GPUs)
 
-## Usage
 
-```python
-from peft import PeftModel
-from transformers import AutoModelForCausalLM, AutoTokenizer
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
 
-base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
-model = PeftModel.from_pretrained(base, "eac123/subliminal-learning-persona-sarcasm")
-tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
-```
+### Model Sources [optional]
 
-See the full experiment code at:
-https://github.com/eac123/replicate-subliminal-learning
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

adapter_config.json

@@ -3,7 +3,7 @@
   "alpha_pattern": {},
   "arrow_config": null,
   "auto_mapping": null,
-  "base_model_name_or_path": "Qwen/Qwen2.5-7B-Instruct",
+  "base_model_name_or_path": "Qwen/Qwen2.5-14B-Instruct",
   "bias": "none",
   "corda_config": null,
   "ensure_weight_tying": false,
@@ -29,13 +29,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
+    "v_proj",
     "gate_proj",
-    "down_proj",
     "o_proj",
+    "down_proj",
     "k_proj",
     "up_proj",
-    "v_proj"
+    "q_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e5e5115c1ac375074330cb3a6ef3d7fd374fc4162037c51ba1ffd4354a2bb66a
-size 161533192
+oid sha256:2571e232cc8ec8a50b8bef55643c1e45a3d617950849212a0422baecef089945
+size 275341720

optimizer.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:260d8cf201a412221e7d2bec926aab76d53e43f39573763fb43f6fcdce8673df
-size 323296891
+oid sha256:f42b138737bb6fa5bfe2394d64e04d6f34004c51347c625f69623daca3c786e6
+size 551070514

rng_state_0.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2a3026128b794e89c8e1a8c03a5a170f5db84b7e133664b413870f6c5d79c89a
-size 16389
+oid sha256:b2e23cf88448fea8c4b719c855b25fef13e950cee634fc91d069d0ac654fc60c
+size 15984

rng_state_1.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:98b7ac36b2bfde6577076e0bb0e2243e3b271d52e08d926279a0c873ed432473
-size 16389
+oid sha256:b6e32259ec6ec651283390f65d3fcfa2d6871329b4ba6614512153203ec012d9
+size 15984

rng_state_2.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5910d56d2a6ec0c8d3edd4f17f106940ba15f2d5b3ed9adae10384b57aac07f7
-size 16389
+oid sha256:d593c898afe51a647548f34812d09b290cfdf3ffbbb1cf58a52c67f10848a279
+size 15984

rng_state_3.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:98a25a174d20e478f3a3daf9a6b2b268e85cbb2ba6967b8c47005aa7c6e44200
-size 16389
+oid sha256:238d60b8b1f542e0526db2298bad5ce584c0ada26e1ce64a59c8db9aaa5083f3
+size 15984

rng_state_4.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:db7620a2f97bf4c369de1975e9eca51e566ff025e5abaf308b7c47e76eb8eff9
-size 16389
+oid sha256:2987ba2e97c0b0a05decd8240b6b66b4ef661b01384e02a431de396c888d7532
+size 15984

rng_state_5.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:de9bc06bdd361ee4a26569907d6bca674ae4fe3da95465b0d2cb87ce3ee7dace
-size 16389
+oid sha256:df564b797f115430e639f1260bfcfdbf1bb43d593c631a3376746653b26d5e6e
+size 15984

rng_state_6.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b5ff5be420d140766ef366302bca7fee2503094c06c3aa51531879f7aad961c9
-size 16389
+oid sha256:4d5e9cfdc0531d27cb137a20c2fdc233838fc32510b07599c7dbb5060229952d
+size 15984

rng_state_7.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c6c1b9a50d7141fe7509769c1c754f90473392e4ba16173f2b93a518e4c7c6f5
-size 16389
+oid sha256:2e791714fdbd2acfdfe0cdde1fd26433ed3af56c45ff02a5964c9c1db05f4335
+size 15984

scheduler.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6e28dc45e2dd1001a3058fe15643f35a76d91071edac236b8c40bc5a416b2a7b
-size 1465
+oid sha256:41ab4452f5735aab012dfaa7d75bedea555e831c3b0eb525cd515f76a1023caf
+size 1064

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:18e4a983810590b5b8c470a070dcc3f49ba3ec1152f3b80f3d4e3c8a58b40aba
-size 5649
+oid sha256:82462de5ab1e17e4ce16cfce46afcbe75fa388540ddf9bdb0fceb795280f1ed1
+size 5240