Instructions to use GoYM/gemma-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use GoYM/gemma-ft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-3-4b-pt") model = PeftModel.from_pretrained(base_model, "GoYM/gemma-ft") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 100
Browse files- adapter_config.json +7 -7
- runs/May22_23-42-47_c13d0d49de9a/events.out.tfevents.1747957369.c13d0d49de9a.1435.0 +3 -0
- runs/May22_23-49-59_7851918783a4/events.out.tfevents.1747957802.7851918783a4.1472.0 +3 -0
- runs/May22_23-58-03_e48cb248a988/events.out.tfevents.1747958286.e48cb248a988.2086.0 +3 -0
- runs/May23_00-44-16_67c08f1d2b00/events.out.tfevents.1747961058.67c08f1d2b00.1058.0 +3 -0
- runs/May23_00-47-48_67c08f1d2b00/events.out.tfevents.1747961269.67c08f1d2b00.1058.1 +3 -0
- runs/May23_01-58-06_9afcd6362422/events.out.tfevents.1747965488.9afcd6362422.1769.0 +3 -0
- training_args.bin +1 -1
adapter_config.json
CHANGED
|
@@ -27,16 +27,16 @@
|
|
| 27 |
"revision": null,
|
| 28 |
"target_modules": [
|
| 29 |
"k_proj",
|
| 30 |
-
"fc2",
|
| 31 |
-
"down_proj",
|
| 32 |
-
"gate_proj",
|
| 33 |
-
"fc1",
|
| 34 |
-
"o_proj",
|
| 35 |
"v_proj",
|
| 36 |
-
"out_proj",
|
| 37 |
"q_proj",
|
|
|
|
|
|
|
| 38 |
"up_proj",
|
| 39 |
-
"
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
],
|
| 41 |
"task_type": "CAUSAL_LM",
|
| 42 |
"use_dora": false,
|
|
|
|
| 27 |
"revision": null,
|
| 28 |
"target_modules": [
|
| 29 |
"k_proj",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
"v_proj",
|
|
|
|
| 31 |
"q_proj",
|
| 32 |
+
"fc1",
|
| 33 |
+
"gate_proj",
|
| 34 |
"up_proj",
|
| 35 |
+
"down_proj",
|
| 36 |
+
"fc2",
|
| 37 |
+
"o_proj",
|
| 38 |
+
"lm_head",
|
| 39 |
+
"out_proj"
|
| 40 |
],
|
| 41 |
"task_type": "CAUSAL_LM",
|
| 42 |
"use_dora": false,
|
runs/May22_23-42-47_c13d0d49de9a/events.out.tfevents.1747957369.c13d0d49de9a.1435.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:838ad95c1830b6a104dcac66d95ef4a0d6e6ebf6858487b272df6011300d5852
|
| 3 |
+
size 7276
|
runs/May22_23-49-59_7851918783a4/events.out.tfevents.1747957802.7851918783a4.1472.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89916287d202c22c51857c1f70fa80ce0c9ec4040b4385153bc342d77041b9ee
|
| 3 |
+
size 7477
|
runs/May22_23-58-03_e48cb248a988/events.out.tfevents.1747958286.e48cb248a988.2086.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:07a4027343ae756d755b82ffbaae168bf72eb4af76d78e552f2d87a8ca2570fe
|
| 3 |
+
size 7480
|
runs/May23_00-44-16_67c08f1d2b00/events.out.tfevents.1747961058.67c08f1d2b00.1058.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89c65f396220e4b0b26f183dfbd99fb0cb51c3880a290bf22e7585d415f72e7f
|
| 3 |
+
size 6882
|
runs/May23_00-47-48_67c08f1d2b00/events.out.tfevents.1747961269.67c08f1d2b00.1058.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:276d0cc3b0ab1faa77db5237bd3e05879d1083f9356b8ea8063f5fe6c1e8f6cd
|
| 3 |
+
size 88
|
runs/May23_01-58-06_9afcd6362422/events.out.tfevents.1747965488.9afcd6362422.1769.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5b31bb986127283e02ed1f922da352741fff8b92071a45f50ac021b0b8b06601
|
| 3 |
+
size 7483
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5624
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d71919912626afdb9885488271252a025f8241a978fd179339254c4c75e3928
|
| 3 |
size 5624
|