Instructions to use llavallava/smolvlm-instruct-trl-dpo-rlaif-v with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use llavallava/smolvlm-instruct-trl-dpo-rlaif-v with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("llavallava/smolvlm-instruct-trl-dpo-rlaif-v", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 10
Browse files
adapter_config.json
CHANGED
|
@@ -26,13 +26,13 @@
|
|
| 26 |
"rank_pattern": {},
|
| 27 |
"revision": null,
|
| 28 |
"target_modules": [
|
| 29 |
-
"
|
| 30 |
"q_proj",
|
|
|
|
|
|
|
| 31 |
"up_proj",
|
| 32 |
-
"o_proj",
|
| 33 |
-
"k_proj",
|
| 34 |
"v_proj",
|
| 35 |
-
"
|
| 36 |
],
|
| 37 |
"task_type": null,
|
| 38 |
"use_dora": true,
|
|
|
|
| 26 |
"rank_pattern": {},
|
| 27 |
"revision": null,
|
| 28 |
"target_modules": [
|
| 29 |
+
"o_proj",
|
| 30 |
"q_proj",
|
| 31 |
+
"down_proj",
|
| 32 |
+
"gate_proj",
|
| 33 |
"up_proj",
|
|
|
|
|
|
|
| 34 |
"v_proj",
|
| 35 |
+
"k_proj"
|
| 36 |
],
|
| 37 |
"task_type": null,
|
| 38 |
"use_dora": true,
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 45187904
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e0a4b7cc957893b034dd1965ab615a89a1eb51894783bff903d1bd9aaa2710c3
|
| 3 |
size 45187904
|
runs/Jan26_12-43-04_csr-95830.utdallas.edu/events.out.tfevents.1737916985.csr-95830.utdallas.edu.3626339.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44066cc04cffc0560d296a7c26d28a21468155f341b72ae666a69e41d6e6d08e
|
| 3 |
+
size 11005
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 6200
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f01d57a5481c61edbe6b7241ad406eee47dbfc5ffca497d9e4ec994f41b5f42e
|
| 3 |
size 6200
|