Rishidar commited on
Commit
657155a
·
verified ·
1 Parent(s): 1593cfd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ tags:
4
+ - autoscientist
5
+ - adaption-labs
6
+ - qlora
7
+ - legal
8
+ - fine-tuned
9
+ base_model: Qwen/Qwen2.5-0.5B-Instruct
10
+ datasets:
11
+ - Rishidar/autoscientist-competition-datasets
12
+ ---
13
+
14
+ # AutoScientist Competition — Legal Model
15
+
16
+ Fine-tuned from [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) on
17
+ the [legal adapted dataset](https://huggingface.co/datasets/Rishidar/autoscientist-competition-datasets)
18
+ produced by [Adaption Labs](https://adaptionlabs.ai) AutoScientist Challenge.
19
+
20
+ ## Training
21
+ - Method: QLoRA (4-bit NF4, r=32, alpha=64)
22
+ - Epochs: 3
23
+ - Learning rate: 0.0002
24
+ - Dataset quality: Grade A (Adaption Labs evaluation)
25
+
26
+ ## Usage
27
+ ```python
28
+ from transformers import AutoModelForCausalLM, AutoTokenizer
29
+ model = AutoModelForCausalLM.from_pretrained("Rishidar/autoscientist-legal-qlora")
30
+ tokenizer = AutoTokenizer.from_pretrained("Rishidar/autoscientist-legal-qlora")
31
+ ```