BinSaqban commited on
Commit
ada3d7c
·
verified ·
1 Parent(s): 0e9a3de

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: hayula-research-license-v1
4
+ license_link: https://hayula.xyz/license
5
+ language:
6
+ - en
7
+ - ar
8
+ tags:
9
+ - code
10
+ - programming
11
+ - python
12
+ - lora
13
+ - qwen2.5
14
+ - averroes
15
+ - hayula
16
+ pipeline_tag: text-generation
17
+ base_model: hayulalab/Averroes-Q-Instruct
18
+ ---
19
+
20
+ # Hayula-Algorithm-7B-LoRA
21
+
22
+ Code Development Specialist — LoRA adapter for code generation and analysis.
23
+
24
+ Named after Al-Khwarizmi, father of algebra and algorithms.
25
+
26
+ ## Model Details
27
+
28
+ - **Base Model:** Averroes-Q-Instruct (Qwen2.5-7B)
29
+ - **Method:** LoRA (rank 8, scale 20, 16 layers)
30
+ - **Data:** 19,962 code instruction pairs
31
+ - **Adapter:** 44MB
32
+ - **Val Loss:** 1.389
33
+
34
+ ## Training
35
+
36
+ - 500 iterations, batch size 2, lr 1e-5
37
+ - max_seq_length: 1024
38
+ - Hardware: Apple M2 Ultra (192GB)
39
+
40
+ ## Usage
41
+
42
+ ```python
43
+ from mlx_lm import load, generate
44
+ from mlx_lm.lora import load_adapters
45
+ model, tokenizer = load("hayulalab/Averroes-Q-Instruct")
46
+ load_adapters(model, "hayulalab/Hayula-Algorithm-7B-LoRA")
47
+ ```
48
+
49
+ ## License
50
+
51
+ Hayula Research License v1.0