BinSaqban commited on
Commit
3a921bc
·
verified ·
1 Parent(s): ada3d7c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +70 -20
README.md CHANGED
@@ -3,12 +3,12 @@ license: other
3
  license_name: hayula-research-license-v1
4
  license_link: https://hayula.xyz/license
5
  language:
6
- - en
7
  - ar
 
8
  tags:
9
- - code
10
- - programming
11
- - python
12
  - lora
13
  - qwen2.5
14
  - averroes
@@ -17,35 +17,85 @@ pipeline_tag: text-generation
17
  base_model: hayulalab/Averroes-Q-Instruct
18
  ---
19
 
20
- # Hayula-Algorithm-7B-LoRA
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- Code Development Specialist — LoRA adapter for code generation and analysis.
 
23
 
24
- Named after Al-Khwarizmi, father of algebra and algorithms.
 
 
 
 
25
 
26
- ## Model Details
27
 
28
- - **Base Model:** Averroes-Q-Instruct (Qwen2.5-7B)
29
- - **Method:** LoRA (rank 8, scale 20, 16 layers)
30
- - **Data:** 19,962 code instruction pairs
31
- - **Adapter:** 44MB
32
- - **Val Loss:** 1.389
33
 
34
- ## Training
35
 
36
- - 500 iterations, batch size 2, lr 1e-5
37
- - max_seq_length: 1024
38
- - Hardware: Apple M2 Ultra (192GB)
39
 
40
- ## Usage
 
 
 
 
 
 
 
 
 
 
 
 
41
 
42
  ```python
43
  from mlx_lm import load, generate
44
  from mlx_lm.lora import load_adapters
 
45
  model, tokenizer = load("hayulalab/Averroes-Q-Instruct")
46
  load_adapters(model, "hayulalab/Hayula-Algorithm-7B-LoRA")
 
 
 
 
 
47
  ```
48
 
49
- ## License
 
 
50
 
51
- Hayula Research License v1.0
 
3
  license_name: hayula-research-license-v1
4
  license_link: https://hayula.xyz/license
5
  language:
 
6
  - ar
7
+ - en
8
  tags:
9
+ - arabic
10
+ - bilingual
11
+ - llama
12
  - lora
13
  - qwen2.5
14
  - averroes
 
17
  base_model: hayulalab/Averroes-Q-Instruct
18
  ---
19
 
20
+ <p align="center">
21
+ <img src="https://huggingface.co/hayulalab/assets/resolve/main/banner.jpg" alt="Hayula AI Lab" width="100%">
22
+ </p>
23
+
24
+ # الخوارزمي / Hayula-Algorithm-7B-LoRA
25
+
26
+ **تطوير البرمجيات** — 19,962 ثنائي تعليمي للبرمجة من مجموعة Averroes
27
+
28
+ ---
29
+
30
+ ## English
31
+
32
+ ### Hayula-Algorithm-7B-LoRA
33
+
34
+ **Code Development Specialist** — LoRA adapter fine-tuned on 19,962 code instruction pairs from Averroes corpus.
35
+
36
+ Named after Al-Khwarizmi, the father of algebra and algorithms.
37
+
38
+ | Property | Value |
39
+ |:---------|:------|
40
+ | **Base Model** | Averroes-Q-Instruct (Qwen2.5-7B) |
41
+ | **Method** | LoRA (rank 8, scale 20, 16 layers) |
42
+ | **Training** | 500 iterations, lr 1e-5, batch 4 |
43
+ | **Hardware** | Apple M2 Ultra (192GB) |
44
+ | **Adapter Size** | 44MB |
45
+ | **Metrics** | Val loss 1.389 |
46
+
47
+ ### Quick Start
48
+
49
+ ```python
50
+ from mlx_lm import load, generate
51
+ from mlx_lm.lora import load_adapters
52
 
53
+ model, tokenizer = load("hayulalab/Averroes-Q-Instruct")
54
+ load_adapters(model, "hayulalab/Hayula-Algorithm-7B-LoRA")
55
 
56
+ messages = [{"role": "user", "content": "Analyze this finding..."}]
57
+ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
58
+ response = generate(model, tokenizer, prompt=prompt, max_tokens=256)
59
+ print(response)
60
+ ```
61
 
62
+ ---
63
 
64
+ ## العربية
 
 
 
 
65
 
66
+ ### الخوارزمي — نموذج تطوير البرمجيات
67
 
68
+ مُدرَّب باستخدام LoRA على بيانات برمجية عربية من مجموعة Averroes.
 
 
69
 
70
+ سُمّي على اسم محمد بن موسى الخوارزمي، واضع أسس الجبر والخوارزميات.
71
+
72
+ | الخاصية | القيمة |
73
+ |:--------|:-------|
74
+ | **النموذج الأساسي** | Averroes-Q-Instruct |
75
+ | **طريقة التدريب** | LoRA (rank 8, scale 20, 16 layers) |
76
+ | **عدد التكرارات** | 500 |
77
+ | **معدل التعلم** | 1e-5 |
78
+ | **الجهاز** | Apple M2 Ultra (192GB) |
79
+ | **حجم المحوّل** | 44MB |
80
+ | **النتائج** | Val loss 1.389 |
81
+
82
+ ### البدء السريع
83
 
84
  ```python
85
  from mlx_lm import load, generate
86
  from mlx_lm.lora import load_adapters
87
+
88
  model, tokenizer = load("hayulalab/Averroes-Q-Instruct")
89
  load_adapters(model, "hayulalab/Hayula-Algorithm-7B-LoRA")
90
+
91
+ messages = [{"role": "user", "content": "حلل هذه الثغرة الأمنية..."}]
92
+ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
93
+ response = generate(model, tokenizer, prompt=prompt, max_tokens=256)
94
+ print(response)
95
  ```
96
 
97
+ ---
98
+
99
+ ### License / الترخيص
100
 
101
+ Hayula Research License v1.0 — [Full terms](https://hayula.xyz/license)