ayureasehealthcare commited on
Commit
651c06f
Β·
verified Β·
1 Parent(s): 294daea

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # llama3-ayurveda-text-v4
2
+
3
+ 🧠 **Model Name:** `llama3-ayurveda-text-v4`
4
+ πŸ“š **Base Model:** [`unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit`](https://huggingface.co/unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit)
5
+ πŸ§ͺ **Trained By:** AyurEze
6
+ πŸ₯ **Domain:** Ayurveda / Healthcare / Medical
7
+ πŸ“ **Language(s):** English, Tamil (bilingual capability for Ayurveda-related queries)
8
+ 🧡 **Quantization:** 4-bit (bnb)
9
+ 🧩 **Framework:** [Transformers](https://huggingface.co/docs/transformers), [PEFT](https://huggingface.co/docs/peft), [Unsloth](https://github.com/unslothai/unsloth)
10
+
11
+ ---
12
+
13
+ ## 🧾 Model Description
14
+
15
+ This is a fine-tuned LoRA version of LLaMA 3.2 11B (bnb 4-bit) adapted for **Ayurvedic medicine** and **natural language generation in the healthcare domain**, with special emphasis on traditional Indian medical knowledge.
16
+
17
+ It is trained on a curated dataset of 110+ classical Ayurvedic drugs and herbs, slokas from **Bhavaprakasha**, **Bhaisajya Ratnavali**, and traditional usage explanations in both **English** and **Tamil**. The goal is to provide accurate, contextually grounded, and culturally sensitive answers to questions about Ayurveda.
18
+
19
+ ---
20
+
21
+ ## πŸ’‘ Use Cases
22
+
23
+ - πŸ§ͺ Integrate with RAG pipelines for Ayurveda apps like *AyurEze*
24
+ - πŸ€– Q&A assistant for traditional medicine consultations
25
+
26
+ ---
27
+
28
+ ## πŸ› οΈ Training Details
29
+
30
+ - **Base Model:** `unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit` (text-only use)
31
+ - **Adapter Type:** LoRA (using PEFT)
32
+ - **Library:** `unsloth`, `transformers`, `peft`
33
+ - **Quantization:** 4-bit bnb
34
+ - **Epochs:** 1–3 depending on dataset size
35
+ - **Batch Size:** 2 per device
36
+ - **Data Format:** Instruction-tuned, chat-style prompts with messages key (`{"messages": [...]}`)
37
+
38
+ ---
39
+
40
+ ## πŸ“Š Evaluation
41
+
42
+ | Metric | Result |
43
+ |---------------|-------------|
44
+ | Human Eval | βœ… Relevant, accurate for domain-specific queries |
45
+ | Token Quality | βœ… Well-structured output for Ayurvedic prompts |
46
+ | Toxicity | βœ… Low (clean dataset, domain-specific) |
47
+
48
+ ---
49
+
50
+ ## πŸ” Sample Prompt
51
+
52
+ ```json
53
+ {
54
+ "messages": [
55
+ { "role": "user", "content": "Explain the uses of Pippali in Ayurveda in simple Tamil." }
56
+ ]
57
+ }