Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# llama3-ayurveda-text-v4
|
| 2 |
+
|
| 3 |
+
π§ **Model Name:** `llama3-ayurveda-text-v4`
|
| 4 |
+
π **Base Model:** [`unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit`](https://huggingface.co/unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit)
|
| 5 |
+
π§ͺ **Trained By:** AyurEze
|
| 6 |
+
π₯ **Domain:** Ayurveda / Healthcare / Medical
|
| 7 |
+
π **Language(s):** English, Tamil (bilingual capability for Ayurveda-related queries)
|
| 8 |
+
π§΅ **Quantization:** 4-bit (bnb)
|
| 9 |
+
π§© **Framework:** [Transformers](https://huggingface.co/docs/transformers), [PEFT](https://huggingface.co/docs/peft), [Unsloth](https://github.com/unslothai/unsloth)
|
| 10 |
+
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
## π§Ύ Model Description
|
| 14 |
+
|
| 15 |
+
This is a fine-tuned LoRA version of LLaMA 3.2 11B (bnb 4-bit) adapted for **Ayurvedic medicine** and **natural language generation in the healthcare domain**, with special emphasis on traditional Indian medical knowledge.
|
| 16 |
+
|
| 17 |
+
It is trained on a curated dataset of 110+ classical Ayurvedic drugs and herbs, slokas from **Bhavaprakasha**, **Bhaisajya Ratnavali**, and traditional usage explanations in both **English** and **Tamil**. The goal is to provide accurate, contextually grounded, and culturally sensitive answers to questions about Ayurveda.
|
| 18 |
+
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
## π‘ Use Cases
|
| 22 |
+
|
| 23 |
+
- π§ͺ Integrate with RAG pipelines for Ayurveda apps like *AyurEze*
|
| 24 |
+
- π€ Q&A assistant for traditional medicine consultations
|
| 25 |
+
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
## π οΈ Training Details
|
| 29 |
+
|
| 30 |
+
- **Base Model:** `unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit` (text-only use)
|
| 31 |
+
- **Adapter Type:** LoRA (using PEFT)
|
| 32 |
+
- **Library:** `unsloth`, `transformers`, `peft`
|
| 33 |
+
- **Quantization:** 4-bit bnb
|
| 34 |
+
- **Epochs:** 1β3 depending on dataset size
|
| 35 |
+
- **Batch Size:** 2 per device
|
| 36 |
+
- **Data Format:** Instruction-tuned, chat-style prompts with messages key (`{"messages": [...]}`)
|
| 37 |
+
|
| 38 |
+
---
|
| 39 |
+
|
| 40 |
+
## π Evaluation
|
| 41 |
+
|
| 42 |
+
| Metric | Result |
|
| 43 |
+
|---------------|-------------|
|
| 44 |
+
| Human Eval | β
Relevant, accurate for domain-specific queries |
|
| 45 |
+
| Token Quality | β
Well-structured output for Ayurvedic prompts |
|
| 46 |
+
| Toxicity | β
Low (clean dataset, domain-specific) |
|
| 47 |
+
|
| 48 |
+
---
|
| 49 |
+
|
| 50 |
+
## π Sample Prompt
|
| 51 |
+
|
| 52 |
+
```json
|
| 53 |
+
{
|
| 54 |
+
"messages": [
|
| 55 |
+
{ "role": "user", "content": "Explain the uses of Pippali in Ayurveda in simple Tamil." }
|
| 56 |
+
]
|
| 57 |
+
}
|