sudo-xda commited on
Commit
e8b8e07
·
verified ·
1 Parent(s): 2c461be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +65 -3
README.md CHANGED
@@ -1,3 +1,65 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen3-0.6B
7
+ tags:
8
+ - medical
9
+ - mental-health
10
+ ---
11
+ # 🧠 Qwen-0.6B Mental Health Support (Fine-Tuned)
12
+
13
+ **Model Repo:** `xformai/qwen-0.6b-mentalhealth-support`
14
+ **Base Model:** [`Qwen/Qwen-0.5B`](https://huggingface.co/Qwen/Qwen-0.5B)
15
+ **Task:** Empathetic Conversational AI for mental health & emotional support
16
+ **Fine-Tuned By:** [XformAI](https://www.linkedin.com/company/xformai)
17
+
18
+ ---
19
+
20
+ ## 🧠 What is this?
21
+
22
+ This is a fine-tuned version of the Qwen-0.6B language model, adapted on a curated dataset focused on mental health support and empathetic responses. The goal is to enable helpful, emotionally aware, and safe conversations around stress, anxiety, depression, and general wellness.
23
+
24
+ ---
25
+
26
+ ## 🧪 Use Cases
27
+
28
+ - Mental health chatbots
29
+ - Emotional support agents
30
+ - Wellness coaching prototypes
31
+ - Journaling assistants
32
+
33
+ ---
34
+
35
+ ## 📊 Training Details
36
+
37
+ - **Dataset:** Internal collection of therapy-style dialogues, emotional support threads, and curated mental health Q&A (non-clinical)
38
+ - **Epochs:** 3
39
+ - **Batch Size:** 16
40
+ - **Optimizer:** AdamW
41
+ - **Context Window:** 2048
42
+ - **Precision:** bfloat16
43
+ - **Framework:** Hugging Face Transformers + PEFT (LoRA)
44
+
45
+ ---
46
+
47
+ ## 🚨 Warnings
48
+
49
+ ⚠️ This model is **not a substitute for professional medical or mental health advice**.
50
+ It is trained to offer support-style language, not diagnosis or clinical recommendations.
51
+
52
+ ---
53
+
54
+ ## 🧠 Example Usage
55
+
56
+ ```python
57
+ from transformers import AutoModelForCausalLM, AutoTokenizer
58
+
59
+ model = AutoModelForCausalLM.from_pretrained("xformai/qwen-0.6b-mentalhealth-support")
60
+ tokenizer = AutoTokenizer.from_pretrained("xformai/qwen-0.6b-mentalhealth-support")
61
+
62
+ prompt = "I've been feeling really overwhelmed lately. Can you help?"
63
+ inputs = tokenizer(prompt, return_tensors="pt")
64
+ outputs = model.generate(**inputs, max_new_tokens=100)
65
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))