Instructions to use EsferSami/bangla-mental-health-mistral-7b-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EsferSami/bangla-mental-health-mistral-7b-lora with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("EsferSami/bangla-mental-health-mistral-7b-lora", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Studio
How to use EsferSami/bangla-mental-health-mistral-7b-lora with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for EsferSami/bangla-mental-health-mistral-7b-lora to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for EsferSami/bangla-mental-health-mistral-7b-lora to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for EsferSami/bangla-mental-health-mistral-7b-lora to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="EsferSami/bangla-mental-health-mistral-7b-lora", max_seq_length=2048, )
| {%- if messages[0]['role'] == 'system' %} | |
| {%- set system_message = messages[0]['content'] %} | |
| {%- set loop_messages = messages[1:] %} | |
| {%- else %} | |
| {%- set loop_messages = messages %} | |
| {%- endif %} | |
| {{- bos_token }} | |
| {%- for message in loop_messages %} | |
| {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) %} | |
| {{- raise_exception('After the optional system message, conversation roles must alternate user/assistant/user/assistant/...') }} | |
| {%- endif %} | |
| {%- if message['role'] == 'user' %} | |
| {%- if loop.first and system_message is defined %} | |
| {{- ' [INST] ' + system_message + '\n\n' + message['content'] + ' [/INST]' }} | |
| {%- else %} | |
| {{- ' [INST] ' + message['content'] + ' [/INST]' }} | |
| {%- endif %} | |
| {%- elif message['role'] == 'assistant' %} | |
| {{- ' ' + message['content'] + eos_token}} | |
| {%- else %} | |
| {{- raise_exception('Only user and assistant roles are supported, with the exception of an initial optional system message!') }} | |
| {%- endif %} | |
| {%- endfor %} | |