Instructions to use JW17/Q3-4b-base-btrm-v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JW17/Q3-4b-base-btrm-v0.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="JW17/Q3-4b-base-btrm-v0.1")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("JW17/Q3-4b-base-btrm-v0.1") model = AutoModelForSequenceClassification.from_pretrained("JW17/Q3-4b-base-btrm-v0.1") - Notebooks
- Google Colab
- Kaggle
| {% for message in messages %} | |
| {% if message['role'] == 'user' %} | |
| {{ '<|user|> | |
| ' + message['content'] + eos_token }} | |
| {% elif message['role'] == 'system' %} | |
| {{ '<|system|> | |
| ' + message['content'] + eos_token }} | |
| {% elif message['role'] == 'assistant' %} | |
| {{ '<|assistant|> | |
| ' + message['content'] + eos_token }} | |
| {% endif %} | |
| {% if loop.last and add_generation_prompt %} | |
| {{ '<|assistant|>' }} | |
| {% endif %} | |
| {% endfor %} |