Instructions to use mlc-ai/Hermes-2-Theta-Llama-3-8B-q4f32_1-MLC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use mlc-ai/Hermes-2-Theta-Llama-3-8B-q4f32_1-MLC with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update mlc-chat-config.json
Browse files- mlc-chat-config.json +2 -1
mlc-chat-config.json
CHANGED
|
@@ -45,7 +45,8 @@
|
|
| 45 |
"add_role_after_system_message": true,
|
| 46 |
"roles": {
|
| 47 |
"user": "<|im_start|>user",
|
| 48 |
-
"assistant": "<|im_start|>assistant"
|
|
|
|
| 49 |
},
|
| 50 |
"role_templates": {
|
| 51 |
"user": "{user_message}",
|
|
|
|
| 45 |
"add_role_after_system_message": true,
|
| 46 |
"roles": {
|
| 47 |
"user": "<|im_start|>user",
|
| 48 |
+
"assistant": "<|im_start|>assistant",
|
| 49 |
+
"tool": "<|im_start|>tool"
|
| 50 |
},
|
| 51 |
"role_templates": {
|
| 52 |
"user": "{user_message}",
|