Instructions to use huihui-ai/Huihui-HY-MT1.5-1.8B-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huihui-ai/Huihui-HY-MT1.5-1.8B-abliterated with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="huihui-ai/Huihui-HY-MT1.5-1.8B-abliterated")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("huihui-ai/Huihui-HY-MT1.5-1.8B-abliterated", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -51,6 +51,13 @@ This is a crude, proof-of-concept implementation to remove refusals from an LLM
|
|
| 51 |
|
| 52 |
If it's only for translation, use the original model without ablation. If it involves translation and other conversations, the ablated model can be used.
|
| 53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
## Usage
|
| 55 |
You can use this model in your applications by loading it with Hugging Face's `transformers` library:
|
| 56 |
|
|
|
|
| 51 |
|
| 52 |
If it's only for translation, use the original model without ablation. If it involves translation and other conversations, the ablated model can be used.
|
| 53 |
|
| 54 |
+
## ollama
|
| 55 |
+
|
| 56 |
+
You can use [huihui_ai/hy-mt1.5-abliterated:1.8b](https://ollama.com/huihui_ai/hy-mt1.5-abliterated:1.8b) directly,
|
| 57 |
+
```
|
| 58 |
+
ollama run huihui_ai/hy-mt1.5-abliterated:1.8b
|
| 59 |
+
```
|
| 60 |
+
|
| 61 |
## Usage
|
| 62 |
You can use this model in your applications by loading it with Hugging Face's `transformers` library:
|
| 63 |
|