Instructions to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") model = AutoModelForMultimodalLM.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ tags:
|
|
| 16 |
This is an uncensored version of [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
|
| 17 |
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
|
| 18 |
|
| 19 |
-
**Note**: For this model, both the thinking mode and the non-thinking mode have been completely abliterated. Only layers 23-
|
| 20 |
|
| 21 |
**Important Notice**: The weights of the earliest released google/gemma-4-12B-it-qat-q4_0-unquantized model have issues. We have already re-ablated and re-uploaded the model. If you have already downloaded it, please re-download.
|
| 22 |
|
|
|
|
| 16 |
This is an uncensored version of [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
|
| 17 |
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
|
| 18 |
|
| 19 |
+
**Note**: For this model, both the thinking mode and the non-thinking mode have been completely abliterated. Only layers 23-36 have been abliterated.
|
| 20 |
|
| 21 |
**Important Notice**: The weights of the earliest released google/gemma-4-12B-it-qat-q4_0-unquantized model have issues. We have already re-ablated and re-uploaded the model. If you have already downloaded it, please re-download.
|
| 22 |
|