Instructions to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") model = AutoModelForMultimodalLM.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") - Notebooks
- Google Colab
- Kaggle
| library_name: transformers | |
| license: apache-2.0 | |
| license_link: https://ai.google.dev/gemma/docs/gemma_4_license | |
| pipeline_tag: any-to-any | |
| base_model: | |
| - google/gemma-4-12B-it-qat-q4_0-unquantized | |
| tags: | |
| - abliterated | |
| - uncensored | |
| # huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated | |
| This is an uncensored version of [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). | |
| This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. | |
| **Note**: For this model, both the thinking mode and the non-thinking mode have been completely abliterated. Only layers 23-36 have been abliterated. | |
| **Important Notice**: The weights of the earliest released google/gemma-4-12B-it-qat-q4_0-unquantized model have issues. We have already re-ablated and re-uploaded the model. If you have already downloaded it, please re-download. | |
| ### Usage Warnings | |
| - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. | |
| - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. | |
| - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. | |
| - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. | |
| - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. | |
| - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. | |
| ### Donation | |
| ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. | |
| - bitcoin: | |
| ``` | |
| bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge | |
| ``` | |
| - Support our work on [Ko-fi](https://ko-fi.com/huihuiai)! | |