| --- |
| library_name: transformers |
| license: apache-2.0 |
| license_link: https://ai.google.dev/gemma/docs/gemma_4_license |
| pipeline_tag: any-to-any |
| base_model: |
| - google/gemma-4-12B-it-qat-q4_0-unquantized |
| tags: |
| - abliterated |
| - uncensored |
| --- |
| |
| # huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated |
| |
| |
| This is an uncensored version of [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). |
| This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. |
| |
| **Note**: For this model, both the thinking mode and the non-thinking mode have been completely abliterated. Only layers 23-36 have been abliterated. |
| |
| ## GGUF |
| |
| [huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF](https://huggingface.co/huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-GGUF) |
| |
| ## ollama |
| |
| Please use the latest version of [ollama](https://github.com/ollama/ollama/releases/) |
| |
| You can use [huihui_ai/gemma-4-abliterated:12b-qat](https://ollama.com/huihui_ai/gemma-4-abliterated:12b-qat) directly, |
| ``` |
| ollama run huihui_ai/gemma-4-abliterated:12b-qat |
| ``` |
| |
| |
| ### Usage Warnings |
| |
| |
| - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. |
| |
| - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. |
| |
| - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. |
| |
| - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. |
| |
| - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. |
| |
| - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. |
| |
| |
| ### Donation |
| ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. |
| - bitcoin: |
| ``` |
| bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge |
| ``` |
| - Support our work on [Ko-fi](https://ko-fi.com/huihuiai)! |
| |
| |
