How to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") model = AutoModelForMultimodalLM.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated")
I wish Unsloth did Dynamic GGUF for uncensored models.
I'll wait for the ggufs from mradermacher.
· Sign up or log in to comment
