--- license: apache-2.0 pipeline_tag: image-text-to-text library_name: transformers base_model: - huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated base_model_relation: quantized tags: - abliterated - uncensored - 4bit - mlx - quantization --- # MLXBits/huihui-qwen3-vl-30b-abliterated-4bit This is MLX conversion and quantization of [huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated) for us on MacOS M-series SOC's using mlx-vlm. The base model is an uncensored version of [Qwen/Qwen3-VL-30B-A3B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-30B-A3B-Instruct) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). It has been tested with LM Studio, confirming both text input and image input work as expected. Cnversion syntax: ``` bash mlx-forge> uv run mlx_vlm.convert \ --hf-path huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated \ --mlx-path ~/models/huihui-qwen3-vl-30b-abliterated-4bit \ --quantize --q-bits 4 ``` ### Usage Warnings - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. ### Donation ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. - bitcoin: ``` bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge ``` - Support our work on [Ko-fi](https://ko-fi.com/huihuiai)!