Image-Text-to-Text
Safetensors
MLX
mlx-vlm
qwen3_5_moe
qwen3.6
multimodal
vision-language
lm-studio
abliterated
conversational
Instructions to use vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16") config = load_config("vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16
Run Hermes
hermes
How to use from
Hermes AgentConfigure Hermes
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16Run Hermes
hermesQuick Links
Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16
MLX-VLM conversion of huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated.
Overview
- Format: MLX-VLM
- Precision: bf16
- Size: 66G
- Source model type: Qwen3_5MoeForConditionalGeneration
- Source pipeline: image-text-to-text
- Intended runtime: mlx-vlm, LM Studio
Validation
Local checks on Apple Silicon:
- model loading in mlx-vlm: passed
- text generation smoke test: passed
- image generation path smoke test: passed
Smoke-test logs were produced locally before upload.
Notes
This is an abliterated model conversion. Outputs may be less filtered than standard instruction-tuned models. Use responsibly and comply with applicable laws and platform policies.
Files
Important files in this repo:
- config.json
- generation_config.json
- chat_template.jinja
- tokenizer.json
- tokenizer_config.json
- model.safetensors.index.json
- model-*.safetensors
Usage
Text generation
mlx_vlm.generate \
--model /path/to/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 \
--prompt "你好" \
--max-tokens 128 \
--trust-remote-code \
--processor-kwargs '{"enable_thinking": false}'
Image prompt
mlx_vlm.generate \
--model /path/to/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 \
--image /path/to/example.png \
--prompt "Describe this image." \
--max-tokens 128 \
--trust-remote-code \
--processor-kwargs '{"enable_thinking": false}'
- Downloads last month
- 351
Model size
35B params
Tensor type
BF16
·
Hardware compatibility
Log In to add your hardware
Quantized
Model tree for vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16
Base model
Qwen/Qwen3.6-35B-A3B
Start the MLX server
# Install MLX LM: uv tool install mlx-lm# Start a local OpenAI-compatible server: mlx_lm.server --model "vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16"