---
library_name: transformers
base_model:
- unsloth/Qwen3.6-35B-A3B
tags:
- gguf
- llama.cpp
- image-text-to-text
- vision
- multimodal
- text-generation-inference
- transformers
- unsloth
- conversational
- mtp
- multi-token-prediction
- speculative-decoding
- qwen3_6
- moe
- reasoning
- chain-of-thought
- lora
- sft
- tool-use
- function-calling
- long-context
license: apache-2.0
language:
- en
- zh
- es
- ru
- ja
pipeline_tag: image-text-to-text
datasets:
- Jackrong/Claude-opus-4.7-TraceInversion-5000x
- Jackrong/Claude-opus-4.6-TraceInversion-9000x
---
# Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF
<div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; border: 1px solid #93c5fd; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
  <div style="background: linear-gradient(135deg, #3b82f6 0%, #1d4ed8 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;">
    <span>⚡</span> What is MTP (Multi-Token Prediction)?
  </div>
  <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.6;">
    MTP (Multi-Token Prediction) is a technique introduced in the Qwen3.6 architecture that enables the model to predict multiple future tokens simultaneously. By leveraging dedicated MTP heads, this model supports <b>speculative decoding</b>, where a draft model predicts multiple tokens at once and the target model verifies them in parallel, resulting in significant inference speedups without sacrificing output quality.
    <br><br>
    This GGUF release preserves the MTP heads from <code>unsloth/Qwen3.6-35B-A3B</code>, making it compatible with mainstream inference frameworks that support MTP-based speculative decoding (such as llama.cpp and its derivatives). For optimal throughput, pair this MTP-enabled GGUF with a corresponding draft model.
  </div>
</div>

Source model: `Jackrong/Qwopus3.6-35B-A3B-v1`
MTP source: `unsloth/Qwen3.6-35B-A3B`

Uploaded GGUF variants:

- `Qwopus3.6-35B-A3B-v1-MTP-Q2_K.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q3_K_S.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q3_K_M.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q3_K_L.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-IQ4_XS.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q4_K_S.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q4_K_M.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q5_K_S.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q5_K_M.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q6_K.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-Q8_0.gguf`
- `Qwopus3.6-35B-A3B-v1-MTP-BF16.gguf`

This release was prepared by validating or injecting Qwen MTP/nextn tensors before GGUF conversion.