Hugging Face's logo

SC117
/
Qwen-AgentWorld-35B-A3B-MTP-APEX-GGUF

Text Generation
Transformers
GGUF
English
Chinese
qwen3_5_moe
qwen-agentworld
world-model
agentic-environment-simulation
mtp
apex
quantization
multimodal
Model card Files
xet
 Community
SC117 commited on
Commit
a6f432b
·
verified ·
1 Parent(s): 3485dfa

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +137 -0
README.md ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ pipeline_tag: text-generation
5
+ language:
6
+ - en
7
+ - zh
8
+ tags:
9
+ - qwen3_5_moe
10
+ - qwen-agentworld
11
+ - world-model
12
+ - agentic-environment-simulation
13
+ - mtp
14
+ - apex
15
+ - quantization
16
+ - gguf
17
+ - multimodal
18
+ base_model:
19
+ - Qwen/Qwen-AgentWorld-35B-A3B
20
+ ---
21
+
22
+ <div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin-bottom: 24px;">
23
+ <div style="background: #f5f7fb; border-radius: 20px; padding: 36px 32px; margin-bottom: 20px; text-align: center; position: relative; overflow: hidden;">
24
+ <div style="position: absolute; top: -34px; right: -30px; width: 130px; height: 130px; background: #dbeafe; border-radius: 50%;"></div>
25
+ <div style="position: absolute; bottom: -24px; left: 34px; width: 92px; height: 92px; background: #bfdbfe; border-radius: 50%;"></div>
26
+ <div style="position: absolute; top: 50%; left: -20px; width: 64px; height: 64px; background: #dcfce7; border-radius: 50%;"></div>
27
+ <div style="display: inline-flex; flex-wrap: wrap; gap: 8px; justify-content: center; margin-bottom: 16px; position: relative; z-index: 1;">
28
+ <span style="background: #007aff; color: white; font-size: 11px; font-weight: 700; padding: 5px 14px; border-radius: 20px;">APEX-I</span>
29
+ <span style="background: #af52de; color: white; font-size: 11px; font-weight: 700; padding: 5px 14px; border-radius: 20px;">MTP</span>
30
+ <span style="background: #30d158; color: white; font-size: 11px; font-weight: 700; padding: 5px 14px; border-radius: 20px;">GGUF</span>
31
+ <span style="background: #f97316; color: white; font-size: 11px; font-weight: 700; padding: 5px 14px; border-radius: 20px;">Apache-2.0</span>
32
+ </div>
33
+ <h1 style="margin: 0 0 8px 0; font-size: 32px; font-weight: 800; color: #1d1d1f; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">Qwen-AgentWorld-35B-A3B-MTP-APEX</h1>
34
+ <p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #86868b;">English</span> | <a href="https://huggingface.co/SC117/Qwen-AgentWorld-35B-A3B-MTP-APEX-GGUF/blob/main/README_zh.md" style="color: #007aff; text-decoration: none;">中文 README</a></p>
35
+ <p style="margin: 10px 0 0 0; font-size: 15px; color: #64748b; position: relative; z-index: 1;">AgentWorld world model · native MTP injected · APEX-I GGUFs</p>
36
+ </div>
37
+ </div>
38
+
39
+ <div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; display: flex; flex-direction: column; gap: 20px; margin-bottom: 30px;">
40
+
41
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
42
+ <div style="background: linear-gradient(135deg, #dc2626 0%, #f97316 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">Important Warning</div>
43
+ <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
44
+ <p style="margin: 0;"><b>Qwen-AgentWorld is designed as an agentic environment simulation / language world model.</b> It is intended to simulate agent-environment interactions and predict environment states from actions and history. It is <b>not recommended</b> as a general daily assistant, coding model, or autonomous Agent backbone unless you specifically need this world-model behavior.</p>
45
+ </div>
46
+ </div>
47
+
48
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
49
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">About This Release</div>
50
+ <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
51
+ <p style="margin: 0 0 12px 0;">This package contains GGUF releases of <a href="https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B" target="_blank" style="color: #2563eb; text-decoration: none; font-weight: 700;">Qwen-AgentWorld-35B-A3B</a>, a Qwen3.5 MoE world model for agentic environment simulation.</p>
52
+ <p style="margin: 0 0 12px 0;">The model is the original Qwen release with no LoRA or abliteration applied. One native MTP layer from a compatible Qwen3.5-35B-A3B MTP shard was injected into the safetensors checkpoint, the result was converted to BF16 GGUF, and then quantized into APEX-I tiers using a model-specific imatrix.</p>
53
+ <p style="margin: 0;">The release keeps the BF16 GGUF, the imatrix, and <code>mmproj-F16.gguf</code> for reproducibility and multimodal llama.cpp use.</p>
54
+ </div>
55
+ </div>
56
+
57
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
58
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">Model Details</div>
59
+ <div style="padding: 16px;">
60
+ <table style="width: 100%; border-collapse: collapse; font-size: 13px;"><tbody>
61
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Base model</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;"><code>Qwen/Qwen-AgentWorld-35B-A3B</code></td></tr>
62
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Architecture</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">Qwen3.5 MoE</td></tr>
63
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Parameters</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">35B total, around 3B active per token</td></tr>
64
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Experts</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">256 routed experts, 8 active per token</td></tr>
65
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">Context</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">262,144 tokens</td></tr>
66
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #334155;">MTP</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); color: #4b5563;">1 injected MTP layer, 785 tensors</td></tr>
67
+ <tr><td style="padding: 7px 10px; font-weight: bold; color: #334155;">License</td><td style="padding: 7px 10px; color: #4b5563;">Apache-2.0</td></tr>
68
+ </tbody></table>
69
+ </div>
70
+ </div>
71
+
72
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
73
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">MTP Extraction And Injection</div>
74
+ <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
75
+ <p style="margin: 0 0 12px 0;">The MTP layer was extracted from a compatible Qwen3.5-35B-A3B MTP shard and injected into the AgentWorld safetensors model.</p>
76
+ <table style="width: 100%; border-collapse: collapse; font-size: 13px;"><tbody>
77
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold;">Tensor prefix</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);"><code>mtp.*</code></td></tr>
78
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold;">Tensor count</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">785</td></tr>
79
+ <tr><td style="padding: 7px 10px; font-weight: bold;">Injected shard</td><td style="padding: 7px 10px;"><code>model-00022-of-00022.safetensors</code></td></tr>
80
+ </tbody></table>
81
+ </div>
82
+ </div>
83
+
84
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
85
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">BenchLocal Results (I-Compact, thinking)</div>
86
+ <div style="padding: 16px;">
87
+ <table style="width: 100%; border-collapse: collapse; font-size: 13px;"><thead><tr style="background: rgba(37,99,235,0.06);"><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Model</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">TC</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">BF</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">HA</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Ceiling</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Practical</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Retry</th></tr></thead><tbody>
88
+ <tr><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold;">Qwen-AgentWorld-35B-A3B, thinking</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">100</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">87</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">81</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">88.5</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15); font-weight: bold; color: #15803d;">87.5</td><td style="padding: 7px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">1</td></tr>
89
+ <tr><td style="padding: 7px 10px; font-weight: bold;">Qwen3.6-35B thinking baseline</td><td style="padding: 7px 10px;">97</td><td style="padding: 7px 10px;">88</td><td style="padding: 7px 10px;">85</td><td style="padding: 7px 10px;">89.5</td><td style="padding: 7px 10px;">81.5</td><td style="padding: 7px 10px;">8</td></tr>
90
+ </tbody></table>
91
+ <p style="margin: 12px 0 0 0; font-size: 12px; color: #64748b; font-style: italic;">Thinking mode is strongly recommended for this model family. The I-Mini, I-Quality, and I-Balanced tiers are pending re-test with the model-specific imatrix.</p>
92
+ </div>
93
+ </div>
94
+
95
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
96
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">Usage</div>
97
+ <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
98
+ <p style="margin: 0 0 8px 0; font-weight: bold;">llama.cpp server</p>
99
+ <p style="margin: 0; font-family: monospace; background: #f8fafc; padding: 10px 14px; border-radius: 6px; border: 1px solid #e2e8f0; font-size: 12px; color: #1e293b; white-space: pre-wrap;">hf download SC117/Qwen-AgentWorld-35B-A3B-MTP-APEX-GGUF --include "*.gguf" --local-dir ./models/qwen-agentworld-mtp-apex
100
+ ./llama-server -m ./models/qwen-agentworld-mtp-apex/Qwen-AgentWorld-35B-A3B-MTP-APEX-I-Compact.gguf -ngl 99 -c 131072</p>
101
+ <p style="margin: 12px 0 8px 0; font-weight: bold;">vision + text</p>
102
+ <p style="margin: 0; font-family: monospace; background: #f8fafc; padding: 10px 14px; border-radius: 6px; border: 1px solid #e2e8f0; font-size: 12px; color: #1e293b; white-space: pre-wrap;">./llama-server -m ./models/qwen-agentworld-mtp-apex/Qwen-AgentWorld-35B-A3B-MTP-APEX-I-Compact.gguf --mmproj ./models/qwen-agentworld-mtp-apex/mmproj-f16.gguf -ngl 99 -c 131072</p>
103
+ </div>
104
+ </div>
105
+
106
+ <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
107
+ <div style="background: linear-gradient(135deg, #2563eb 0%, #7c3aed 100%); padding: 12px 16px; color: white; font-weight: 800; font-size: 14px;">APEX Quantization Tiers</div>
108
+ <div style="padding: 16px;">
109
+ <table style="width: 100%; border-collapse: collapse; font-size: 13px;"><thead><tr style="background: rgba(37,99,235,0.06);"><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">File</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Size</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Profile</th><th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8;">Best For</th></tr></thead><tbody>
110
+ <tr><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);"><code>*-APEX-I-Balanced.gguf</code></td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">24.33 GB</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">I-Balanced</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">Highest-retention all-rounder</td></tr>
111
+ <tr><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);"><code>*-APEX-I-Quality.gguf</code></td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">21.87 GB</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">I-Quality</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">Quality-focused, IQ4_XS middle experts</td></tr>
112
+ <tr><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);"><code>*-APEX-I-Compact.gguf</code></td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">16.14 GB</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">I-Compact</td><td style="padding: 8px 10px; box-shadow: 0 1px 0 0 rgba(128,128,128,0.15);">Recommended quality/size ratio</td></tr>
113
+ <tr><td style="padding: 8px 10px;"><code>*-APEX-I-Mini.gguf</code></td><td style="padding: 8px 10px;">13.29 GB</td><td style="padding: 8px 10px;">I-Mini</td><td style="padding: 8px 10px;">Smallest practical tier</td></tr>
114
+ </tbody></table>
115
+ <p style="margin: 12px 0 0 0; font-size: 12px; color: #64748b;">Quantized with a model-specific imatrix generated from cleaned AgentWorld calibration text.</p>
116
+ </div>
117
+ </div>
118
+
119
+ </div>
120
+
121
+ ## Links
122
+
123
+ - **Original Model**: https://huggingface.co/Qwen/Qwen-AgentWorld-35B-A3B
124
+ - **Qwen-AgentWorld Project**: https://github.com/QwenLM/Qwen-AgentWorld
125
+ - **APEX Quantization**: https://github.com/mudler/apex-quant
126
+ - **BenchLocal Thinking**: https://scorp1o117.github.io/benchlocal-results/models/qwen-agentworld-35b-thinking.html
127
+
128
+ ## Citation
129
+
130
+ ```bibtex
131
+ @misc{qwen-agentworld-2026,
132
+ title = {Qwen-AgentWorld: Language World Models for General Agents},
133
+ author = {Qwen Team},
134
+ year = {2026},
135
+ url = {https://github.com/QwenLM/Qwen-AgentWorld}
136
+ }
137
+ ```