MTP layers mising?

#55
by btearspell - opened

Using the latest TheTom fork of llama-cpp
with base funtionality confirmed with unsloth/Qwen3.6-27B-MTP-GGUF MTP works fine

Your model lists "Multi-token prediction (MTP) support" but

0.02.963.752 I srv    load_model: creating MTP draft context against the target model 'E:/Program Files/LM Studio Models/HauhauCS/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Q8_0.gguf'
0.02.963.761 W llama_init_from_model: context type MTP requested but model doesn't contain MTP layers
0.02.963.762 E srv    load_model: failed to create MTP context

yep, there are no MTP

maybe this model never supported mtp

Sign up or log in to comment