error while handling argument "--spec-type": unknown speculative type: mtp

#6
by felkf - opened

========================================
git clone --depth 1 https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
git fetch origin pull/22673/head:mtp-pr && git checkout mtp-pr

cmake -B build -DGGML_METAL=ON -DCMAKE_BUILD_TYPE=Release
cmake --build build --target llama-cli llama-server

I use this command and start llama server, but error below.

========================================
error while handling argument "--spec-type": unknown speculative type: mtp

usage:
--spec-type none,draft-simple,draft-eagle3,draft-mtp,ngram-simple,ngram-map-k,ngram-map-k4v,ngram-mod,ngram-cache
comma-separated list of types of speculative decoding to use (default:
none)

(env: LLAMA_ARG_SPEC_TYPE)

What is problem??
(I use apple macbook m1 max)

felkf changed discussion status to closed

Yes, now the MTP PR has been merged the command is different. I will upload an updated readme

Sign up or log in to comment