error while handling argument "--spec-type": unknown speculative type: mtp
#6
by felkf - opened
========================================
git clone --depth 1 https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
git fetch origin pull/22673/head:mtp-pr && git checkout mtp-pr
cmake -B build -DGGML_METAL=ON -DCMAKE_BUILD_TYPE=Release
cmake --build build --target llama-cli llama-server
I use this command and start llama server, but error below.
========================================
error while handling argument "--spec-type": unknown speculative type: mtp
usage:
--spec-type none,draft-simple,draft-eagle3,draft-mtp,ngram-simple,ngram-map-k,ngram-map-k4v,ngram-mod,ngram-cache
comma-separated list of types of speculative decoding to use (default:
none)
(env: LLAMA_ARG_SPEC_TYPE)
What is problem??
(I use apple macbook m1 max)
felkf changed discussion status to closed
Yes, now the MTP PR has been merged the command is different. I will upload an updated readme