Text Generation
GGUF
quantized
deepseek
deepseek-v4
deepseek-v4-flash
Mixture of Experts
mixture-of-experts
mxfp4
iq2_xxs
q2_k
ds4
dspark
apple-silicon
metal
imatrix
conversational
Instructions to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 # Run inference directly in the terminal: llama cli -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 # Run inference directly in the terminal: llama cli -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 # Run inference directly in the terminal: ./llama-cli -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 # Run inference directly in the terminal: ./build/bin/llama-cli -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Use Docker
docker model run hf.co/apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
- LM Studio
- Jan
- vLLM
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
- Ollama
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Ollama:
ollama run hf.co/apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
- Unsloth Studio
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 to start chatting
- Pi
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Docker Model Runner:
docker model run hf.co/apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
- Lemonade
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Run and chat with the model
lemonade run user.DeepSeek-V4-Flash-0731-DS4-Quality128-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128
Run Hermes
hermes
- Atomic Chat
| { | |
| "schema": "deepseek-model-tools.build128.v1", | |
| "artifact": "ds4-quality128-original", | |
| "output": "DeepSeek-V4-Flash-0731-DS4-Quality128", | |
| "engine": "ds4", | |
| "dspark": true, | |
| "created_at": "2026-08-01T16:00:13.755362+00:00", | |
| "source": { | |
| "path": "/Volumes/Samsung_4TB/models/DeepSeek-V4-Flash-0731", | |
| "only_weight_source": true, | |
| "source_kind": "original-huggingface-checkpoint", | |
| "config_sha256": "6c8f3d2d3b48707541b88f32f22ef3f0f8a6b57d8523281e2b8d3cdb0ae9a023", | |
| "index_sha256": "98efab455cf08dfbbbaaba6f570e1bf10bf927d2b4c3c453a59c2f6f0e3be92b", | |
| "upstream_model": "deepseek-ai/DeepSeek-V4-Flash-0731", | |
| "upstream_revision": "9e165c30e2704aec5d9d593cce3eebd58bbef1cb", | |
| "identity_cache": "/Volumes/Samsung_4TB/models/DeepSeek-V4-Flash-0731/.cache/huggingface/download", | |
| "weight_shards": [ | |
| { | |
| "filename": "model-00001-of-00048.safetensors", | |
| "sha256": "f3668ba4cccf1ca6a7eb84e888fb92c1cdc7204d472ba9db771e6fd3abf6b874", | |
| "upload_mode": "lfs", | |
| "bytes": 1059061856 | |
| }, | |
| { | |
| "filename": "model-00002-of-00048.safetensors", | |
| "sha256": "77b26c939a0e25b3113c8d6bb04e1901a748bd4a7d2589e3bfdaabdf1e9bba14", | |
| "upload_mode": "lfs", | |
| "bytes": 3566321192 | |
| }, | |
| { | |
| "filename": "model-00003-of-00048.safetensors", | |
| "sha256": "412abf4c906faadc221ef0cb50f90fe20bde8454a08ad4dc2364b6b79e7fda5c", | |
| "upload_mode": "lfs", | |
| "bytes": 3566321192 | |
| }, | |
| { | |
| "filename": "model-00004-of-00048.safetensors", | |
| "sha256": "9610f56bc587fb0ff9a8b68a60299482ee8c433fe5b5587e4257aca98add4a2e", | |
| "upload_mode": "lfs", | |
| "bytes": 3596229272 | |
| }, | |
| { | |
| "filename": "model-00005-of-00048.safetensors", | |
| "sha256": "f87a5ac7b8becc31f9c3169afd3a6f33fb82b4af9e21022e3755a10bc28f0180", | |
| "upload_mode": "lfs", | |
| "bytes": 3568768976 | |
| }, | |
| { | |
| "filename": "model-00006-of-00048.safetensors", | |
| "sha256": "4a4f3764e3fc772b9fba67f0a44ef68e18f178b6f00faa80b75db549e51894cd", | |
| "upload_mode": "lfs", | |
| "bytes": 3590024776 | |
| }, | |
| { | |
| "filename": "model-00007-of-00048.safetensors", | |
| "sha256": "df81bb80e27a689e01fa579eebd6499f86e0b6105f7fea18961aa5eebbbee9bc", | |
| "upload_mode": "lfs", | |
| "bytes": 3568768976 | |
| }, | |
| { | |
| "filename": "model-00008-of-00048.safetensors", | |
| "sha256": "224968d2b27f8669365ec08657a768dfec40da0585f85f302a31495931f6a526", | |
| "upload_mode": "lfs", | |
| "bytes": 3590024776 | |
| }, | |
| { | |
| "filename": "model-00009-of-00048.safetensors", | |
| "sha256": "04d69ef1071fff8721c62968c200a5583122b59b015e9ef9b2978bfed271b2b7", | |
| "upload_mode": "lfs", | |
| "bytes": 3568768976 | |
| }, | |
| { | |
| "filename": "model-00010-of-00048.safetensors", | |
| "sha256": "627145f4ebeb1cc3f5bdd03416b8cb7370b3c96974853cbeb8e5516ad5713e49", | |
| "upload_mode": "lfs", | |
| "bytes": 3590024776 | |
| }, | |
| { | |
| "filename": "model-00011-of-00048.safetensors", | |
| "sha256": "e4b8e601dcbebe902e0102e7b098b670a121cb8b9564dd719fc41d782c8416e0", | |
| "upload_mode": "lfs", | |
| "bytes": 3568768976 | |
| }, | |
| { | |
| "filename": "model-00012-of-00048.safetensors", | |
| "sha256": "64ed4e5f6126ba029c462c9d5fca0fc907c5f855b4ba01194d79560f6db16e42", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00013-of-00048.safetensors", | |
| "sha256": "8dfe199d07c07ddd141c2c0136a2237f1161250a1a03ebe8deaabac93440da1d", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00014-of-00048.safetensors", | |
| "sha256": "45db2f540f825f92453c50335e49aede58cca56bc578d1787c12a0fbca6593e5", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00015-of-00048.safetensors", | |
| "sha256": "5810381a0f05b7381c002d299ed6ac19e42eba8070dd17e2703546944d84f292", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00016-of-00048.safetensors", | |
| "sha256": "e0530b7024771b0ce2df9b40bcc2232578f3300178487ec216863b0b2835617b", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00017-of-00048.safetensors", | |
| "sha256": "ed11130247118b185ade893c0109bad896dd394cb1e066ce4fce044176261d94", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00018-of-00048.safetensors", | |
| "sha256": "e393fea96da2a3414ef089354fc32e1c8891954de40958c84d2c2ecf80365b25", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00019-of-00048.safetensors", | |
| "sha256": "a74ca4d3e8e82ce20c458bb8b1900110b753793ad4c58d08f38995f719c616f7", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00020-of-00048.safetensors", | |
| "sha256": "9f556769926e60309e8defe45ab59fc8b26ae460d30c190cd746a3d78c11e2c2", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00021-of-00048.safetensors", | |
| "sha256": "1671cce7f90d781f796b5ca6bf32dd1aeb740abcb2735e41ffd28f62485ce005", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00022-of-00048.safetensors", | |
| "sha256": "decd67a4bd97a75fa36861d2ad3067afeefa6a04a20da997fe6c19f171e70132", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00023-of-00048.safetensors", | |
| "sha256": "c61a3e179cdbee19bfb8cbc4e111928ce2f1e1f0f4729d7c0cd5634354a4689d", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00024-of-00048.safetensors", | |
| "sha256": "fc27aeb4233534f6f7781dcfe57127a3908ae10fc025c5d86dc0682057f8b2fe", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00025-of-00048.safetensors", | |
| "sha256": "a66b6b8d5821b68f5b511e4f91e12025cd07d0fa6d0b71e722d825a2d6d878ca", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00026-of-00048.safetensors", | |
| "sha256": "657b89314fbaf6eee4acce24b3baf7e5fd2c5986a96ad85b08d90539cde869fe", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00027-of-00048.safetensors", | |
| "sha256": "fb01f21a0da0446b0bdf25a127ab19a6b06006acd8735f06a9ebfe34423fd7f5", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00028-of-00048.safetensors", | |
| "sha256": "b2fd5cbbb639f16e673bc484e5cca16b52a58bf2ab4bd62592e0c5408712ad7c", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00029-of-00048.safetensors", | |
| "sha256": "9ec2fdf900275daeac0980490c5c731cc7868b151ce1de5698f48418de4fa5f0", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00030-of-00048.safetensors", | |
| "sha256": "9ed3c317bf967d32133ad3a068ee4c56aae9784bc8b7da694482437f37dc1782", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00031-of-00048.safetensors", | |
| "sha256": "d5078c3fca3e6370043606ead7856e0b8fe67a9aab52c415769f29934c4d7f5d", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00032-of-00048.safetensors", | |
| "sha256": "163653848f002718d3deaa6ce48885483fc1f2e12e50e44a47477c73ccd91393", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00033-of-00048.safetensors", | |
| "sha256": "f2cffd43f2a5f491f4691f8694e6bc08239158e143ae7063dc04f0eb0259214a", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00034-of-00048.safetensors", | |
| "sha256": "0f94945121474cfdb6a9ab175914d3811ffbf08e6cc54082e14e473c755d18d8", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00035-of-00048.safetensors", | |
| "sha256": "9cb6a316989f7c7385e3ec2bd42ffe766ee126c70ef3466742849982ee1b0f0f", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00036-of-00048.safetensors", | |
| "sha256": "7e6761421fe944c2143eb897b983085891b421c148c6c17fb5cd8eaa9bdaa497", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00037-of-00048.safetensors", | |
| "sha256": "a59d662f1143596d56c452a1230b717ce43edf678207398c573a2503b0f72c91", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00038-of-00048.safetensors", | |
| "sha256": "137fa617a74ba8e73fd76bb1010c7a85d791aaa150006cb66faa04a83e9e730f", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00039-of-00048.safetensors", | |
| "sha256": "a29af1aa519d7ce726235ea2c2b38146d756290cda7a82d90c4d4438155b53e4", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00040-of-00048.safetensors", | |
| "sha256": "8bc93d8a7d1987dc86b14e22b1d8f42ec31da92c56edd9f312daf43f33a6a206", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00041-of-00048.safetensors", | |
| "sha256": "fd312e7fdd6cb5796df356a7f0314f124851dc149991e9fb02c5bed45cc4ba05", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00042-of-00048.safetensors", | |
| "sha256": "4d19bf368083c9a183cb0849f316ec17b62f859ca824c0586e779657efb6e6a6", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00043-of-00048.safetensors", | |
| "sha256": "b7103842ceb70848f9804f55c193d6a57f43174a587cba42b61b5c1bc4e1303d", | |
| "upload_mode": "lfs", | |
| "bytes": 3568770544 | |
| }, | |
| { | |
| "filename": "model-00044-of-00048.safetensors", | |
| "sha256": "422d3889fa20c238b7f97464c14df0bcf3328f189c294f41a3a334421dc560c7", | |
| "upload_mode": "lfs", | |
| "bytes": 3590026352 | |
| }, | |
| { | |
| "filename": "model-00045-of-00048.safetensors", | |
| "sha256": "a5be6aed7b84fc87ec42b5d24ba0b0d67f253a3906fcd99c13f4f7be5958fc00", | |
| "upload_mode": "lfs", | |
| "bytes": 1059332516 | |
| }, | |
| { | |
| "filename": "model-00046-of-00048.safetensors", | |
| "sha256": "5db924ca907e0d93acd975bd5079c3662717f9ac709f23d079bd8f816d29d9dd", | |
| "upload_mode": "lfs", | |
| "bytes": 3610455184 | |
| }, | |
| { | |
| "filename": "model-00047-of-00048.safetensors", | |
| "sha256": "62816173f9f6e136b20b48e3b6f16613ac9ea02b5603f636928b253244a548bd", | |
| "upload_mode": "lfs", | |
| "bytes": 3560111960 | |
| }, | |
| { | |
| "filename": "model-00048-of-00048.safetensors", | |
| "sha256": "cc43742bd24ae6bcdea343a91442f6f66aed2cfebcc6b235470204851ce2f8a9", | |
| "upload_mode": "lfs", | |
| "bytes": 3692775244 | |
| } | |
| ], | |
| "weight_shard_bytes": 166886535336, | |
| "weight_shard_hashes_verified": true, | |
| "weight_shard_hashes_verified_at": "2026-08-01T14:21:34.126450+00:00", | |
| "post_hash_stat_snapshot": { | |
| "model-00001-of-00048.safetensors": { | |
| "bytes": 1059061856, | |
| "mtime_ns": 1785503207610000000, | |
| "ctime_ns": 1785503207610000000, | |
| "device": 16777242, | |
| "inode": 1227200 | |
| }, | |
| "model-00002-of-00048.safetensors": { | |
| "bytes": 3566321192, | |
| "mtime_ns": 1785503526950000000, | |
| "ctime_ns": 1785503526950000000, | |
| "device": 16777242, | |
| "inode": 1220339 | |
| }, | |
| "model-00003-of-00048.safetensors": { | |
| "bytes": 3566321192, | |
| "mtime_ns": 1785503449850000000, | |
| "ctime_ns": 1785503449850000000, | |
| "device": 16777242, | |
| "inode": 1220314 | |
| }, | |
| "model-00004-of-00048.safetensors": { | |
| "bytes": 3596229272, | |
| "mtime_ns": 1785503514180000000, | |
| "ctime_ns": 1785503514180000000, | |
| "device": 16777242, | |
| "inode": 1220289 | |
| }, | |
| "model-00005-of-00048.safetensors": { | |
| "bytes": 3568768976, | |
| "mtime_ns": 1785503576410000000, | |
| "ctime_ns": 1785503576410000000, | |
| "device": 16777242, | |
| "inode": 1220288 | |
| }, | |
| "model-00006-of-00048.safetensors": { | |
| "bytes": 3590024776, | |
| "mtime_ns": 1785503626970000000, | |
| "ctime_ns": 1785503626970000000, | |
| "device": 16777242, | |
| "inode": 1220364 | |
| }, | |
| "model-00007-of-00048.safetensors": { | |
| "bytes": 3568768976, | |
| "mtime_ns": 1785503569660000000, | |
| "ctime_ns": 1785503569660000000, | |
| "device": 16777242, | |
| "inode": 1220287 | |
| }, | |
| "model-00008-of-00048.safetensors": { | |
| "bytes": 3590024776, | |
| "mtime_ns": 1785503573510000000, | |
| "ctime_ns": 1785503573510000000, | |
| "device": 16777242, | |
| "inode": 1220286 | |
| }, | |
| "model-00009-of-00048.safetensors": { | |
| "bytes": 3568768976, | |
| "mtime_ns": 1785503819100000000, | |
| "ctime_ns": 1785503819100000000, | |
| "device": 16777242, | |
| "inode": 1257677 | |
| }, | |
| "model-00010-of-00048.safetensors": { | |
| "bytes": 3590024776, | |
| "mtime_ns": 1785503875280000000, | |
| "ctime_ns": 1785503875280000000, | |
| "device": 16777242, | |
| "inode": 1412950 | |
| }, | |
| "model-00011-of-00048.safetensors": { | |
| "bytes": 3568768976, | |
| "mtime_ns": 1785503964350000000, | |
| "ctime_ns": 1785503964350000000, | |
| "device": 16777242, | |
| "inode": 1439498 | |
| }, | |
| "model-00012-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785503994640000000, | |
| "ctime_ns": 1785503994640000000, | |
| "device": 16777242, | |
| "inode": 1479217 | |
| }, | |
| "model-00013-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504255840000000, | |
| "ctime_ns": 1785504255840000000, | |
| "device": 16777242, | |
| "inode": 2913063 | |
| }, | |
| "model-00014-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504220800000000, | |
| "ctime_ns": 1785504220800000000, | |
| "device": 16777242, | |
| "inode": 2943079 | |
| }, | |
| "model-00015-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504267840000000, | |
| "ctime_ns": 1785504267840000000, | |
| "device": 16777242, | |
| "inode": 2943120 | |
| }, | |
| "model-00016-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504275460000000, | |
| "ctime_ns": 1785504275460000000, | |
| "device": 16777242, | |
| "inode": 3008574 | |
| }, | |
| "model-00017-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504389580000000, | |
| "ctime_ns": 1785504389580000000, | |
| "device": 16777242, | |
| "inode": 3111729 | |
| }, | |
| "model-00018-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504430230000000, | |
| "ctime_ns": 1785504430230000000, | |
| "device": 16777242, | |
| "inode": 3142001 | |
| }, | |
| "model-00019-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504408150000000, | |
| "ctime_ns": 1785504408150000000, | |
| "device": 16777242, | |
| "inode": 3175731 | |
| }, | |
| "model-00020-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504589260000000, | |
| "ctime_ns": 1785504589260000000, | |
| "device": 16777242, | |
| "inode": 3179314 | |
| }, | |
| "model-00021-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504739580000000, | |
| "ctime_ns": 1785504739580000000, | |
| "device": 16777242, | |
| "inode": 3250866 | |
| }, | |
| "model-00022-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504807160000000, | |
| "ctime_ns": 1785504807160000000, | |
| "device": 16777242, | |
| "inode": 3273972 | |
| }, | |
| "model-00023-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785504764960000000, | |
| "ctime_ns": 1785504764960000000, | |
| "device": 16777242, | |
| "inode": 3280897 | |
| }, | |
| "model-00024-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785504875800000000, | |
| "ctime_ns": 1785504875800000000, | |
| "device": 16777242, | |
| "inode": 3280896 | |
| }, | |
| "model-00025-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505025920000000, | |
| "ctime_ns": 1785505025920000000, | |
| "device": 16777242, | |
| "inode": 3413097 | |
| }, | |
| "model-00026-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505045180000000, | |
| "ctime_ns": 1785505045180000000, | |
| "device": 16777242, | |
| "inode": 3413096 | |
| }, | |
| "model-00027-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505045830000000, | |
| "ctime_ns": 1785505045830000000, | |
| "device": 16777242, | |
| "inode": 3476335 | |
| }, | |
| "model-00028-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505098680000000, | |
| "ctime_ns": 1785505098680000000, | |
| "device": 16777242, | |
| "inode": 3862697 | |
| }, | |
| "model-00029-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505337860000000, | |
| "ctime_ns": 1785505337860000000, | |
| "device": 16777242, | |
| "inode": 3962848 | |
| }, | |
| "model-00030-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505329360000000, | |
| "ctime_ns": 1785505329360000000, | |
| "device": 16777242, | |
| "inode": 3969579 | |
| }, | |
| "model-00031-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505278610000000, | |
| "ctime_ns": 1785505278610000000, | |
| "device": 16777242, | |
| "inode": 6552978 | |
| }, | |
| "model-00032-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505422450000000, | |
| "ctime_ns": 1785505422450000000, | |
| "device": 16777242, | |
| "inode": 6577364 | |
| }, | |
| "model-00033-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505518610000000, | |
| "ctime_ns": 1785505518610000000, | |
| "device": 16777242, | |
| "inode": 9337694 | |
| }, | |
| "model-00034-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505646240000000, | |
| "ctime_ns": 1785505646240000000, | |
| "device": 16777242, | |
| "inode": 9337693 | |
| }, | |
| "model-00035-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505632340000000, | |
| "ctime_ns": 1785505632340000000, | |
| "device": 16777242, | |
| "inode": 9341904 | |
| }, | |
| "model-00036-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505677330000000, | |
| "ctime_ns": 1785505677330000000, | |
| "device": 16777242, | |
| "inode": 9347816 | |
| }, | |
| "model-00037-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505900360000000, | |
| "ctime_ns": 1785505900360000000, | |
| "device": 16777242, | |
| "inode": 9384464 | |
| }, | |
| "model-00038-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505965980000000, | |
| "ctime_ns": 1785505965980000000, | |
| "device": 16777242, | |
| "inode": 9391578 | |
| }, | |
| "model-00039-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505970320000000, | |
| "ctime_ns": 1785505970320000000, | |
| "device": 16777242, | |
| "inode": 9398495 | |
| }, | |
| "model-00040-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785505978650000000, | |
| "ctime_ns": 1785505978650000000, | |
| "device": 16777242, | |
| "inode": 9411167 | |
| }, | |
| "model-00041-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785505946150000000, | |
| "ctime_ns": 1785505946150000000, | |
| "device": 16777242, | |
| "inode": 10377561 | |
| }, | |
| "model-00042-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785506161290000000, | |
| "ctime_ns": 1785506161290000000, | |
| "device": 16777242, | |
| "inode": 10394652 | |
| }, | |
| "model-00043-of-00048.safetensors": { | |
| "bytes": 3568770544, | |
| "mtime_ns": 1785506159880000000, | |
| "ctime_ns": 1785506159880000000, | |
| "device": 16777242, | |
| "inode": 10401334 | |
| }, | |
| "model-00044-of-00048.safetensors": { | |
| "bytes": 3590026352, | |
| "mtime_ns": 1785506177170000000, | |
| "ctime_ns": 1785506177170000000, | |
| "device": 16777242, | |
| "inode": 10405174 | |
| }, | |
| "model-00045-of-00048.safetensors": { | |
| "bytes": 1059332516, | |
| "mtime_ns": 1785506038960000000, | |
| "ctime_ns": 1785506038960000000, | |
| "device": 16777242, | |
| "inode": 10451859 | |
| }, | |
| "model-00046-of-00048.safetensors": { | |
| "bytes": 3610455184, | |
| "mtime_ns": 1785506331530000000, | |
| "ctime_ns": 1785506331530000000, | |
| "device": 16777242, | |
| "inode": 10459297 | |
| }, | |
| "model-00047-of-00048.safetensors": { | |
| "bytes": 3560111960, | |
| "mtime_ns": 1785506331790000000, | |
| "ctime_ns": 1785506331790000000, | |
| "device": 16777242, | |
| "inode": 10459296 | |
| }, | |
| "model-00048-of-00048.safetensors": { | |
| "bytes": 3692775244, | |
| "mtime_ns": 1785506331020000000, | |
| "ctime_ns": 1785506331020000000, | |
| "device": 16777242, | |
| "inode": 10464304 | |
| } | |
| } | |
| }, | |
| "profile": { | |
| "path": "/Users/andreas/code/deepseek-model-tools/configs/dsv4-ds4-quality128-original.json", | |
| "sha256": "bc7f6470a0cb6208addf2ac52806d976108517119b411023da3fd91b492b218c", | |
| "content": { | |
| "name": "dsv4-ds4-quality128-original", | |
| "engine": "ds4", | |
| "description": "Quality-first 128 GB DS4 profile for the official original DeepSeek V4 Flash 0731 checkpoint, preserving exact native MXFP4 routed experts on ten sensitivity-selected layers, with IQ2_XXS/Q2_K elsewhere and native-MXFP4 DSpark down projections.", | |
| "source": "/Volumes/Samsung_4TB/models/DeepSeek-V4-Flash-0731", | |
| "source_identity": { | |
| "repo_id": "deepseek-ai/DeepSeek-V4-Flash-0731", | |
| "revision": "9e165c30e2704aec5d9d593cce3eebd58bbef1cb", | |
| "identity_cache": ".cache/huggingface/download" | |
| }, | |
| "output": "DeepSeek-V4-Flash-0731-DS4-Quality128", | |
| "ds4_revision": "d516d4eeb82c454aeb2831af1b1961801d6b571b", | |
| "toolchain": { | |
| "root": "/Users/andreas/code/3rd-party-repos/ds4-apetersson", | |
| "upstream_base_revision": "4893e0c40fba03dbc85555faeb035799aa04e0b6", | |
| "quantizer_sha256": "f0a381f4ada808ea2afa740d964354fa327fc1235ba7cebf50874eb89fb97ac5", | |
| "runtime_sha256": "5382bee60cb1c2d1e3274511c56099f88279684fbf152fa409d551711dbb9543" | |
| }, | |
| "main": { | |
| "experts": "iq2_xxs", | |
| "routed_w2": "q2_k", | |
| "attention_proj": "q8_0", | |
| "shared": "q8_0", | |
| "preserve_indexer_f16": true, | |
| "tensor_types": [ | |
| "output.weight=q8_0" | |
| ], | |
| "native_mxfp4_layers": [ | |
| 10, | |
| 14, | |
| 30, | |
| 34, | |
| 37, | |
| 38, | |
| 39, | |
| 40, | |
| 41, | |
| 42 | |
| ], | |
| "native_mxfp4_layer_selection": "Antirez 37-42 seed plus cross-recipe sensitivity controls 10,14,30,34; source packed I8 codes and F8_E8M0 scales are preserved exactly.", | |
| "estimated_bytes": 102826238912 | |
| }, | |
| "dspark": { | |
| "experts": "iq2_xxs", | |
| "routed_w2": "mxfp4", | |
| "block_size": 5, | |
| "target_layers": [ | |
| 40, | |
| 41, | |
| 42 | |
| ], | |
| "markov_rank": 256, | |
| "noise_token_id": 128799, | |
| "calibration": "target-layer proxy aliases" | |
| }, | |
| "verification": { | |
| "require_imatrix_strict": true, | |
| "require_native_byte_compare": true, | |
| "main": { | |
| "bytes": 102826238912, | |
| "tensors": 1328, | |
| "tensor_types": { | |
| "i32": 3, | |
| "iq2_xxs": 66, | |
| "q2_k": 33, | |
| "mxfp4": 30, | |
| "f16": 359, | |
| "f32": 492, | |
| "q8_0": 345 | |
| } | |
| }, | |
| "dspark": { | |
| "bytes": 7297737120, | |
| "tensors": 81, | |
| "tensor_types": { | |
| "f32": 34, | |
| "f16": 7, | |
| "q8_0": 31, | |
| "iq2_xxs": 6, | |
| "mxfp4": 3 | |
| } | |
| } | |
| }, | |
| "calibration": { | |
| "repo_id": "ox-ox/DeepSeek-V4-Flash-0731-GGUF", | |
| "revision": "6d58a3a36030c3ccb969bb5759fc6ae08cd299f8", | |
| "filename": "imatrix/DeepSeek-V4-Flash-0731-chat-v2-routed-moe-ds4-1p5m.dat", | |
| "bytes": 450892654, | |
| "sha256": "6fce7674df701de544e5d3351aab04e67602eddeafeb48cf70e77ebe47239eb4", | |
| "coverage_policy": "exact 129 routed names and vector dimensions; strict mode checks only imatrix-consuming output types" | |
| }, | |
| "template": { | |
| "role": "metadata-tokenizer-tensor-order-only", | |
| "repo_id": "antirez/deepseek-v4-gguf", | |
| "revision": "1cd7b564460821938add0475a60b942c409295e0", | |
| "filename": "DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-0731.gguf", | |
| "remote_bytes": 86720111488, | |
| "lfs_sha256": "ca22ae2f838e14077c22bc1c1417b71b45b5e5a3687bd96c2ac6e17fdb6261c0", | |
| "xet_hash": "7da16e1025c1b856490c29c341f4e467d15cb195389c70383dade5e6108799ac", | |
| "header_sha256": "f0e1d5e8f3b008402aa6eb32cada3873dd926c8bf5e7d00d7788eec65f09dd6d" | |
| }, | |
| "recipe_control": { | |
| "repo_id": "antirez/deepseek-v4-gguf", | |
| "revision": "1cd7b564460821938add0475a60b942c409295e0", | |
| "dspark_filename": "DeepSeek-V4-Flash-DSpark-support.gguf", | |
| "weights_used": false | |
| } | |
| } | |
| }, | |
| "calibration": { | |
| "repo_id": "ox-ox/DeepSeek-V4-Flash-0731-GGUF", | |
| "filename": "imatrix/DeepSeek-V4-Flash-0731-chat-v2-routed-moe-ds4-1p5m.dat", | |
| "revision": "6d58a3a36030c3ccb969bb5759fc6ae08cd299f8", | |
| "bytes": 450892654, | |
| "sha256": "6fce7674df701de544e5d3351aab04e67602eddeafeb48cf70e77ebe47239eb4", | |
| "coverage_validation": { | |
| "entries": 129, | |
| "scope": "all routed gate/up/down tensors", | |
| "policy": "exact-name-and-vector-length", | |
| "global_ds4_imatrix_strict": true | |
| } | |
| }, | |
| "template": { | |
| "repo_id": "antirez/deepseek-v4-gguf", | |
| "filename": "DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-0731.gguf", | |
| "revision": "1cd7b564460821938add0475a60b942c409295e0", | |
| "role": "metadata-tokenizer-tensor-order-and-shapes-only", | |
| "weights_used": false, | |
| "remote_bytes": 86720111488, | |
| "lfs_sha256": "ca22ae2f838e14077c22bc1c1417b71b45b5e5a3687bd96c2ac6e17fdb6261c0", | |
| "xet_hash": "7da16e1025c1b856490c29c341f4e467d15cb195389c70383dade5e6108799ac", | |
| "downloaded_header_bytes": 67108864, | |
| "header_sha256": "f0e1d5e8f3b008402aa6eb32cada3873dd926c8bf5e7d00d7788eec65f09dd6d", | |
| "resolved": { | |
| "repo_id": "antirez/deepseek-v4-gguf", | |
| "filename": "DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-0731.gguf", | |
| "role": "metadata-tokenizer-tensor-order-and-shapes-only", | |
| "weights_used": false, | |
| "remote_bytes": 86720111488, | |
| "lfs_sha256": "ca22ae2f838e14077c22bc1c1417b71b45b5e5a3687bd96c2ac6e17fdb6261c0", | |
| "xet_hash": "7da16e1025c1b856490c29c341f4e467d15cb195389c70383dade5e6108799ac", | |
| "resolved_etag": "7da16e1025c1b856490c29c341f4e467d15cb195389c70383dade5e6108799ac", | |
| "range": "bytes=0-67108863", | |
| "header_bytes": 67108864, | |
| "header_sha256": "f0e1d5e8f3b008402aa6eb32cada3873dd926c8bf5e7d00d7788eec65f09dd6d" | |
| } | |
| }, | |
| "dspark_calibration_alias": { | |
| "schema": "deepseek-model-tools.dspark-imatrix-alias.v1", | |
| "function": "extend_dspark_legacy_imatrix", | |
| "source": { | |
| "repo_id": "ox-ox/DeepSeek-V4-Flash-0731-GGUF", | |
| "revision": "6d58a3a36030c3ccb969bb5759fc6ae08cd299f8", | |
| "filename": "imatrix/DeepSeek-V4-Flash-0731-chat-v2-routed-moe-ds4-1p5m.dat", | |
| "bytes": 450892654, | |
| "sha256": "6fce7674df701de544e5d3351aab04e67602eddeafeb48cf70e77ebe47239eb4" | |
| }, | |
| "output_sha256": "689b446ed2e2657ebcb69a6516781ee0444e07641aeb6125233fb4e6fe7cbce3", | |
| "mapping": [ | |
| { | |
| "stage": 0, | |
| "target_layer": 40, | |
| "alias": "mtp.0.ffn_gate_exps.weight", | |
| "source": "blk.40.ffn_gate_exps.weight" | |
| }, | |
| { | |
| "stage": 0, | |
| "target_layer": 40, | |
| "alias": "mtp.0.ffn_up_exps.weight", | |
| "source": "blk.40.ffn_up_exps.weight" | |
| }, | |
| { | |
| "stage": 0, | |
| "target_layer": 40, | |
| "alias": "mtp.0.ffn_down_exps.weight", | |
| "source": "blk.40.ffn_down_exps.weight" | |
| }, | |
| { | |
| "stage": 1, | |
| "target_layer": 41, | |
| "alias": "mtp.1.ffn_gate_exps.weight", | |
| "source": "blk.41.ffn_gate_exps.weight" | |
| }, | |
| { | |
| "stage": 1, | |
| "target_layer": 41, | |
| "alias": "mtp.1.ffn_up_exps.weight", | |
| "source": "blk.41.ffn_up_exps.weight" | |
| }, | |
| { | |
| "stage": 1, | |
| "target_layer": 41, | |
| "alias": "mtp.1.ffn_down_exps.weight", | |
| "source": "blk.41.ffn_down_exps.weight" | |
| }, | |
| { | |
| "stage": 2, | |
| "target_layer": 42, | |
| "alias": "mtp.2.ffn_gate_exps.weight", | |
| "source": "blk.42.ffn_gate_exps.weight" | |
| }, | |
| { | |
| "stage": 2, | |
| "target_layer": 42, | |
| "alias": "mtp.2.ffn_up_exps.weight", | |
| "source": "blk.42.ffn_up_exps.weight" | |
| }, | |
| { | |
| "stage": 2, | |
| "target_layer": 42, | |
| "alias": "mtp.2.ffn_down_exps.weight", | |
| "source": "blk.42.ffn_down_exps.weight" | |
| } | |
| ], | |
| "tool": { | |
| "repository_revision": "e24746463a0a3e79036dd9c0472deac6ce704f08", | |
| "importer_sha256": "b39987ce5ce35564bb4053ec11265c0ff41be233595ae17a6e039318a52dd4da" | |
| }, | |
| "coverage_validation": { | |
| "entries": 138, | |
| "trunk_entries": 129, | |
| "dspark_entries": 9, | |
| "coverage": "exact-name-and-vector-length" | |
| } | |
| }, | |
| "tools": { | |
| "ds4_revision": "d516d4eeb82c454aeb2831af1b1961801d6b571b", | |
| "ds4_root": "/Users/andreas/code/3rd-party-repos/ds4-apetersson", | |
| "ds4_quantizer_sha256": "f0a381f4ada808ea2afa740d964354fa327fc1235ba7cebf50874eb89fb97ac5", | |
| "ds4_runtime_sha256": "5382bee60cb1c2d1e3274511c56099f88279684fbf152fa409d551711dbb9543", | |
| "omlx_revision": "76352ed2363e42b2146243463875756e683a640d", | |
| "deepseek_model_tools_revision": "e24746463a0a3e79036dd9c0472deac6ce704f08", | |
| "deepseek_model_tools_worktree": { | |
| "dirty": true, | |
| "status_sha256": "92f5beb73ac6d01920de0cbfb8cd5cd4d019c05296a8bb3a183902b6eb83f1dc", | |
| "tracked_patch_sha256": "64dfc4b91c70163b4848cb404cc85dd539967d22d789a3aa04567503895a6312" | |
| }, | |
| "build_driver_sha256": "cb1569b909de010b4aaa2a1b1b7ed8e277bcdf41e32585f1651005b41e81567f" | |
| }, | |
| "commands": [ | |
| [ | |
| "/Users/andreas/code/3rd-party-repos/ds4-apetersson/gguf-tools/deepseek4-quantize", | |
| "--hf", | |
| "/Volumes/Samsung_4TB/models/DeepSeek-V4-Flash-0731", | |
| "--template", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/inputs/antirez/ca22ae2f838e14077c22bc1c1417b71b45b5e5a3687bd96c2ac6e17fdb6261c0.header-only.sparse.gguf", | |
| "--experts", | |
| "iq2_xxs", | |
| "--routed-w2", | |
| "q2_k", | |
| "--attention-proj", | |
| "q8_0", | |
| "--shared", | |
| "q8_0", | |
| "--threads", | |
| "8", | |
| "--imatrix", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/inputs/ox-ox/DeepSeek-V4-Flash-0731-chat-v2-routed-moe-ds4-1p5m.dat", | |
| "--tensor-type", | |
| "output.weight=q8_0", | |
| "--tensor-type", | |
| "blk.2.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.4.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.6.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.8.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.10.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.12.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.14.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.16.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.18.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.20.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.22.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.24.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.26.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.28.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.30.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.32.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.34.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.36.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.38.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.40.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.42.indexer.attn_q_b.weight=f16", | |
| "--tensor-type", | |
| "blk.10.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.10.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.10.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.14.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.14.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.14.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.30.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.30.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.30.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.34.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.34.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.34.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.37.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.37.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.37.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.38.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.38.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.38.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.39.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.39.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.39.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.40.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.40.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.40.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.41.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.41.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.41.ffn_down_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.42.ffn_gate_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.42.ffn_up_exps.weight=mxfp4", | |
| "--tensor-type", | |
| "blk.42.ffn_down_exps.weight=mxfp4", | |
| "--imatrix-strict", | |
| "--out", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/.DeepSeek-V4-Flash-0731-DS4-Quality128.building-20260801-161944-54912/DeepSeek-V4-Flash-0731-DS4-Quality128.gguf" | |
| ], | |
| [ | |
| "/Users/andreas/code/3rd-party-repos/ds4-apetersson/gguf-tools/deepseek4-quantize", | |
| "--hf", | |
| "/Volumes/Samsung_4TB/models/DeepSeek-V4-Flash-0731", | |
| "--template", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/inputs/antirez/ca22ae2f838e14077c22bc1c1417b71b45b5e5a3687bd96c2ac6e17fdb6261c0.header-only.sparse.gguf", | |
| "--dspark-support", | |
| "--experts", | |
| "iq2_xxs", | |
| "--routed-w2", | |
| "mxfp4", | |
| "--attention-proj", | |
| "q8_0", | |
| "--shared", | |
| "q8_0", | |
| "--dspark-block-size", | |
| "5", | |
| "--dspark-markov-rank", | |
| "256", | |
| "--dspark-noise-token-id", | |
| "128799", | |
| "--dspark-target-layers", | |
| "40,41,42", | |
| "--threads", | |
| "8", | |
| "--imatrix", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/inputs/ox-ox/DeepSeek-V4-Flash-0731-dspark-alias.dat", | |
| "--out", | |
| "/Users/andreas/Library/Caches/deepseek-model-tools/build128/.DeepSeek-V4-Flash-0731-DS4-Quality128.building-20260801-161944-54912/DeepSeek-V4-Flash-0731-DS4-Quality128-DSpark-support.gguf", | |
| "--imatrix-strict" | |
| ] | |
| ], | |
| "appledouble_excluded": true, | |
| "installation": "internal-stage -> hash-copy to hidden same-volume incoming -> verify -> atomic directory exposure via renameatx_np(RENAME_EXCL); when that kernel no-replace primitive is unsupported (notably exFAT), use a cooperative exclusive sibling lock + destination lstat + same-parent renameat fallback that preserves atomic visibility and refuses every destination observed before rename" | |
| } | |