Instructions to use Hcompany/Holo-3.1-35B-A3B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Hcompany/Holo-3.1-35B-A3B-GGUF")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Hcompany/Holo-3.1-35B-A3B-GGUF", dtype="auto")

llama-cpp-python

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="Hcompany/Holo-3.1-35B-A3B-GGUF",
	filename="imatrix.gguf",
)

llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": [
				{
					"type": "text",
					"text": "Describe this image in one sentence."
				},
				{
					"type": "image_url",
					"image_url": {
						"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
					}
				}
			]
		}
	]
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Use Docker

docker model run hf.co/Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

LM Studio
Jan

vLLM

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Hcompany/Holo-3.1-35B-A3B-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Hcompany/Holo-3.1-35B-A3B-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

SGLang

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Hcompany/Holo-3.1-35B-A3B-GGUF" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Hcompany/Holo-3.1-35B-A3B-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Hcompany/Holo-3.1-35B-A3B-GGUF" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Hcompany/Holo-3.1-35B-A3B-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Ollama
How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Ollama:
```
ollama run hf.co/Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
```

Unsloth Studio

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Hcompany/Holo-3.1-35B-A3B-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Hcompany/Holo-3.1-35B-A3B-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for Hcompany/Holo-3.1-35B-A3B-GGUF to start chatting

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Run Hermes

hermes

Atomic Chat new

OpenClaw new

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Docker Model Runner
How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Docker Model Runner:
```
docker model run hf.co/Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M
```

Lemonade

How to use Hcompany/Holo-3.1-35B-A3B-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Hcompany/Holo-3.1-35B-A3B-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.Holo-3.1-35B-A3B-GGUF-Q4_K_M

List all available models

lemonade list

Holo-3.1-35B-A3B-GGUF

File size: 109,879 Bytes

d6ec177

ggml_cuda_init: found 1 CUDA devices (Total VRAM: 81079 MiB):
  Device 0: NVIDIA H100 80GB HBM3, compute capability 9.0, VMM: yes, VRAM: 81079 MiB
load_backend: loaded CUDA backend from /app/libggml-cuda.so
load_backend: loaded CPU backend from /app/libggml-cpu-haswell.so
llama_print_build_info: build = 9282 (4f0e43da6)
llama_print_build_info: built with GNU 14.2.0 for Linux x86_64
llama_quantize: quantizing '/tmp/q_quant_work/main.bf16.gguf' to '/tmp/q_quant_work/q4_k_m.gguf' as Q4_K_M
llama_model_loader: loaded meta data with 40 key-value pairs and 733 tensors from /tmp/q_quant_work/main.bf16.gguf (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = qwen35moe
llama_model_loader: - kv   1:                               general.type str              = model
llama_model_loader: - kv   2:                     general.sampling.top_k i32              = 20
llama_model_loader: - kv   3:                     general.sampling.top_p f32              = 0.950000
llama_model_loader: - kv   4:                      general.sampling.temp f32              = 1.000000
llama_model_loader: - kv   5:                               general.name str              = Source_Model
llama_model_loader: - kv   6:                         general.size_label str              = 256x2.6B
llama_model_loader: - kv   7:                      qwen35moe.block_count u32              = 40
llama_model_loader: - kv   8:                   qwen35moe.context_length u32              = 262144
llama_model_loader: - kv   9:                 qwen35moe.embedding_length u32              = 2048
llama_model_loader: - kv  10:             qwen35moe.attention.head_count u32              = 16
llama_model_loader: - kv  11:          qwen35moe.attention.head_count_kv u32              = 2
llama_model_loader: - kv  12:          qwen35moe.rope.dimension_sections arr[i32,4]       = [11, 11, 10, 0]
llama_model_loader: - kv  13:                   qwen35moe.rope.freq_base f32              = 10000000.000000
llama_model_loader: - kv  14: qwen35moe.attention.layer_norm_rms_epsilon f32              = 0.000001
llama_model_loader: - kv  15:                     qwen35moe.expert_count u32              = 256
llama_model_loader: - kv  16:                qwen35moe.expert_used_count u32              = 8
llama_model_loader: - kv  17:             qwen35moe.attention.key_length u32              = 256
llama_model_loader: - kv  18:           qwen35moe.attention.value_length u32              = 256
llama_model_loader: - kv  19:                          general.file_type u32              = 32
llama_model_loader: - kv  20:       qwen35moe.expert_feed_forward_length u32              = 512
llama_model_loader: - kv  21: qwen35moe.expert_shared_feed_forward_length u32              = 512
llama_model_loader: - kv  22:                  qwen35moe.ssm.conv_kernel u32              = 4
llama_model_loader: - kv  23:                   qwen35moe.ssm.state_size u32              = 128
llama_model_loader: - kv  24:                  qwen35moe.ssm.group_count u32              = 16
llama_model_loader: - kv  25:               qwen35moe.ssm.time_step_rank u32              = 32
llama_model_loader: - kv  26:                   qwen35moe.ssm.inner_size u32              = 4096
llama_model_loader: - kv  27:          qwen35moe.full_attention_interval u32              = 4
llama_model_loader: - kv  28:             qwen35moe.rope.dimension_count u32              = 64
llama_model_loader: - kv  29:               general.quantization_version u32              = 2
llama_model_loader: - kv  30:                       tokenizer.ggml.model str              = gpt2
llama_model_loader: - kv  31:                         tokenizer.ggml.pre str              = qwen35
llama_model_loader: - kv  32:                      tokenizer.ggml.tokens arr[str,248320]  = ["!", "\"", "#", "$", "%", "&", "'", ...
llama_model_loader: - kv  33:                  tokenizer.ggml.token_type arr[i32,248320]  = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv  34:                      tokenizer.ggml.merges arr[str,247587]  = ["Ġ Ġ", "ĠĠ ĠĠ", "i n", "Ġ t",...
llama_model_loader: - kv  35:                tokenizer.ggml.eos_token_id u32              = 248046
llama_model_loader: - kv  36:            tokenizer.ggml.padding_token_id u32              = 248044
llama_model_loader: - kv  37:                tokenizer.ggml.bos_token_id u32              = 248044
llama_model_loader: - kv  38:               tokenizer.ggml.add_bos_token bool             = false
llama_model_loader: - kv  39:                    tokenizer.chat_template str              = {%- set image_count = namespace(value...
llama_model_loader: - type  f32:  301 tensors
llama_model_loader: - type bf16:  432 tensors

llama_model_quantize_impl: have importance matrix data with 511 entries
[   1/ 733] output.weight                        - [  2048, 248320,      1,      1], type =   bf16, converting to q6_K .. load_imatrix: imatrix datasets=['/data/llama-calibration-dataset/holo3-imatrix-calib.txt']
load_imatrix: loaded 511 importance matrix entries from /tmp/q_quant_work/imatrix.gguf computed on 934 chunks
prepare_imatrix: have 511 importance matrix entries
size =   970.00 MiB ->   397.85 MiB
[   2/ 733] output_norm.weight                   - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[   3/ 733] token_embd.weight                    - [  2048, 248320,      1,      1], type =   bf16, 
====== llama_model_quantize_impl: did not find weights for token_embd.weight
converting to q6_K .. size =   970.00 MiB ->   397.85 MiB
[   4/ 733] blk.0.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[   5/ 733] blk.0.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[   6/ 733] blk.0.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[   7/ 733] blk.0.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[   8/ 733] blk.0.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[   9/ 733] blk.0.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  10/ 733] blk.0.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[  11/ 733] blk.0.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  12/ 733] blk.0.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  13/ 733] blk.0.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  14/ 733] blk.0.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  15/ 733] blk.0.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  16/ 733] blk.0.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  17/ 733] blk.0.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  18/ 733] blk.0.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  19/ 733] blk.0.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[  20/ 733] blk.0.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  21/ 733] blk.0.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[  22/ 733] blk.0.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  23/ 733] blk.1.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  24/ 733] blk.1.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  25/ 733] blk.1.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[  26/ 733] blk.1.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[  27/ 733] blk.1.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[  28/ 733] blk.1.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  29/ 733] blk.1.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[  30/ 733] blk.1.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  31/ 733] blk.1.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  32/ 733] blk.1.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  33/ 733] blk.1.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  34/ 733] blk.1.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  35/ 733] blk.1.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  36/ 733] blk.1.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  37/ 733] blk.1.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  38/ 733] blk.1.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[  39/ 733] blk.1.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  40/ 733] blk.1.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[  41/ 733] blk.1.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  42/ 733] blk.2.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  43/ 733] blk.2.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  44/ 733] blk.2.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[  45/ 733] blk.2.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[  46/ 733] blk.2.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[  47/ 733] blk.2.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  48/ 733] blk.2.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[  49/ 733] blk.2.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  50/ 733] blk.2.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  51/ 733] blk.2.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  52/ 733] blk.2.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  53/ 733] blk.2.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  54/ 733] blk.2.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  55/ 733] blk.2.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  56/ 733] blk.2.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  57/ 733] blk.2.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[  58/ 733] blk.2.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  59/ 733] blk.2.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[  60/ 733] blk.2.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  61/ 733] blk.3.attn_k.weight                  - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  62/ 733] blk.3.attn_k_norm.weight             - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[  63/ 733] blk.3.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  64/ 733] blk.3.attn_output.weight             - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  65/ 733] blk.3.attn_q.weight                  - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[  66/ 733] blk.3.attn_q_norm.weight             - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[  67/ 733] blk.3.attn_v.weight                  - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[  68/ 733] blk.3.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[  69/ 733] blk.3.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[  70/ 733] blk.3.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  71/ 733] blk.3.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[  72/ 733] blk.3.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  73/ 733] blk.3.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  74/ 733] blk.3.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  75/ 733] blk.3.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  76/ 733] blk.3.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  77/ 733] blk.4.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  78/ 733] blk.4.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  79/ 733] blk.4.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[  80/ 733] blk.4.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[  81/ 733] blk.4.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[  82/ 733] blk.4.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  83/ 733] blk.4.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[  84/ 733] blk.4.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  85/ 733] blk.4.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  86/ 733] blk.4.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[  87/ 733] blk.4.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[  88/ 733] blk.4.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  89/ 733] blk.4.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  90/ 733] blk.4.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  91/ 733] blk.4.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[  92/ 733] blk.4.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[  93/ 733] blk.4.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[  94/ 733] blk.4.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[  95/ 733] blk.4.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  96/ 733] blk.5.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[  97/ 733] blk.5.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[  98/ 733] blk.5.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[  99/ 733] blk.5.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 100/ 733] blk.5.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 101/ 733] blk.5.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 102/ 733] blk.5.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 103/ 733] blk.5.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 104/ 733] blk.5.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 105/ 733] blk.5.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 106/ 733] blk.5.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 107/ 733] blk.5.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 108/ 733] blk.5.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 109/ 733] blk.5.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 110/ 733] blk.5.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 111/ 733] blk.5.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 112/ 733] blk.5.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 113/ 733] blk.5.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 114/ 733] blk.5.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 115/ 733] blk.6.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 116/ 733] blk.6.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 117/ 733] blk.6.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 118/ 733] blk.6.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 119/ 733] blk.6.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 120/ 733] blk.6.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 121/ 733] blk.6.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 122/ 733] blk.6.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 123/ 733] blk.6.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 124/ 733] blk.6.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 125/ 733] blk.6.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 126/ 733] blk.6.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 127/ 733] blk.6.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 128/ 733] blk.6.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 129/ 733] blk.6.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 130/ 733] blk.6.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 131/ 733] blk.6.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 132/ 733] blk.6.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 133/ 733] blk.6.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 134/ 733] blk.7.attn_k.weight                  - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 135/ 733] blk.7.attn_k_norm.weight             - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 136/ 733] blk.7.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 137/ 733] blk.7.attn_output.weight             - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 138/ 733] blk.7.attn_q.weight                  - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 139/ 733] blk.7.attn_q_norm.weight             - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 140/ 733] blk.7.attn_v.weight                  - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 141/ 733] blk.7.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 142/ 733] blk.7.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 143/ 733] blk.7.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 144/ 733] blk.7.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 145/ 733] blk.7.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 146/ 733] blk.7.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 147/ 733] blk.7.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 148/ 733] blk.7.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 149/ 733] blk.7.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 150/ 733] blk.8.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 151/ 733] blk.8.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 152/ 733] blk.8.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 153/ 733] blk.8.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 154/ 733] blk.8.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 155/ 733] blk.8.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 156/ 733] blk.8.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 157/ 733] blk.8.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 158/ 733] blk.8.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 159/ 733] blk.8.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 160/ 733] blk.8.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 161/ 733] blk.8.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 162/ 733] blk.8.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 163/ 733] blk.8.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 164/ 733] blk.8.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 165/ 733] blk.8.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 166/ 733] blk.8.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 167/ 733] blk.8.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 168/ 733] blk.8.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 169/ 733] blk.9.attn_gate.weight               - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 170/ 733] blk.9.attn_norm.weight               - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 171/ 733] blk.9.attn_qkv.weight                - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 172/ 733] blk.9.ffn_down_exps.weight           - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 173/ 733] blk.9.ffn_down_shexp.weight          - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 174/ 733] blk.9.ffn_gate_exps.weight           - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 175/ 733] blk.9.ffn_gate_inp.weight            - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 176/ 733] blk.9.ffn_gate_inp_shexp.weight      - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 177/ 733] blk.9.ffn_gate_shexp.weight          - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 178/ 733] blk.9.ffn_up_exps.weight             - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 179/ 733] blk.9.ffn_up_shexp.weight            - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 180/ 733] blk.9.post_attention_norm.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 181/ 733] blk.9.ssm_a                          - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 182/ 733] blk.9.ssm_alpha.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 183/ 733] blk.9.ssm_beta.weight                - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 184/ 733] blk.9.ssm_conv1d.weight              - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 185/ 733] blk.9.ssm_dt.bias                    - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 186/ 733] blk.9.ssm_norm.weight                - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 187/ 733] blk.9.ssm_out.weight                 - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 188/ 733] blk.10.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 189/ 733] blk.10.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 190/ 733] blk.10.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 191/ 733] blk.10.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 192/ 733] blk.10.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 193/ 733] blk.10.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 194/ 733] blk.10.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 195/ 733] blk.10.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 196/ 733] blk.10.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 197/ 733] blk.10.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 198/ 733] blk.10.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 199/ 733] blk.10.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 200/ 733] blk.10.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 201/ 733] blk.10.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 202/ 733] blk.10.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 203/ 733] blk.10.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 204/ 733] blk.10.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 205/ 733] blk.10.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 206/ 733] blk.10.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 207/ 733] blk.11.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 208/ 733] blk.11.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 209/ 733] blk.11.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 210/ 733] blk.11.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 211/ 733] blk.11.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 212/ 733] blk.11.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 213/ 733] blk.11.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 214/ 733] blk.11.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 215/ 733] blk.11.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 216/ 733] blk.11.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 217/ 733] blk.11.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 218/ 733] blk.11.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 219/ 733] blk.11.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 220/ 733] blk.11.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 221/ 733] blk.11.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 222/ 733] blk.11.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 223/ 733] blk.12.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 224/ 733] blk.12.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 225/ 733] blk.12.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 226/ 733] blk.12.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 227/ 733] blk.12.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 228/ 733] blk.12.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 229/ 733] blk.12.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 230/ 733] blk.12.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 231/ 733] blk.12.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 232/ 733] blk.12.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 233/ 733] blk.12.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 234/ 733] blk.12.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 235/ 733] blk.12.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 236/ 733] blk.12.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 237/ 733] blk.12.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 238/ 733] blk.12.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 239/ 733] blk.12.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 240/ 733] blk.12.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 241/ 733] blk.12.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 242/ 733] blk.13.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 243/ 733] blk.13.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 244/ 733] blk.13.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 245/ 733] blk.13.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 246/ 733] blk.13.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 247/ 733] blk.13.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 248/ 733] blk.13.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 249/ 733] blk.13.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 250/ 733] blk.13.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 251/ 733] blk.13.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 252/ 733] blk.13.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 253/ 733] blk.13.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 254/ 733] blk.13.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 255/ 733] blk.13.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 256/ 733] blk.13.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 257/ 733] blk.13.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 258/ 733] blk.13.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 259/ 733] blk.13.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 260/ 733] blk.13.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 261/ 733] blk.14.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 262/ 733] blk.14.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 263/ 733] blk.14.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 264/ 733] blk.14.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 265/ 733] blk.14.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 266/ 733] blk.14.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 267/ 733] blk.14.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 268/ 733] blk.14.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 269/ 733] blk.14.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 270/ 733] blk.14.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 271/ 733] blk.14.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 272/ 733] blk.14.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 273/ 733] blk.14.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 274/ 733] blk.14.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 275/ 733] blk.14.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 276/ 733] blk.14.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 277/ 733] blk.14.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 278/ 733] blk.14.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 279/ 733] blk.14.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 280/ 733] blk.15.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 281/ 733] blk.15.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 282/ 733] blk.15.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 283/ 733] blk.15.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 284/ 733] blk.15.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 285/ 733] blk.15.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 286/ 733] blk.15.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 287/ 733] blk.15.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 288/ 733] blk.15.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 289/ 733] blk.15.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 290/ 733] blk.15.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 291/ 733] blk.15.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 292/ 733] blk.15.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 293/ 733] blk.15.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 294/ 733] blk.15.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 295/ 733] blk.15.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 296/ 733] blk.16.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 297/ 733] blk.16.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 298/ 733] blk.16.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 299/ 733] blk.16.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 300/ 733] blk.16.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 301/ 733] blk.16.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 302/ 733] blk.16.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 303/ 733] blk.16.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 304/ 733] blk.16.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 305/ 733] blk.16.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 306/ 733] blk.16.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 307/ 733] blk.16.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 308/ 733] blk.16.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 309/ 733] blk.16.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 310/ 733] blk.16.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 311/ 733] blk.16.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 312/ 733] blk.16.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 313/ 733] blk.16.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 314/ 733] blk.16.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 315/ 733] blk.17.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 316/ 733] blk.17.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 317/ 733] blk.17.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 318/ 733] blk.17.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 319/ 733] blk.17.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 320/ 733] blk.17.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 321/ 733] blk.17.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 322/ 733] blk.17.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 323/ 733] blk.17.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 324/ 733] blk.17.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 325/ 733] blk.17.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 326/ 733] blk.17.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 327/ 733] blk.17.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 328/ 733] blk.17.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 329/ 733] blk.17.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 330/ 733] blk.17.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 331/ 733] blk.17.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 332/ 733] blk.17.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 333/ 733] blk.17.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 334/ 733] blk.18.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 335/ 733] blk.18.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 336/ 733] blk.18.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 337/ 733] blk.18.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 338/ 733] blk.18.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 339/ 733] blk.18.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 340/ 733] blk.18.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 341/ 733] blk.18.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 342/ 733] blk.18.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 343/ 733] blk.18.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 344/ 733] blk.18.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 345/ 733] blk.18.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 346/ 733] blk.18.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 347/ 733] blk.18.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 348/ 733] blk.18.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 349/ 733] blk.18.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 350/ 733] blk.18.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 351/ 733] blk.18.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 352/ 733] blk.18.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 353/ 733] blk.19.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 354/ 733] blk.19.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 355/ 733] blk.19.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 356/ 733] blk.19.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 357/ 733] blk.19.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 358/ 733] blk.19.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 359/ 733] blk.19.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 360/ 733] blk.19.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 361/ 733] blk.19.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 362/ 733] blk.19.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 363/ 733] blk.19.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 364/ 733] blk.19.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 365/ 733] blk.19.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 366/ 733] blk.19.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 367/ 733] blk.19.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 368/ 733] blk.19.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 369/ 733] blk.20.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 370/ 733] blk.20.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 371/ 733] blk.20.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 372/ 733] blk.20.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 373/ 733] blk.20.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 374/ 733] blk.20.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 375/ 733] blk.20.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 376/ 733] blk.20.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 377/ 733] blk.20.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 378/ 733] blk.20.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 379/ 733] blk.20.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 380/ 733] blk.20.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 381/ 733] blk.20.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 382/ 733] blk.20.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 383/ 733] blk.20.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 384/ 733] blk.20.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 385/ 733] blk.20.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 386/ 733] blk.20.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 387/ 733] blk.20.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 388/ 733] blk.21.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 389/ 733] blk.21.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 390/ 733] blk.21.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 391/ 733] blk.21.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 392/ 733] blk.21.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 393/ 733] blk.21.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 394/ 733] blk.21.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 395/ 733] blk.21.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 396/ 733] blk.21.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 397/ 733] blk.21.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 398/ 733] blk.21.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 399/ 733] blk.21.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 400/ 733] blk.21.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 401/ 733] blk.21.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 402/ 733] blk.21.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 403/ 733] blk.21.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 404/ 733] blk.21.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 405/ 733] blk.21.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 406/ 733] blk.21.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 407/ 733] blk.22.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 408/ 733] blk.22.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 409/ 733] blk.22.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 410/ 733] blk.22.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 411/ 733] blk.22.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 412/ 733] blk.22.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 413/ 733] blk.22.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 414/ 733] blk.22.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 415/ 733] blk.22.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 416/ 733] blk.22.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 417/ 733] blk.22.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 418/ 733] blk.22.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 419/ 733] blk.22.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 420/ 733] blk.22.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 421/ 733] blk.22.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 422/ 733] blk.22.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 423/ 733] blk.22.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 424/ 733] blk.22.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 425/ 733] blk.22.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 426/ 733] blk.23.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 427/ 733] blk.23.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 428/ 733] blk.23.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 429/ 733] blk.23.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 430/ 733] blk.23.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 431/ 733] blk.23.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 432/ 733] blk.23.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 433/ 733] blk.23.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 434/ 733] blk.23.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 435/ 733] blk.23.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 436/ 733] blk.23.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 437/ 733] blk.23.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 438/ 733] blk.23.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 439/ 733] blk.23.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 440/ 733] blk.23.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 441/ 733] blk.23.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 442/ 733] blk.24.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 443/ 733] blk.24.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 444/ 733] blk.24.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 445/ 733] blk.24.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 446/ 733] blk.24.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 447/ 733] blk.24.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 448/ 733] blk.24.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 449/ 733] blk.24.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 450/ 733] blk.24.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 451/ 733] blk.24.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 452/ 733] blk.24.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 453/ 733] blk.24.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 454/ 733] blk.24.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 455/ 733] blk.24.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 456/ 733] blk.24.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 457/ 733] blk.24.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 458/ 733] blk.24.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 459/ 733] blk.24.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 460/ 733] blk.24.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 461/ 733] blk.25.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 462/ 733] blk.25.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 463/ 733] blk.25.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 464/ 733] blk.25.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 465/ 733] blk.25.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 466/ 733] blk.25.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 467/ 733] blk.25.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 468/ 733] blk.25.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 469/ 733] blk.25.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 470/ 733] blk.25.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 471/ 733] blk.25.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 472/ 733] blk.25.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 473/ 733] blk.25.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 474/ 733] blk.25.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 475/ 733] blk.25.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 476/ 733] blk.25.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 477/ 733] blk.25.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 478/ 733] blk.25.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 479/ 733] blk.25.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 480/ 733] blk.26.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 481/ 733] blk.26.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 482/ 733] blk.26.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 483/ 733] blk.26.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 484/ 733] blk.26.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 485/ 733] blk.26.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 486/ 733] blk.26.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 487/ 733] blk.26.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 488/ 733] blk.26.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 489/ 733] blk.26.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 490/ 733] blk.26.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 491/ 733] blk.26.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 492/ 733] blk.26.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 493/ 733] blk.26.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 494/ 733] blk.26.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 495/ 733] blk.26.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 496/ 733] blk.26.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 497/ 733] blk.26.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 498/ 733] blk.26.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 499/ 733] blk.27.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 500/ 733] blk.27.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 501/ 733] blk.27.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 502/ 733] blk.27.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 503/ 733] blk.27.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 504/ 733] blk.27.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 505/ 733] blk.27.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 506/ 733] blk.27.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 507/ 733] blk.27.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 508/ 733] blk.27.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 509/ 733] blk.27.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 510/ 733] blk.27.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 511/ 733] blk.27.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 512/ 733] blk.27.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 513/ 733] blk.27.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 514/ 733] blk.27.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 515/ 733] blk.28.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 516/ 733] blk.28.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 517/ 733] blk.28.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 518/ 733] blk.28.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 519/ 733] blk.28.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 520/ 733] blk.28.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 521/ 733] blk.28.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 522/ 733] blk.28.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 523/ 733] blk.28.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 524/ 733] blk.28.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 525/ 733] blk.28.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 526/ 733] blk.28.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 527/ 733] blk.28.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 528/ 733] blk.28.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 529/ 733] blk.28.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 530/ 733] blk.28.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 531/ 733] blk.28.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 532/ 733] blk.28.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 533/ 733] blk.28.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 534/ 733] blk.29.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 535/ 733] blk.29.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 536/ 733] blk.29.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 537/ 733] blk.29.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 538/ 733] blk.29.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 539/ 733] blk.29.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 540/ 733] blk.29.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 541/ 733] blk.29.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 542/ 733] blk.29.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 543/ 733] blk.29.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 544/ 733] blk.29.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 545/ 733] blk.29.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 546/ 733] blk.29.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 547/ 733] blk.29.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 548/ 733] blk.29.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 549/ 733] blk.29.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 550/ 733] blk.29.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 551/ 733] blk.29.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 552/ 733] blk.29.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 553/ 733] blk.30.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 554/ 733] blk.30.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 555/ 733] blk.30.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 556/ 733] blk.30.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 557/ 733] blk.30.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 558/ 733] blk.30.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 559/ 733] blk.30.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 560/ 733] blk.30.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 561/ 733] blk.30.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 562/ 733] blk.30.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 563/ 733] blk.30.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 564/ 733] blk.30.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 565/ 733] blk.30.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 566/ 733] blk.30.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 567/ 733] blk.30.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 568/ 733] blk.30.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 569/ 733] blk.30.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 570/ 733] blk.30.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 571/ 733] blk.30.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 572/ 733] blk.31.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 573/ 733] blk.31.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 574/ 733] blk.31.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 575/ 733] blk.31.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 576/ 733] blk.31.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 577/ 733] blk.31.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 578/ 733] blk.31.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 579/ 733] blk.31.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 580/ 733] blk.31.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 581/ 733] blk.31.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 582/ 733] blk.31.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 583/ 733] blk.31.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 584/ 733] blk.31.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 585/ 733] blk.31.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 586/ 733] blk.31.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 587/ 733] blk.31.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 588/ 733] blk.32.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 589/ 733] blk.32.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 590/ 733] blk.32.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 591/ 733] blk.32.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 592/ 733] blk.32.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 593/ 733] blk.32.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 594/ 733] blk.32.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 595/ 733] blk.32.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 596/ 733] blk.32.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 597/ 733] blk.32.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 598/ 733] blk.32.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 599/ 733] blk.32.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 600/ 733] blk.32.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 601/ 733] blk.32.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 602/ 733] blk.32.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 603/ 733] blk.32.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 604/ 733] blk.32.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 605/ 733] blk.32.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 606/ 733] blk.32.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 607/ 733] blk.33.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 608/ 733] blk.33.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 609/ 733] blk.33.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 610/ 733] blk.33.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 611/ 733] blk.33.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 612/ 733] blk.33.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 613/ 733] blk.33.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 614/ 733] blk.33.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 615/ 733] blk.33.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 616/ 733] blk.33.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 617/ 733] blk.33.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 618/ 733] blk.33.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 619/ 733] blk.33.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 620/ 733] blk.33.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 621/ 733] blk.33.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 622/ 733] blk.33.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 623/ 733] blk.33.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 624/ 733] blk.33.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 625/ 733] blk.33.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 626/ 733] blk.34.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 627/ 733] blk.34.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 628/ 733] blk.34.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 629/ 733] blk.34.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 630/ 733] blk.34.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 631/ 733] blk.34.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 632/ 733] blk.34.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 633/ 733] blk.34.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 634/ 733] blk.34.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 635/ 733] blk.34.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 636/ 733] blk.34.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 637/ 733] blk.34.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 638/ 733] blk.34.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 639/ 733] blk.34.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 640/ 733] blk.34.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 641/ 733] blk.34.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 642/ 733] blk.34.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 643/ 733] blk.34.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 644/ 733] blk.34.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 645/ 733] blk.35.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 646/ 733] blk.35.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 647/ 733] blk.35.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 648/ 733] blk.35.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 649/ 733] blk.35.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 650/ 733] blk.35.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 651/ 733] blk.35.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 652/ 733] blk.35.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 653/ 733] blk.35.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 654/ 733] blk.35.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 655/ 733] blk.35.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 656/ 733] blk.35.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 657/ 733] blk.35.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 658/ 733] blk.35.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 659/ 733] blk.35.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 660/ 733] blk.35.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 661/ 733] blk.36.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 662/ 733] blk.36.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 663/ 733] blk.36.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 664/ 733] blk.36.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 665/ 733] blk.36.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 666/ 733] blk.36.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 667/ 733] blk.36.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 668/ 733] blk.36.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 669/ 733] blk.36.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 670/ 733] blk.36.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 671/ 733] blk.36.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 672/ 733] blk.36.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 673/ 733] blk.36.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 674/ 733] blk.36.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 675/ 733] blk.36.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 676/ 733] blk.36.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 677/ 733] blk.36.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 678/ 733] blk.36.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 679/ 733] blk.36.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 680/ 733] blk.37.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 681/ 733] blk.37.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 682/ 733] blk.37.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 683/ 733] blk.37.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 684/ 733] blk.37.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 685/ 733] blk.37.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 686/ 733] blk.37.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 687/ 733] blk.37.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 688/ 733] blk.37.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 689/ 733] blk.37.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 690/ 733] blk.37.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 691/ 733] blk.37.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 692/ 733] blk.37.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 693/ 733] blk.37.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 694/ 733] blk.37.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 695/ 733] blk.37.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 696/ 733] blk.37.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 697/ 733] blk.37.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 698/ 733] blk.37.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 699/ 733] blk.38.attn_gate.weight              - [  2048,   4096,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 700/ 733] blk.38.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 701/ 733] blk.38.attn_qkv.weight               - [  2048,   8192,      1,      1], type =   bf16, converting to q6_K .. size =    32.00 MiB ->    13.12 MiB
[ 702/ 733] blk.38.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 703/ 733] blk.38.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 704/ 733] blk.38.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 705/ 733] blk.38.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 706/ 733] blk.38.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 707/ 733] blk.38.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 708/ 733] blk.38.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 709/ 733] blk.38.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 710/ 733] blk.38.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 711/ 733] blk.38.ssm_a                         - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 712/ 733] blk.38.ssm_alpha.weight              - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 713/ 733] blk.38.ssm_beta.weight               - [  2048,     32,      1,      1], type =   bf16, converting to q4_K .. size =     0.12 MiB ->     0.04 MiB
[ 714/ 733] blk.38.ssm_conv1d.weight             - [     4,   8192,      1,      1], type =    f32, size =    0.125 MiB
[ 715/ 733] blk.38.ssm_dt.bias                   - [    32,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 716/ 733] blk.38.ssm_norm.weight               - [   128,      1,      1,      1], type =    f32, size =    0.000 MiB
[ 717/ 733] blk.38.ssm_out.weight                - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 718/ 733] blk.39.attn_k.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 719/ 733] blk.39.attn_k_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 720/ 733] blk.39.attn_norm.weight              - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 721/ 733] blk.39.attn_output.weight            - [  4096,   2048,      1,      1], type =   bf16, converting to q4_K .. size =    16.00 MiB ->     4.50 MiB
[ 722/ 733] blk.39.attn_q.weight                 - [  2048,   8192,      1,      1], type =   bf16, converting to q4_K .. size =    32.00 MiB ->     9.00 MiB
[ 723/ 733] blk.39.attn_q_norm.weight            - [   256,      1,      1,      1], type =    f32, size =    0.001 MiB
[ 724/ 733] blk.39.attn_v.weight                 - [  2048,    512,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 725/ 733] blk.39.ffn_down_exps.weight          - [   512,   2048,    256,      1], type =   bf16, converting to q6_K .. size =   512.00 MiB ->   210.00 MiB
[ 726/ 733] blk.39.ffn_down_shexp.weight         - [   512,   2048,      1,      1], type =   bf16, converting to q6_K .. size =     2.00 MiB ->     0.82 MiB
[ 727/ 733] blk.39.ffn_gate_exps.weight          - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 728/ 733] blk.39.ffn_gate_inp.weight           - [  2048,    256,      1,      1], type =    f32, size =    2.000 MiB
[ 729/ 733] blk.39.ffn_gate_inp_shexp.weight     - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
[ 730/ 733] blk.39.ffn_gate_shexp.weight         - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 731/ 733] blk.39.ffn_up_exps.weight            - [  2048,    512,    256,      1], type =   bf16, converting to q4_K .. size =   512.00 MiB ->   144.00 MiB
[ 732/ 733] blk.39.ffn_up_shexp.weight           - [  2048,    512,      1,      1], type =   bf16, converting to q4_K .. size =     2.00 MiB ->     0.56 MiB
[ 733/ 733] blk.39.post_attention_norm.weight    - [  2048,      1,      1,      1], type =    f32, size =    0.008 MiB
llama_model_quantize_impl: model size  = 66152.24 MiB (16.01 BPW)
llama_model_quantize_impl: quant size  = 20300.75 MiB (4.91 BPW)

llama_quantize: quantize time = 335138.39 ms
llama_quantize:    total time = 335138.39 ms