AutomatosX commited on
Commit
669dda7
·
verified ·
1 Parent(s): a41e012

Promote audited AXQuant v2 artifact at stable repository name

Browse files

Preserve backward-compatible repository identity; v1 remains tagged legacy-pre-v2 and this exact revision is tagged v2 after verification.

README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  license: apache-2.0
3
  library_name: mlx
4
- base_model: mistralai/Ministral-3-14B-Instruct-2512
5
  base_model_relation: quantized
6
  pipeline_tag: text-generation
7
  tags:
@@ -15,39 +15,45 @@ tags:
15
  - mistral3
16
  - 4bit
17
  - 4-bit
 
 
18
  ---
19
 
20
  # AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit
21
 
22
  An **AXQuant (AXQ)** mixed-precision MLX checkpoint for Apple Silicon, converted directly from
23
- the BF16 source model. The language path is quantized under AXQuant protection floors (embeddings, norms, and other protected tensors remain higher precision).
24
 
25
  > **Development evidence — not a certified AXQuant release.** This package has conversion and
26
  > artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
27
  > or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
28
 
 
 
 
29
  ## Model details
30
 
31
  | Property | Value |
32
  | --- | --- |
33
- | Base model | [mistralai/Ministral-3-14B-Instruct-2512](https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512) |
34
- | Source revision | `unrecorded` |
35
  | Product family | `mistral3` |
36
  | Source architecture | `Mistral3ForConditionalGeneration` (dense); text path optimized |
37
- | Main-model parameters | 13.51B logical parameters |
38
- | Quantizer | AXQuant `1.0.1` |
39
  | Hub budget class | `4bit` |
40
- | AXQuant base precision class | `4bit` |
41
- | Planned storage-adjusted BPW | 5.2798 |
42
- | Measured main-model BPW | 5.2799 |
43
- | Measured total BPW | **5.2799** |
44
- | Safetensors weight size | 8.91 GB |
45
- | Approximate complete download | 8.93 GB |
 
46
  | Configured maximum context | 262,144 tokens; practical limits depend on unified memory |
47
- | Primary runtime | AX Engine, compatibility level A |
48
- | Compatible runtime | MLX-LM standard text inference, compatibility level B |
49
  | MTP present | `False` |
50
- | Vision sidecar present | `False` |
51
 
52
  This repository contains MLX Safetensors. It does **not** contain PyTorch or GGUF weights.
53
 
@@ -63,7 +69,7 @@ protected models.
63
  | Sibling | Intended trade-off |
64
  | --- | --- |
65
  | [4bit sibling](https://huggingface.co/AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
66
- | [6bit sibling](https://huggingface.co/AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-6bit) | Higher average precision near a 6-BPW budget |
67
 
68
  See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
69
  for related MLX and OptiQ alternatives.
@@ -75,7 +81,7 @@ python -m pip install -U huggingface_hub
75
  hf download AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit --local-dir ./AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit
76
  ```
77
 
78
- Allow at least 8.93 GB of free disk space. Pin the resulting Hub commit in reproducible
79
  deployments rather than relying indefinitely on `main`.
80
 
81
  ## Run with MLX-LM
@@ -94,32 +100,26 @@ metadata and optional sidecars (`vision.safetensors`, `mtp.safetensors`); this c
94
  does not establish MTP acceleration or vision-language quality. The artifact records MLX
95
  `0.32.0` and MLX-LM `0.31.3` from conversion.
96
 
97
- ## Serve with AX Engine
98
 
99
- After installing [AX Engine](https://github.com/defai-digital/ax-engine), download the complete
100
- repository and serve the local directory:
101
-
102
- ```bash
103
- ax-engine serve ./AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit --port 31418
104
- ```
105
-
106
- AX Engine is the authority for the AXQ runtime contract.
107
- This development package does not claim runtime speedups until identical-checkpoint benchmarks are
108
- published. The artifact records AX Engine version `not recorded`. Native
109
- `model-manifest.json` status: not included.
110
 
111
  ## Quantization layout
112
 
113
  | Main-weight precision | Parameters | Share |
114
  | --- | ---: | ---: |
115
- | `4bit` | 12.16B | 90.06% |
116
- | `8bit` | 671.09M | 4.97% |
117
- | `bf16` | 671.50M | 4.97% |
118
 
119
  - Quantization methods: `affine, bf16`.
120
  - Group sizes used by quantized assignments: `32, 64`.
121
  - MTP sidecar: not included.
122
- - Vision sidecar: not included.
123
  - Optimization scope: `text-path`.
124
  - Support tier: `convertible`.
125
 
@@ -137,7 +137,7 @@ establish MTP acceleration or vision-language quality.
137
  | Quality versus BF16 or uniform baselines | Not published; no quality-retention claim |
138
  | MTP acceptance and speed | not measured; no MTP speedup claim |
139
  | AX Engine kernel evidence | `unmeasured` |
140
- | Vision-language quality | Not applicable (no vision sidecar in this package) |
141
  | Long-context quality | 262,144-token capacity is config metadata, not a validated claim |
142
  | Release certification | **Not certified**; formal AXQuant M0-M8 gates are not closed |
143
 
@@ -148,7 +148,10 @@ establish MTP acceleration or vision-language quality.
148
  KV-cache policy, runtime buffers, and other processes using unified memory.
149
  - Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
150
  model quality.
 
151
  - The configured context window can require substantially more memory as the KV cache grows.
 
 
152
  - Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
153
 
154
  ## Provenance and audit files
@@ -158,7 +161,8 @@ establish MTP acceleration or vision-language quality.
158
  - [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
159
  - [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
160
  fallback records.
161
- - [`axquant_runtime.json`](axquant_runtime.json): AX Engine and MLX-LM compatibility contract.
 
162
 
163
  All published provenance uses repository-relative paths. Local source paths are stripped before
164
  publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
@@ -168,5 +172,5 @@ identical BPW or quality.
168
  ## License
169
 
170
  The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
171
- the [mistralai/Ministral-3-14B-Instruct-2512 model card](https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512) for license terms, model
172
  limitations, and responsible-use guidance.
 
1
  ---
2
  license: apache-2.0
3
  library_name: mlx
4
+ base_model: mistralai/Ministral-3-14B-Instruct-2512-BF16
5
  base_model_relation: quantized
6
  pipeline_tag: text-generation
7
  tags:
 
15
  - mistral3
16
  - 4bit
17
  - 4-bit
18
+ - v2
19
+ - vision
20
  ---
21
 
22
  # AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit
23
 
24
  An **AXQuant (AXQ)** mixed-precision MLX checkpoint for Apple Silicon, converted directly from
25
+ the BF16 source model. The language path is quantized while the vision tower are preserved as BF16 sidecars when present.
26
 
27
  > **Development evidence — not a certified AXQuant release.** This package has conversion and
28
  > artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
29
  > or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
30
 
31
+ > **Stable-name v2.** `main` serves the audited v2 artifact for backward compatibility. The same revision is tagged `v2`; the replaced artifact remains recoverable at `legacy-pre-v2`.
32
+
33
+
34
  ## Model details
35
 
36
  | Property | Value |
37
  | --- | --- |
38
+ | Base model | [mistralai/Ministral-3-14B-Instruct-2512-BF16](https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512-BF16/tree/3cea74c1ebaf5ce5f5a2553de470e2ceab825142) |
39
+ | Source revision | `3cea74c1ebaf5ce5f5a2553de470e2ceab825142` |
40
  | Product family | `mistral3` |
41
  | Source architecture | `Mistral3ForConditionalGeneration` (dense); text path optimized |
42
+ | Main-model parameters | 13.95B logical parameters |
43
+ | Quantizer | AXQuant `1.2.0` |
44
  | Hub budget class | `4bit` |
45
+ | Artifact edition | `v2` |
46
+ | AXQuant base precision class | `5p6bpw` |
47
+ | Planned storage-adjusted BPW | 5.6099 |
48
+ | Measured main-model BPW | 5.6100 |
49
+ | Measured total BPW | **5.6100** |
50
+ | Safetensors weight size | 9.78 GB |
51
+ | Approximate complete download | 9.80 GB |
52
  | Configured maximum context | 262,144 tokens; practical limits depend on unified memory |
53
+ | MLX-LM compatibility | Standard text inference, compatibility level B |
54
+ | AX Engine native execution | Not established; no validated native manifest is included |
55
  | MTP present | `False` |
56
+ | Vision sidecar present | `True` |
57
 
58
  This repository contains MLX Safetensors. It does **not** contain PyTorch or GGUF weights.
59
 
 
69
  | Sibling | Intended trade-off |
70
  | --- | --- |
71
  | [4bit sibling](https://huggingface.co/AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
72
+ | [6bit sibling](https://huggingface.co/AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-6bit) | Higher average precision near the 6-BPW budget |
73
 
74
  See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
75
  for related MLX and OptiQ alternatives.
 
81
  hf download AutomatosX/AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit --local-dir ./AX-Ministral-3-14B-Instruct-2512-MLX-AXQ-4bit
82
  ```
83
 
84
+ Allow at least 9.80 GB of free disk space. Pin the resulting Hub commit in reproducible
85
  deployments rather than relying indefinitely on `main`.
86
 
87
  ## Run with MLX-LM
 
100
  does not establish MTP acceleration or vision-language quality. The artifact records MLX
101
  `0.32.0` and MLX-LM `0.31.3` from conversion.
102
 
103
+ ## AX Engine status
104
 
105
+ This package does **not** include a validated native `model-manifest.json`, so AX Engine execution
106
+ is not established by this release. The AX Engine fields in `axquant_runtime.json` describe the
107
+ intended compatibility contract, not observed runtime evidence. Use the MLX-LM path above for
108
+ standard text/backbone inference. The artifact records AX Engine version
109
+ `not recorded`, but version discovery alone is not a runtime check.
 
 
 
 
 
 
110
 
111
  ## Quantization layout
112
 
113
  | Main-weight precision | Parameters | Share |
114
  | --- | ---: | ---: |
115
+ | `4bit` | 12.16B | 87.22% |
116
+ | `8bit` | 671.09M | 4.81% |
117
+ | `bf16` | 1.11B | 7.96% |
118
 
119
  - Quantization methods: `affine, bf16`.
120
  - Group sizes used by quantized assignments: `32, 64`.
121
  - MTP sidecar: not included.
122
+ - Vision sidecar: 222 tensors, 438.96M parameters, 0.88 GB, BF16.
123
  - Optimization scope: `text-path`.
124
  - Support tier: `convertible`.
125
 
 
137
  | Quality versus BF16 or uniform baselines | Not published; no quality-retention claim |
138
  | MTP acceptance and speed | not measured; no MTP speedup claim |
139
  | AX Engine kernel evidence | `unmeasured` |
140
+ | Vision-language quality | Not evaluated or claimed; vision tensors are preserved at BF16 |
141
  | Long-context quality | 262,144-token capacity is config metadata, not a validated claim |
142
  | Release certification | **Not certified**; formal AXQuant M0-M8 gates are not closed |
143
 
 
148
  KV-cache policy, runtime buffers, and other processes using unified memory.
149
  - Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
150
  model quality.
151
+ - Vision weights are byte-preserved at BF16, but this release does not claim validated VLM quality.
152
  - The configured context window can require substantially more memory as the KV cache grows.
153
+ - AX Engine execution is not established because this package has no validated native manifest.
154
+
155
  - Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
156
 
157
  ## Provenance and audit files
 
161
  - [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
162
  - [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
163
  fallback records.
164
+ - [`axquant_runtime.json`](axquant_runtime.json): declared AX Engine and MLX-LM compatibility metadata; runtime checks remain separate evidence.
165
+ - [`axquant_vision_sidecar_manifest.json`](axquant_vision_sidecar_manifest.json): protected vision tensor provenance.
166
 
167
  All published provenance uses repository-relative paths. Local source paths are stripped before
168
  publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
 
172
  ## License
173
 
174
  The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
175
+ the [mistralai/Ministral-3-14B-Instruct-2512-BF16 model card](https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512-BF16/tree/3cea74c1ebaf5ce5f5a2553de470e2ceab825142) for license terms, model
176
  limitations, and responsible-use guidance.
axquant_manifest.json CHANGED
@@ -1,28 +1,33 @@
1
  {
2
- "axquant_version": "1.0.1",
3
  "calibration": null,
4
- "created_at": "2026-08-02T19:52:56.105649Z",
5
- "effective_bpw": 5.279832291155292,
6
  "files": [
7
  {
8
  "path": "README.md",
9
- "sha256": "efee8e591496ed537a3fc7d0e8d2090a6fbefd03d670ef7fbaacb087b34befff",
10
- "size_bytes": 7456
11
  },
12
  {
13
  "path": "axquant_plan.json",
14
- "sha256": "02b20463cc90ca81dcd03492b246ab9b7f4c97bed3f248052deee83105b74144",
15
- "size_bytes": 347258
16
  },
17
  {
18
  "path": "axquant_quantizer_execution.json",
19
- "sha256": "c97f9283ba562ba735d4cefc191e35f7b7964318b9325c08d5ebd47fd0e2a76e",
20
  "size_bytes": 72744
21
  },
22
  {
23
  "path": "axquant_runtime.json",
24
- "sha256": "5715430cce19e6ec6627c9d8e4d07c96cb935cf21582561db7734b22480f6042",
25
- "size_bytes": 1643
 
 
 
 
 
26
  },
27
  {
28
  "path": "chat_template.jinja",
@@ -31,8 +36,8 @@
31
  },
32
  {
33
  "path": "config.json",
34
- "sha256": "d444f78fddd3e95b0f2a18725a0ac72a923b79deb3adbe9f75b9b2abd1a92342",
35
- "size_bytes": 87042
36
  },
37
  {
38
  "path": "generation_config.json",
@@ -41,36 +46,41 @@
41
  },
42
  {
43
  "path": "model-00001-of-00002.safetensors",
44
- "sha256": "2581a3f8a5beb43f361c0dd2886cdff436bdbad90a2b46ca3e13864e3b1e1f41",
45
  "size_bytes": 5361479864
46
  },
47
  {
48
  "path": "model-00002-of-00002.safetensors",
49
- "sha256": "7e6eba9b62bd4e3ed0035efc5254d961768e21915feb6c9adc84c52c6d91561d",
50
- "size_bytes": 3552365268
51
  },
52
  {
53
  "path": "model.safetensors.index.json",
54
- "sha256": "56d962482ac45a61674b07033f2a8b5a9ef1106568eddc5148dfcaa789132e9e",
55
  "size_bytes": 93118
56
  },
57
  {
58
  "path": "tokenizer.json",
59
- "sha256": "99cf274236c60277fcfad861a5a1007518687ad06ba8938760f50b55ffa0b1ef",
60
- "size_bytes": 17077420
61
  },
62
  {
63
  "path": "tokenizer_config.json",
64
- "sha256": "790c3e17aefff6a4e0daca94a2dfbb17d4db65df0421ed3bc7759cda526b93c2",
65
- "size_bytes": 21222
 
 
 
 
 
66
  }
67
  ],
68
  "format": "mlx",
69
- "logical_parameters": 13506073600,
70
- "main_logical_parameters": 13506073600,
71
- "main_weight_file_size_bytes": 8913845132,
72
- "measured_main_bpw": 5.2799031878517235,
73
- "measured_total_bpw": 5.2799031878517235,
74
  "mtp_acceptance_retention": null,
75
  "mtp_distribution": {},
76
  "mtp_measured_speedup": null,
@@ -88,9 +98,9 @@
88
  },
89
  "mtp_present": false,
90
  "mtp_weight_file_size_bytes": 0,
91
- "plan_sha256": "864e1704f89086e16e8e8b124ef72e348aea1b7ad863e8dd1a6af299af74e835",
92
  "profile": "general",
93
- "protected_weight_file_size_bytes": 0,
94
  "quantizer": "axquant",
95
  "runtime": {
96
  "ax_engine": {
@@ -104,7 +114,7 @@
104
  {
105
  "compatibility_level": "B",
106
  "manifest": "config.json",
107
- "mtp_support": "runtime-dependent",
108
  "name": "mlx-lm",
109
  "notes": [
110
  "Standard backbone inference is the compatibility target.",
@@ -115,7 +125,7 @@
115
  "support_level": "standard-inference"
116
  }
117
  ],
118
- "created_at": "2026-08-02T19:52:51.472949Z",
119
  "kv_cache": null,
120
  "memory_policy": {
121
  "kv_cache_precision": "runtime-default",
@@ -139,7 +149,7 @@
139
  "primary_runtime": {
140
  "compatibility_level": "A",
141
  "manifest": "model-manifest.json",
142
- "mtp_support": "native",
143
  "name": "ax-engine",
144
  "notes": [
145
  "Runtime claims require a passing AX Engine doctor and benchmark report."
@@ -153,7 +163,7 @@
153
  "schema_version": "axquant.artifact.v2",
154
  "software_versions": {
155
  "ax_engine": null,
156
- "axquant": "1.0.1",
157
  "mlx": "0.32.0",
158
  "mlx_lm": "0.31.3",
159
  "pydantic": "2.13.4",
@@ -164,23 +174,23 @@
164
  "architecture": "Mistral3ForConditionalGeneration",
165
  "format": "mlx",
166
  "local_path": null,
167
- "model_id": "mistralai/Ministral-3-14B-Instruct-2512",
168
- "revision": null
169
  },
170
- "target_class": "4bit",
171
  "weight_distribution": {
172
  "4bit": {
173
- "fraction": 0.9005934633733967,
174
  "parameters": 12163481600
175
  },
176
  "8bit": {
177
- "fraction": 0.049687915220601196,
178
  "parameters": 671088640
179
  },
180
  "bf16": {
181
- "fraction": 0.04971862140600211,
182
- "parameters": 671503360
183
  }
184
  },
185
- "weight_file_size_bytes": 8913845132
186
  }
 
1
  {
2
+ "axquant_version": "1.2.0",
3
  "calibration": null,
4
+ "created_at": "2026-08-05T08:00:33.026860Z",
5
+ "effective_bpw": 5.6099475738157665,
6
  "files": [
7
  {
8
  "path": "README.md",
9
+ "sha256": "a5d1b0bda06d65e19f39437a968aca94f352d5a96bbbeccd040028f508dca66b",
10
+ "size_bytes": 8160
11
  },
12
  {
13
  "path": "axquant_plan.json",
14
+ "sha256": "68ff3d56821c0889b33c00297e0294172d93a59b8b69c1682e2c15eba94118b9",
15
+ "size_bytes": 544082
16
  },
17
  {
18
  "path": "axquant_quantizer_execution.json",
19
+ "sha256": "da8577ee59f6ac1ceef0b02b00a71d598baa6d607bd2af7b24d425c2c8fa0889",
20
  "size_bytes": 72744
21
  },
22
  {
23
  "path": "axquant_runtime.json",
24
+ "sha256": "3de6aeff0857f7bd58c76faaa75e20abfe32e3e8a3e13b746faaffd1fa05c9ae",
25
+ "size_bytes": 1628
26
+ },
27
+ {
28
+ "path": "axquant_vision_sidecar_manifest.json",
29
+ "sha256": "6e85bdfca944a1c61568958002d47f0c1c8e9a244af3c5e1b6642fb865b8af72",
30
+ "size_bytes": 916
31
  },
32
  {
33
  "path": "chat_template.jinja",
 
36
  },
37
  {
38
  "path": "config.json",
39
+ "sha256": "06e149fad49a02a9763f64902f4d06378ba52f59650dc2a7cff7b94b662b525c",
40
+ "size_bytes": 72666
41
  },
42
  {
43
  "path": "generation_config.json",
 
46
  },
47
  {
48
  "path": "model-00001-of-00002.safetensors",
49
+ "sha256": "f11db713f005b3eee6389231907ec6aa4679de7852df665e926b7178f96a9f86",
50
  "size_bytes": 5361479864
51
  },
52
  {
53
  "path": "model-00002-of-00002.safetensors",
54
+ "sha256": "b53c1dd8a5203e504fb3bc7f71adca58727adc7340fccbdb8a78ad312cb170f5",
55
+ "size_bytes": 3539585712
56
  },
57
  {
58
  "path": "model.safetensors.index.json",
59
+ "sha256": "9dede08d899bc5c3baf5b55bf7f68999d8ec5c3c687bc17936b9a7fd96387308",
60
  "size_bytes": 93118
61
  },
62
  {
63
  "path": "tokenizer.json",
64
+ "sha256": "d5f6046775b112f0e2d456ee9dba450684ab964fe5c4e231599bdc6773028135",
65
+ "size_bytes": 17078128
66
  },
67
  {
68
  "path": "tokenizer_config.json",
69
+ "sha256": "39f05766964b37275aa5e64fc812f3dbc7610cc6b2653fd5b6f7cf565ad94284",
70
+ "size_bytes": 468
71
+ },
72
+ {
73
+ "path": "vision.safetensors",
74
+ "sha256": "b1ae78df075fefa8f9e6eb5f157640530efd1bc51c5d07239145fa61a67d09ad",
75
+ "size_bytes": 877945912
76
  }
77
  ],
78
  "format": "mlx",
79
+ "logical_parameters": 13945031680,
80
+ "main_logical_parameters": 13945031680,
81
+ "main_weight_file_size_bytes": 9779011488,
82
+ "measured_main_bpw": 5.610033286349623,
83
+ "measured_total_bpw": 5.610033286349623,
84
  "mtp_acceptance_retention": null,
85
  "mtp_distribution": {},
86
  "mtp_measured_speedup": null,
 
98
  },
99
  "mtp_present": false,
100
  "mtp_weight_file_size_bytes": 0,
101
+ "plan_sha256": "b16e4310e1401539e785d2b2ffaab5bb0427ec7ab693cd96ff552b0a7ce6ef87",
102
  "profile": "general",
103
+ "protected_weight_file_size_bytes": 877945912,
104
  "quantizer": "axquant",
105
  "runtime": {
106
  "ax_engine": {
 
114
  {
115
  "compatibility_level": "B",
116
  "manifest": "config.json",
117
+ "mtp_support": "none",
118
  "name": "mlx-lm",
119
  "notes": [
120
  "Standard backbone inference is the compatibility target.",
 
125
  "support_level": "standard-inference"
126
  }
127
  ],
128
+ "created_at": "2026-08-05T08:00:22.646438Z",
129
  "kv_cache": null,
130
  "memory_policy": {
131
  "kv_cache_precision": "runtime-default",
 
149
  "primary_runtime": {
150
  "compatibility_level": "A",
151
  "manifest": "model-manifest.json",
152
+ "mtp_support": "none",
153
  "name": "ax-engine",
154
  "notes": [
155
  "Runtime claims require a passing AX Engine doctor and benchmark report."
 
163
  "schema_version": "axquant.artifact.v2",
164
  "software_versions": {
165
  "ax_engine": null,
166
+ "axquant": "1.2.0",
167
  "mlx": "0.32.0",
168
  "mlx_lm": "0.31.3",
169
  "pydantic": "2.13.4",
 
174
  "architecture": "Mistral3ForConditionalGeneration",
175
  "format": "mlx",
176
  "local_path": null,
177
+ "model_id": "mistralai/Ministral-3-14B-Instruct-2512-BF16",
178
+ "revision": "3cea74c1ebaf5ce5f5a2553de470e2ceab825142"
179
  },
180
+ "target_class": "5p6bpw",
181
  "weight_distribution": {
182
  "4bit": {
183
+ "fraction": 0.8722448165854579,
184
  "parameters": 12163481600
185
  },
186
  "8bit": {
187
+ "fraction": 0.0481238519495425,
188
  "parameters": 671088640
189
  },
190
  "bf16": {
191
+ "fraction": 0.07963133146499958,
192
+ "parameters": 1110461440
193
  }
194
  },
195
+ "weight_file_size_bytes": 9779011488
196
  }
axquant_plan.json CHANGED
The diff for this file is too large to render. See raw diff
 
axquant_quantizer_execution.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
- "created_at": "2026-08-02T19:52:51.464543Z",
3
- "plan_sha256": "864e1704f89086e16e8e8b124ef72e348aea1b7ad863e8dd1a6af299af74e835",
4
  "records": [
5
  {
6
  "bits": 8,
@@ -298,7 +298,7 @@
298
  "group_size": 64,
299
  "metadata": {},
300
  "method": "affine",
301
- "module_path": "language_model.model.layers.4.mlp.down_proj",
302
  "note": "MLX-LM affine packing",
303
  "success": true
304
  },
@@ -308,7 +308,7 @@
308
  "group_size": 64,
309
  "metadata": {},
310
  "method": "affine",
311
- "module_path": "language_model.model.layers.4.mlp.gate_proj",
312
  "note": "MLX-LM affine packing",
313
  "success": true
314
  },
@@ -318,7 +318,7 @@
318
  "group_size": 64,
319
  "metadata": {},
320
  "method": "affine",
321
- "module_path": "language_model.model.layers.4.mlp.up_proj",
322
  "note": "MLX-LM affine packing",
323
  "success": true
324
  },
@@ -328,7 +328,7 @@
328
  "group_size": 64,
329
  "metadata": {},
330
  "method": "affine",
331
- "module_path": "language_model.model.layers.4.self_attn.k_proj",
332
  "note": "MLX-LM affine packing",
333
  "success": true
334
  },
@@ -338,7 +338,7 @@
338
  "group_size": 64,
339
  "metadata": {},
340
  "method": "affine",
341
- "module_path": "language_model.model.layers.4.self_attn.o_proj",
342
  "note": "MLX-LM affine packing",
343
  "success": true
344
  },
@@ -348,7 +348,7 @@
348
  "group_size": 64,
349
  "metadata": {},
350
  "method": "affine",
351
- "module_path": "language_model.model.layers.4.self_attn.q_proj",
352
  "note": "MLX-LM affine packing",
353
  "success": true
354
  },
@@ -358,7 +358,7 @@
358
  "group_size": 64,
359
  "metadata": {},
360
  "method": "affine",
361
- "module_path": "language_model.model.layers.4.self_attn.v_proj",
362
  "note": "MLX-LM affine packing",
363
  "success": true
364
  },
@@ -368,7 +368,7 @@
368
  "group_size": 64,
369
  "metadata": {},
370
  "method": "affine",
371
- "module_path": "language_model.model.layers.5.mlp.down_proj",
372
  "note": "MLX-LM affine packing",
373
  "success": true
374
  },
@@ -378,7 +378,7 @@
378
  "group_size": 64,
379
  "metadata": {},
380
  "method": "affine",
381
- "module_path": "language_model.model.layers.5.mlp.gate_proj",
382
  "note": "MLX-LM affine packing",
383
  "success": true
384
  },
@@ -388,7 +388,7 @@
388
  "group_size": 64,
389
  "metadata": {},
390
  "method": "affine",
391
- "module_path": "language_model.model.layers.5.mlp.up_proj",
392
  "note": "MLX-LM affine packing",
393
  "success": true
394
  },
@@ -398,7 +398,7 @@
398
  "group_size": 64,
399
  "metadata": {},
400
  "method": "affine",
401
- "module_path": "language_model.model.layers.5.self_attn.k_proj",
402
  "note": "MLX-LM affine packing",
403
  "success": true
404
  },
@@ -408,7 +408,7 @@
408
  "group_size": 64,
409
  "metadata": {},
410
  "method": "affine",
411
- "module_path": "language_model.model.layers.5.self_attn.o_proj",
412
  "note": "MLX-LM affine packing",
413
  "success": true
414
  },
@@ -418,7 +418,7 @@
418
  "group_size": 64,
419
  "metadata": {},
420
  "method": "affine",
421
- "module_path": "language_model.model.layers.5.self_attn.q_proj",
422
  "note": "MLX-LM affine packing",
423
  "success": true
424
  },
@@ -428,7 +428,7 @@
428
  "group_size": 64,
429
  "metadata": {},
430
  "method": "affine",
431
- "module_path": "language_model.model.layers.5.self_attn.v_proj",
432
  "note": "MLX-LM affine packing",
433
  "success": true
434
  },
@@ -438,7 +438,7 @@
438
  "group_size": 64,
439
  "metadata": {},
440
  "method": "affine",
441
- "module_path": "language_model.model.layers.6.mlp.gate_proj",
442
  "note": "MLX-LM affine packing",
443
  "success": true
444
  },
@@ -448,7 +448,7 @@
448
  "group_size": 64,
449
  "metadata": {},
450
  "method": "affine",
451
- "module_path": "language_model.model.layers.6.self_attn.k_proj",
452
  "note": "MLX-LM affine packing",
453
  "success": true
454
  },
@@ -458,7 +458,7 @@
458
  "group_size": 64,
459
  "metadata": {},
460
  "method": "affine",
461
- "module_path": "language_model.model.layers.6.self_attn.o_proj",
462
  "note": "MLX-LM affine packing",
463
  "success": true
464
  },
@@ -468,7 +468,7 @@
468
  "group_size": 64,
469
  "metadata": {},
470
  "method": "affine",
471
- "module_path": "language_model.model.layers.6.self_attn.q_proj",
472
  "note": "MLX-LM affine packing",
473
  "success": true
474
  },
@@ -478,7 +478,7 @@
478
  "group_size": 64,
479
  "metadata": {},
480
  "method": "affine",
481
- "module_path": "language_model.model.layers.6.self_attn.v_proj",
482
  "note": "MLX-LM affine packing",
483
  "success": true
484
  },
@@ -488,7 +488,7 @@
488
  "group_size": 64,
489
  "metadata": {},
490
  "method": "affine",
491
- "module_path": "language_model.model.layers.10.mlp.down_proj",
492
  "note": "MLX-LM affine packing",
493
  "success": true
494
  },
@@ -498,7 +498,7 @@
498
  "group_size": 64,
499
  "metadata": {},
500
  "method": "affine",
501
- "module_path": "language_model.model.layers.10.mlp.gate_proj",
502
  "note": "MLX-LM affine packing",
503
  "success": true
504
  },
@@ -508,7 +508,7 @@
508
  "group_size": 64,
509
  "metadata": {},
510
  "method": "affine",
511
- "module_path": "language_model.model.layers.10.mlp.up_proj",
512
  "note": "MLX-LM affine packing",
513
  "success": true
514
  },
@@ -518,7 +518,7 @@
518
  "group_size": 64,
519
  "metadata": {},
520
  "method": "affine",
521
- "module_path": "language_model.model.layers.10.self_attn.k_proj",
522
  "note": "MLX-LM affine packing",
523
  "success": true
524
  },
@@ -528,7 +528,7 @@
528
  "group_size": 64,
529
  "metadata": {},
530
  "method": "affine",
531
- "module_path": "language_model.model.layers.10.self_attn.o_proj",
532
  "note": "MLX-LM affine packing",
533
  "success": true
534
  },
@@ -538,7 +538,7 @@
538
  "group_size": 64,
539
  "metadata": {},
540
  "method": "affine",
541
- "module_path": "language_model.model.layers.10.self_attn.q_proj",
542
  "note": "MLX-LM affine packing",
543
  "success": true
544
  },
@@ -548,7 +548,7 @@
548
  "group_size": 64,
549
  "metadata": {},
550
  "method": "affine",
551
- "module_path": "language_model.model.layers.10.self_attn.v_proj",
552
  "note": "MLX-LM affine packing",
553
  "success": true
554
  },
@@ -558,7 +558,7 @@
558
  "group_size": 64,
559
  "metadata": {},
560
  "method": "affine",
561
- "module_path": "language_model.model.layers.11.mlp.down_proj",
562
  "note": "MLX-LM affine packing",
563
  "success": true
564
  },
@@ -568,7 +568,7 @@
568
  "group_size": 64,
569
  "metadata": {},
570
  "method": "affine",
571
- "module_path": "language_model.model.layers.11.mlp.gate_proj",
572
  "note": "MLX-LM affine packing",
573
  "success": true
574
  },
@@ -578,7 +578,7 @@
578
  "group_size": 64,
579
  "metadata": {},
580
  "method": "affine",
581
- "module_path": "language_model.model.layers.11.mlp.up_proj",
582
  "note": "MLX-LM affine packing",
583
  "success": true
584
  },
@@ -588,7 +588,7 @@
588
  "group_size": 64,
589
  "metadata": {},
590
  "method": "affine",
591
- "module_path": "language_model.model.layers.11.self_attn.k_proj",
592
  "note": "MLX-LM affine packing",
593
  "success": true
594
  },
@@ -598,7 +598,7 @@
598
  "group_size": 64,
599
  "metadata": {},
600
  "method": "affine",
601
- "module_path": "language_model.model.layers.11.self_attn.o_proj",
602
  "note": "MLX-LM affine packing",
603
  "success": true
604
  },
@@ -608,7 +608,7 @@
608
  "group_size": 64,
609
  "metadata": {},
610
  "method": "affine",
611
- "module_path": "language_model.model.layers.11.self_attn.q_proj",
612
  "note": "MLX-LM affine packing",
613
  "success": true
614
  },
@@ -618,7 +618,7 @@
618
  "group_size": 64,
619
  "metadata": {},
620
  "method": "affine",
621
- "module_path": "language_model.model.layers.11.self_attn.v_proj",
622
  "note": "MLX-LM affine packing",
623
  "success": true
624
  },
@@ -628,7 +628,7 @@
628
  "group_size": 64,
629
  "metadata": {},
630
  "method": "affine",
631
- "module_path": "language_model.model.layers.12.mlp.down_proj",
632
  "note": "MLX-LM affine packing",
633
  "success": true
634
  },
@@ -638,7 +638,7 @@
638
  "group_size": 64,
639
  "metadata": {},
640
  "method": "affine",
641
- "module_path": "language_model.model.layers.12.mlp.gate_proj",
642
  "note": "MLX-LM affine packing",
643
  "success": true
644
  },
@@ -648,7 +648,7 @@
648
  "group_size": 64,
649
  "metadata": {},
650
  "method": "affine",
651
- "module_path": "language_model.model.layers.12.mlp.up_proj",
652
  "note": "MLX-LM affine packing",
653
  "success": true
654
  },
@@ -658,7 +658,7 @@
658
  "group_size": 64,
659
  "metadata": {},
660
  "method": "affine",
661
- "module_path": "language_model.model.layers.12.self_attn.k_proj",
662
  "note": "MLX-LM affine packing",
663
  "success": true
664
  },
@@ -668,7 +668,7 @@
668
  "group_size": 64,
669
  "metadata": {},
670
  "method": "affine",
671
- "module_path": "language_model.model.layers.12.self_attn.o_proj",
672
  "note": "MLX-LM affine packing",
673
  "success": true
674
  },
@@ -678,7 +678,7 @@
678
  "group_size": 64,
679
  "metadata": {},
680
  "method": "affine",
681
- "module_path": "language_model.model.layers.12.self_attn.q_proj",
682
  "note": "MLX-LM affine packing",
683
  "success": true
684
  },
@@ -688,7 +688,7 @@
688
  "group_size": 64,
689
  "metadata": {},
690
  "method": "affine",
691
- "module_path": "language_model.model.layers.12.self_attn.v_proj",
692
  "note": "MLX-LM affine packing",
693
  "success": true
694
  },
@@ -698,7 +698,7 @@
698
  "group_size": 64,
699
  "metadata": {},
700
  "method": "affine",
701
- "module_path": "language_model.model.layers.13.mlp.down_proj",
702
  "note": "MLX-LM affine packing",
703
  "success": true
704
  },
@@ -708,7 +708,7 @@
708
  "group_size": 64,
709
  "metadata": {},
710
  "method": "affine",
711
- "module_path": "language_model.model.layers.13.mlp.gate_proj",
712
  "note": "MLX-LM affine packing",
713
  "success": true
714
  },
@@ -718,7 +718,7 @@
718
  "group_size": 64,
719
  "metadata": {},
720
  "method": "affine",
721
- "module_path": "language_model.model.layers.13.mlp.up_proj",
722
  "note": "MLX-LM affine packing",
723
  "success": true
724
  },
@@ -728,7 +728,7 @@
728
  "group_size": 64,
729
  "metadata": {},
730
  "method": "affine",
731
- "module_path": "language_model.model.layers.13.self_attn.k_proj",
732
  "note": "MLX-LM affine packing",
733
  "success": true
734
  },
@@ -738,7 +738,7 @@
738
  "group_size": 64,
739
  "metadata": {},
740
  "method": "affine",
741
- "module_path": "language_model.model.layers.13.self_attn.o_proj",
742
  "note": "MLX-LM affine packing",
743
  "success": true
744
  },
@@ -748,7 +748,7 @@
748
  "group_size": 64,
749
  "metadata": {},
750
  "method": "affine",
751
- "module_path": "language_model.model.layers.13.self_attn.q_proj",
752
  "note": "MLX-LM affine packing",
753
  "success": true
754
  },
@@ -758,7 +758,7 @@
758
  "group_size": 64,
759
  "metadata": {},
760
  "method": "affine",
761
- "module_path": "language_model.model.layers.13.self_attn.v_proj",
762
  "note": "MLX-LM affine packing",
763
  "success": true
764
  },
@@ -768,7 +768,7 @@
768
  "group_size": 64,
769
  "metadata": {},
770
  "method": "affine",
771
- "module_path": "language_model.model.layers.14.mlp.down_proj",
772
  "note": "MLX-LM affine packing",
773
  "success": true
774
  },
@@ -778,7 +778,7 @@
778
  "group_size": 64,
779
  "metadata": {},
780
  "method": "affine",
781
- "module_path": "language_model.model.layers.14.mlp.gate_proj",
782
  "note": "MLX-LM affine packing",
783
  "success": true
784
  },
@@ -788,7 +788,7 @@
788
  "group_size": 64,
789
  "metadata": {},
790
  "method": "affine",
791
- "module_path": "language_model.model.layers.14.mlp.up_proj",
792
  "note": "MLX-LM affine packing",
793
  "success": true
794
  },
@@ -798,7 +798,7 @@
798
  "group_size": 64,
799
  "metadata": {},
800
  "method": "affine",
801
- "module_path": "language_model.model.layers.14.self_attn.k_proj",
802
  "note": "MLX-LM affine packing",
803
  "success": true
804
  },
@@ -808,7 +808,7 @@
808
  "group_size": 64,
809
  "metadata": {},
810
  "method": "affine",
811
- "module_path": "language_model.model.layers.14.self_attn.o_proj",
812
  "note": "MLX-LM affine packing",
813
  "success": true
814
  },
@@ -818,7 +818,7 @@
818
  "group_size": 64,
819
  "metadata": {},
820
  "method": "affine",
821
- "module_path": "language_model.model.layers.14.self_attn.q_proj",
822
  "note": "MLX-LM affine packing",
823
  "success": true
824
  },
@@ -828,7 +828,7 @@
828
  "group_size": 64,
829
  "metadata": {},
830
  "method": "affine",
831
- "module_path": "language_model.model.layers.14.self_attn.v_proj",
832
  "note": "MLX-LM affine packing",
833
  "success": true
834
  },
@@ -838,7 +838,7 @@
838
  "group_size": 64,
839
  "metadata": {},
840
  "method": "affine",
841
- "module_path": "language_model.model.layers.15.self_attn.k_proj",
842
  "note": "MLX-LM affine packing",
843
  "success": true
844
  },
@@ -848,7 +848,7 @@
848
  "group_size": 64,
849
  "metadata": {},
850
  "method": "affine",
851
- "module_path": "language_model.model.layers.15.self_attn.o_proj",
852
  "note": "MLX-LM affine packing",
853
  "success": true
854
  },
@@ -858,7 +858,7 @@
858
  "group_size": 64,
859
  "metadata": {},
860
  "method": "affine",
861
- "module_path": "language_model.model.layers.15.self_attn.q_proj",
862
  "note": "MLX-LM affine packing",
863
  "success": true
864
  },
@@ -868,7 +868,7 @@
868
  "group_size": 64,
869
  "metadata": {},
870
  "method": "affine",
871
- "module_path": "language_model.model.layers.15.self_attn.v_proj",
872
  "note": "MLX-LM affine packing",
873
  "success": true
874
  },
@@ -878,7 +878,7 @@
878
  "group_size": 64,
879
  "metadata": {},
880
  "method": "affine",
881
- "module_path": "language_model.model.layers.6.mlp.down_proj",
882
  "note": "MLX-LM affine packing",
883
  "success": true
884
  },
@@ -888,7 +888,7 @@
888
  "group_size": 64,
889
  "metadata": {},
890
  "method": "affine",
891
- "module_path": "language_model.model.layers.6.mlp.up_proj",
892
  "note": "MLX-LM affine packing",
893
  "success": true
894
  },
@@ -898,7 +898,7 @@
898
  "group_size": 64,
899
  "metadata": {},
900
  "method": "affine",
901
- "module_path": "language_model.model.layers.7.mlp.down_proj",
902
  "note": "MLX-LM affine packing",
903
  "success": true
904
  },
@@ -908,7 +908,7 @@
908
  "group_size": 64,
909
  "metadata": {},
910
  "method": "affine",
911
- "module_path": "language_model.model.layers.7.mlp.gate_proj",
912
  "note": "MLX-LM affine packing",
913
  "success": true
914
  },
@@ -918,7 +918,7 @@
918
  "group_size": 64,
919
  "metadata": {},
920
  "method": "affine",
921
- "module_path": "language_model.model.layers.7.mlp.up_proj",
922
  "note": "MLX-LM affine packing",
923
  "success": true
924
  },
@@ -928,7 +928,7 @@
928
  "group_size": 64,
929
  "metadata": {},
930
  "method": "affine",
931
- "module_path": "language_model.model.layers.7.self_attn.k_proj",
932
  "note": "MLX-LM affine packing",
933
  "success": true
934
  },
@@ -938,7 +938,7 @@
938
  "group_size": 64,
939
  "metadata": {},
940
  "method": "affine",
941
- "module_path": "language_model.model.layers.7.self_attn.o_proj",
942
  "note": "MLX-LM affine packing",
943
  "success": true
944
  },
@@ -948,7 +948,7 @@
948
  "group_size": 64,
949
  "metadata": {},
950
  "method": "affine",
951
- "module_path": "language_model.model.layers.7.self_attn.q_proj",
952
  "note": "MLX-LM affine packing",
953
  "success": true
954
  },
@@ -958,7 +958,7 @@
958
  "group_size": 64,
959
  "metadata": {},
960
  "method": "affine",
961
- "module_path": "language_model.model.layers.7.self_attn.v_proj",
962
  "note": "MLX-LM affine packing",
963
  "success": true
964
  },
@@ -968,7 +968,7 @@
968
  "group_size": 64,
969
  "metadata": {},
970
  "method": "affine",
971
- "module_path": "language_model.model.layers.8.mlp.down_proj",
972
  "note": "MLX-LM affine packing",
973
  "success": true
974
  },
@@ -978,7 +978,7 @@
978
  "group_size": 64,
979
  "metadata": {},
980
  "method": "affine",
981
- "module_path": "language_model.model.layers.8.mlp.gate_proj",
982
  "note": "MLX-LM affine packing",
983
  "success": true
984
  },
@@ -988,7 +988,7 @@
988
  "group_size": 64,
989
  "metadata": {},
990
  "method": "affine",
991
- "module_path": "language_model.model.layers.8.mlp.up_proj",
992
  "note": "MLX-LM affine packing",
993
  "success": true
994
  },
@@ -998,7 +998,7 @@
998
  "group_size": 64,
999
  "metadata": {},
1000
  "method": "affine",
1001
- "module_path": "language_model.model.layers.8.self_attn.k_proj",
1002
  "note": "MLX-LM affine packing",
1003
  "success": true
1004
  },
@@ -1008,7 +1008,7 @@
1008
  "group_size": 64,
1009
  "metadata": {},
1010
  "method": "affine",
1011
- "module_path": "language_model.model.layers.8.self_attn.o_proj",
1012
  "note": "MLX-LM affine packing",
1013
  "success": true
1014
  },
@@ -1018,7 +1018,7 @@
1018
  "group_size": 64,
1019
  "metadata": {},
1020
  "method": "affine",
1021
- "module_path": "language_model.model.layers.8.self_attn.q_proj",
1022
  "note": "MLX-LM affine packing",
1023
  "success": true
1024
  },
@@ -1028,7 +1028,7 @@
1028
  "group_size": 64,
1029
  "metadata": {},
1030
  "method": "affine",
1031
- "module_path": "language_model.model.layers.8.self_attn.v_proj",
1032
  "note": "MLX-LM affine packing",
1033
  "success": true
1034
  },
@@ -1038,7 +1038,7 @@
1038
  "group_size": 64,
1039
  "metadata": {},
1040
  "method": "affine",
1041
- "module_path": "language_model.model.layers.9.mlp.down_proj",
1042
  "note": "MLX-LM affine packing",
1043
  "success": true
1044
  },
@@ -1048,7 +1048,7 @@
1048
  "group_size": 64,
1049
  "metadata": {},
1050
  "method": "affine",
1051
- "module_path": "language_model.model.layers.9.mlp.gate_proj",
1052
  "note": "MLX-LM affine packing",
1053
  "success": true
1054
  },
@@ -1058,7 +1058,7 @@
1058
  "group_size": 64,
1059
  "metadata": {},
1060
  "method": "affine",
1061
- "module_path": "language_model.model.layers.9.mlp.up_proj",
1062
  "note": "MLX-LM affine packing",
1063
  "success": true
1064
  },
@@ -1068,7 +1068,7 @@
1068
  "group_size": 64,
1069
  "metadata": {},
1070
  "method": "affine",
1071
- "module_path": "language_model.model.layers.9.self_attn.k_proj",
1072
  "note": "MLX-LM affine packing",
1073
  "success": true
1074
  },
@@ -1078,7 +1078,7 @@
1078
  "group_size": 64,
1079
  "metadata": {},
1080
  "method": "affine",
1081
- "module_path": "language_model.model.layers.9.self_attn.o_proj",
1082
  "note": "MLX-LM affine packing",
1083
  "success": true
1084
  },
@@ -1088,7 +1088,7 @@
1088
  "group_size": 64,
1089
  "metadata": {},
1090
  "method": "affine",
1091
- "module_path": "language_model.model.layers.9.self_attn.q_proj",
1092
  "note": "MLX-LM affine packing",
1093
  "success": true
1094
  },
@@ -1098,7 +1098,7 @@
1098
  "group_size": 64,
1099
  "metadata": {},
1100
  "method": "affine",
1101
- "module_path": "language_model.model.layers.9.self_attn.v_proj",
1102
  "note": "MLX-LM affine packing",
1103
  "success": true
1104
  },
@@ -1108,7 +1108,7 @@
1108
  "group_size": 64,
1109
  "metadata": {},
1110
  "method": "affine",
1111
- "module_path": "language_model.model.layers.15.mlp.down_proj",
1112
  "note": "MLX-LM affine packing",
1113
  "success": true
1114
  },
@@ -1118,7 +1118,7 @@
1118
  "group_size": 64,
1119
  "metadata": {},
1120
  "method": "affine",
1121
- "module_path": "language_model.model.layers.15.mlp.gate_proj",
1122
  "note": "MLX-LM affine packing",
1123
  "success": true
1124
  },
@@ -1128,7 +1128,7 @@
1128
  "group_size": 64,
1129
  "metadata": {},
1130
  "method": "affine",
1131
- "module_path": "language_model.model.layers.15.mlp.up_proj",
1132
  "note": "MLX-LM affine packing",
1133
  "success": true
1134
  },
@@ -1418,7 +1418,7 @@
1418
  "group_size": 64,
1419
  "metadata": {},
1420
  "method": "affine",
1421
- "module_path": "language_model.model.layers.20.mlp.down_proj",
1422
  "note": "MLX-LM affine packing",
1423
  "success": true
1424
  },
@@ -1428,7 +1428,7 @@
1428
  "group_size": 64,
1429
  "metadata": {},
1430
  "method": "affine",
1431
- "module_path": "language_model.model.layers.20.mlp.gate_proj",
1432
  "note": "MLX-LM affine packing",
1433
  "success": true
1434
  },
@@ -1438,7 +1438,7 @@
1438
  "group_size": 64,
1439
  "metadata": {},
1440
  "method": "affine",
1441
- "module_path": "language_model.model.layers.20.mlp.up_proj",
1442
  "note": "MLX-LM affine packing",
1443
  "success": true
1444
  },
@@ -1448,7 +1448,7 @@
1448
  "group_size": 64,
1449
  "metadata": {},
1450
  "method": "affine",
1451
- "module_path": "language_model.model.layers.20.self_attn.k_proj",
1452
  "note": "MLX-LM affine packing",
1453
  "success": true
1454
  },
@@ -1458,7 +1458,7 @@
1458
  "group_size": 64,
1459
  "metadata": {},
1460
  "method": "affine",
1461
- "module_path": "language_model.model.layers.20.self_attn.o_proj",
1462
  "note": "MLX-LM affine packing",
1463
  "success": true
1464
  },
@@ -1468,7 +1468,7 @@
1468
  "group_size": 64,
1469
  "metadata": {},
1470
  "method": "affine",
1471
- "module_path": "language_model.model.layers.20.self_attn.q_proj",
1472
  "note": "MLX-LM affine packing",
1473
  "success": true
1474
  },
@@ -1478,7 +1478,7 @@
1478
  "group_size": 64,
1479
  "metadata": {},
1480
  "method": "affine",
1481
- "module_path": "language_model.model.layers.20.self_attn.v_proj",
1482
  "note": "MLX-LM affine packing",
1483
  "success": true
1484
  },
@@ -1648,7 +1648,7 @@
1648
  "group_size": 64,
1649
  "metadata": {},
1650
  "method": "affine",
1651
- "module_path": "language_model.model.layers.23.self_attn.k_proj",
1652
  "note": "MLX-LM affine packing",
1653
  "success": true
1654
  },
@@ -1658,7 +1658,7 @@
1658
  "group_size": 64,
1659
  "metadata": {},
1660
  "method": "affine",
1661
- "module_path": "language_model.model.layers.23.self_attn.o_proj",
1662
  "note": "MLX-LM affine packing",
1663
  "success": true
1664
  },
@@ -1668,7 +1668,7 @@
1668
  "group_size": 64,
1669
  "metadata": {},
1670
  "method": "affine",
1671
- "module_path": "language_model.model.layers.23.self_attn.q_proj",
1672
  "note": "MLX-LM affine packing",
1673
  "success": true
1674
  },
@@ -1678,7 +1678,7 @@
1678
  "group_size": 64,
1679
  "metadata": {},
1680
  "method": "affine",
1681
- "module_path": "language_model.model.layers.23.self_attn.v_proj",
1682
  "note": "MLX-LM affine packing",
1683
  "success": true
1684
  },
@@ -1688,7 +1688,7 @@
1688
  "group_size": 64,
1689
  "metadata": {},
1690
  "method": "affine",
1691
- "module_path": "language_model.model.layers.23.mlp.up_proj",
1692
  "note": "MLX-LM affine packing",
1693
  "success": true
1694
  },
@@ -1978,7 +1978,7 @@
1978
  "group_size": 64,
1979
  "metadata": {},
1980
  "method": "affine",
1981
- "module_path": "language_model.model.layers.28.mlp.down_proj",
1982
  "note": "MLX-LM affine packing",
1983
  "success": true
1984
  },
@@ -1988,7 +1988,7 @@
1988
  "group_size": 64,
1989
  "metadata": {},
1990
  "method": "affine",
1991
- "module_path": "language_model.model.layers.28.mlp.gate_proj",
1992
  "note": "MLX-LM affine packing",
1993
  "success": true
1994
  },
@@ -1998,7 +1998,7 @@
1998
  "group_size": 64,
1999
  "metadata": {},
2000
  "method": "affine",
2001
- "module_path": "language_model.model.layers.28.mlp.up_proj",
2002
  "note": "MLX-LM affine packing",
2003
  "success": true
2004
  },
@@ -2008,7 +2008,7 @@
2008
  "group_size": 64,
2009
  "metadata": {},
2010
  "method": "affine",
2011
- "module_path": "language_model.model.layers.28.self_attn.k_proj",
2012
  "note": "MLX-LM affine packing",
2013
  "success": true
2014
  },
@@ -2018,7 +2018,7 @@
2018
  "group_size": 64,
2019
  "metadata": {},
2020
  "method": "affine",
2021
- "module_path": "language_model.model.layers.28.self_attn.o_proj",
2022
  "note": "MLX-LM affine packing",
2023
  "success": true
2024
  },
@@ -2028,7 +2028,7 @@
2028
  "group_size": 64,
2029
  "metadata": {},
2030
  "method": "affine",
2031
- "module_path": "language_model.model.layers.28.self_attn.q_proj",
2032
  "note": "MLX-LM affine packing",
2033
  "success": true
2034
  },
@@ -2038,7 +2038,7 @@
2038
  "group_size": 64,
2039
  "metadata": {},
2040
  "method": "affine",
2041
- "module_path": "language_model.model.layers.28.self_attn.v_proj",
2042
  "note": "MLX-LM affine packing",
2043
  "success": true
2044
  },
@@ -2258,7 +2258,7 @@
2258
  "group_size": 64,
2259
  "metadata": {},
2260
  "method": "affine",
2261
- "module_path": "language_model.model.layers.32.mlp.gate_proj",
2262
  "note": "MLX-LM affine packing",
2263
  "success": true
2264
  },
@@ -2268,7 +2268,7 @@
2268
  "group_size": 64,
2269
  "metadata": {},
2270
  "method": "affine",
2271
- "module_path": "language_model.model.layers.32.self_attn.k_proj",
2272
  "note": "MLX-LM affine packing",
2273
  "success": true
2274
  },
@@ -2278,7 +2278,7 @@
2278
  "group_size": 64,
2279
  "metadata": {},
2280
  "method": "affine",
2281
- "module_path": "language_model.model.layers.32.self_attn.o_proj",
2282
  "note": "MLX-LM affine packing",
2283
  "success": true
2284
  },
@@ -2288,7 +2288,7 @@
2288
  "group_size": 64,
2289
  "metadata": {},
2290
  "method": "affine",
2291
- "module_path": "language_model.model.layers.32.self_attn.q_proj",
2292
  "note": "MLX-LM affine packing",
2293
  "success": true
2294
  },
@@ -2298,7 +2298,7 @@
2298
  "group_size": 64,
2299
  "metadata": {},
2300
  "method": "affine",
2301
- "module_path": "language_model.model.layers.32.self_attn.v_proj",
2302
  "note": "MLX-LM affine packing",
2303
  "success": true
2304
  },
@@ -2308,7 +2308,7 @@
2308
  "group_size": 64,
2309
  "metadata": {},
2310
  "method": "affine",
2311
- "module_path": "language_model.model.layers.32.mlp.down_proj",
2312
  "note": "MLX-LM affine packing",
2313
  "success": true
2314
  },
@@ -2318,7 +2318,7 @@
2318
  "group_size": 64,
2319
  "metadata": {},
2320
  "method": "affine",
2321
- "module_path": "language_model.model.layers.32.mlp.up_proj",
2322
  "note": "MLX-LM affine packing",
2323
  "success": true
2324
  },
@@ -2425,7 +2425,7 @@
2425
  {
2426
  "bits": 4,
2427
  "fallback": false,
2428
- "group_size": 32,
2429
  "metadata": {},
2430
  "method": "affine",
2431
  "module_path": "language_model.model.layers.34.self_attn.k_proj",
@@ -2455,7 +2455,7 @@
2455
  {
2456
  "bits": 4,
2457
  "fallback": false,
2458
- "group_size": 32,
2459
  "metadata": {},
2460
  "method": "affine",
2461
  "module_path": "language_model.model.layers.34.self_attn.v_proj",
@@ -2495,7 +2495,7 @@
2495
  {
2496
  "bits": 4,
2497
  "fallback": false,
2498
- "group_size": 32,
2499
  "metadata": {},
2500
  "method": "affine",
2501
  "module_path": "language_model.model.layers.35.self_attn.k_proj",
@@ -2515,7 +2515,7 @@
2515
  {
2516
  "bits": 4,
2517
  "fallback": false,
2518
- "group_size": 32,
2519
  "metadata": {},
2520
  "method": "affine",
2521
  "module_path": "language_model.model.layers.35.self_attn.q_proj",
@@ -2525,7 +2525,7 @@
2525
  {
2526
  "bits": 4,
2527
  "fallback": false,
2528
- "group_size": 32,
2529
  "metadata": {},
2530
  "method": "affine",
2531
  "module_path": "language_model.model.layers.35.self_attn.v_proj",
@@ -2538,7 +2538,7 @@
2538
  "group_size": 64,
2539
  "metadata": {},
2540
  "method": "affine",
2541
- "module_path": "language_model.model.layers.36.mlp.down_proj",
2542
  "note": "MLX-LM affine packing",
2543
  "success": true
2544
  },
@@ -2548,7 +2548,7 @@
2548
  "group_size": 64,
2549
  "metadata": {},
2550
  "method": "affine",
2551
- "module_path": "language_model.model.layers.36.mlp.gate_proj",
2552
  "note": "MLX-LM affine packing",
2553
  "success": true
2554
  },
@@ -2558,47 +2558,47 @@
2558
  "group_size": 64,
2559
  "metadata": {},
2560
  "method": "affine",
2561
- "module_path": "language_model.model.layers.36.mlp.up_proj",
2562
  "note": "MLX-LM affine packing",
2563
  "success": true
2564
  },
2565
  {
2566
  "bits": 4,
2567
  "fallback": false,
2568
- "group_size": 32,
2569
  "metadata": {},
2570
  "method": "affine",
2571
- "module_path": "language_model.model.layers.36.self_attn.k_proj",
2572
  "note": "MLX-LM affine packing",
2573
  "success": true
2574
  },
2575
  {
2576
  "bits": 4,
2577
  "fallback": false,
2578
- "group_size": 32,
2579
  "metadata": {},
2580
  "method": "affine",
2581
- "module_path": "language_model.model.layers.36.self_attn.o_proj",
2582
  "note": "MLX-LM affine packing",
2583
  "success": true
2584
  },
2585
  {
2586
  "bits": 4,
2587
  "fallback": false,
2588
- "group_size": 32,
2589
  "metadata": {},
2590
  "method": "affine",
2591
- "module_path": "language_model.model.layers.36.self_attn.q_proj",
2592
  "note": "MLX-LM affine packing",
2593
  "success": true
2594
  },
2595
  {
2596
  "bits": 4,
2597
  "fallback": false,
2598
- "group_size": 32,
2599
  "metadata": {},
2600
  "method": "affine",
2601
- "module_path": "language_model.model.layers.36.self_attn.v_proj",
2602
  "note": "MLX-LM affine packing",
2603
  "success": true
2604
  },
@@ -2635,7 +2635,7 @@
2635
  {
2636
  "bits": 4,
2637
  "fallback": false,
2638
- "group_size": 32,
2639
  "metadata": {},
2640
  "method": "affine",
2641
  "module_path": "language_model.model.layers.37.self_attn.k_proj",
@@ -2645,7 +2645,7 @@
2645
  {
2646
  "bits": 4,
2647
  "fallback": false,
2648
- "group_size": 32,
2649
  "metadata": {},
2650
  "method": "affine",
2651
  "module_path": "language_model.model.layers.37.self_attn.o_proj",
@@ -2655,7 +2655,7 @@
2655
  {
2656
  "bits": 4,
2657
  "fallback": false,
2658
- "group_size": 32,
2659
  "metadata": {},
2660
  "method": "affine",
2661
  "module_path": "language_model.model.layers.37.self_attn.q_proj",
@@ -2665,7 +2665,7 @@
2665
  {
2666
  "bits": 4,
2667
  "fallback": false,
2668
- "group_size": 32,
2669
  "metadata": {},
2670
  "method": "affine",
2671
  "module_path": "language_model.model.layers.37.self_attn.v_proj",
@@ -2705,7 +2705,7 @@
2705
  {
2706
  "bits": 4,
2707
  "fallback": false,
2708
- "group_size": 32,
2709
  "metadata": {},
2710
  "method": "affine",
2711
  "module_path": "language_model.model.layers.38.self_attn.k_proj",
@@ -2715,7 +2715,7 @@
2715
  {
2716
  "bits": 4,
2717
  "fallback": false,
2718
- "group_size": 32,
2719
  "metadata": {},
2720
  "method": "affine",
2721
  "module_path": "language_model.model.layers.38.self_attn.o_proj",
@@ -2725,7 +2725,7 @@
2725
  {
2726
  "bits": 4,
2727
  "fallback": false,
2728
- "group_size": 32,
2729
  "metadata": {},
2730
  "method": "affine",
2731
  "module_path": "language_model.model.layers.38.self_attn.q_proj",
@@ -2735,7 +2735,7 @@
2735
  {
2736
  "bits": 4,
2737
  "fallback": false,
2738
- "group_size": 32,
2739
  "metadata": {},
2740
  "method": "affine",
2741
  "module_path": "language_model.model.layers.38.self_attn.v_proj",
@@ -2775,7 +2775,7 @@
2775
  {
2776
  "bits": 4,
2777
  "fallback": false,
2778
- "group_size": 32,
2779
  "metadata": {},
2780
  "method": "affine",
2781
  "module_path": "language_model.model.layers.39.self_attn.k_proj",
 
1
  {
2
+ "created_at": "2026-08-05T08:00:18.943902Z",
3
+ "plan_sha256": "b16e4310e1401539e785d2b2ffaab5bb0427ec7ab693cd96ff552b0a7ce6ef87",
4
  "records": [
5
  {
6
  "bits": 8,
 
298
  "group_size": 64,
299
  "metadata": {},
300
  "method": "affine",
301
+ "module_path": "language_model.model.layers.4.mlp.gate_proj",
302
  "note": "MLX-LM affine packing",
303
  "success": true
304
  },
 
308
  "group_size": 64,
309
  "metadata": {},
310
  "method": "affine",
311
+ "module_path": "language_model.model.layers.4.self_attn.k_proj",
312
  "note": "MLX-LM affine packing",
313
  "success": true
314
  },
 
318
  "group_size": 64,
319
  "metadata": {},
320
  "method": "affine",
321
+ "module_path": "language_model.model.layers.4.self_attn.o_proj",
322
  "note": "MLX-LM affine packing",
323
  "success": true
324
  },
 
328
  "group_size": 64,
329
  "metadata": {},
330
  "method": "affine",
331
+ "module_path": "language_model.model.layers.4.self_attn.q_proj",
332
  "note": "MLX-LM affine packing",
333
  "success": true
334
  },
 
338
  "group_size": 64,
339
  "metadata": {},
340
  "method": "affine",
341
+ "module_path": "language_model.model.layers.4.self_attn.v_proj",
342
  "note": "MLX-LM affine packing",
343
  "success": true
344
  },
 
348
  "group_size": 64,
349
  "metadata": {},
350
  "method": "affine",
351
+ "module_path": "language_model.model.layers.10.mlp.down_proj",
352
  "note": "MLX-LM affine packing",
353
  "success": true
354
  },
 
358
  "group_size": 64,
359
  "metadata": {},
360
  "method": "affine",
361
+ "module_path": "language_model.model.layers.10.mlp.gate_proj",
362
  "note": "MLX-LM affine packing",
363
  "success": true
364
  },
 
368
  "group_size": 64,
369
  "metadata": {},
370
  "method": "affine",
371
+ "module_path": "language_model.model.layers.10.mlp.up_proj",
372
  "note": "MLX-LM affine packing",
373
  "success": true
374
  },
 
378
  "group_size": 64,
379
  "metadata": {},
380
  "method": "affine",
381
+ "module_path": "language_model.model.layers.10.self_attn.k_proj",
382
  "note": "MLX-LM affine packing",
383
  "success": true
384
  },
 
388
  "group_size": 64,
389
  "metadata": {},
390
  "method": "affine",
391
+ "module_path": "language_model.model.layers.10.self_attn.o_proj",
392
  "note": "MLX-LM affine packing",
393
  "success": true
394
  },
 
398
  "group_size": 64,
399
  "metadata": {},
400
  "method": "affine",
401
+ "module_path": "language_model.model.layers.10.self_attn.q_proj",
402
  "note": "MLX-LM affine packing",
403
  "success": true
404
  },
 
408
  "group_size": 64,
409
  "metadata": {},
410
  "method": "affine",
411
+ "module_path": "language_model.model.layers.10.self_attn.v_proj",
412
  "note": "MLX-LM affine packing",
413
  "success": true
414
  },
 
418
  "group_size": 64,
419
  "metadata": {},
420
  "method": "affine",
421
+ "module_path": "language_model.model.layers.11.mlp.down_proj",
422
  "note": "MLX-LM affine packing",
423
  "success": true
424
  },
 
428
  "group_size": 64,
429
  "metadata": {},
430
  "method": "affine",
431
+ "module_path": "language_model.model.layers.11.mlp.gate_proj",
432
  "note": "MLX-LM affine packing",
433
  "success": true
434
  },
 
438
  "group_size": 64,
439
  "metadata": {},
440
  "method": "affine",
441
+ "module_path": "language_model.model.layers.11.mlp.up_proj",
442
  "note": "MLX-LM affine packing",
443
  "success": true
444
  },
 
448
  "group_size": 64,
449
  "metadata": {},
450
  "method": "affine",
451
+ "module_path": "language_model.model.layers.11.self_attn.k_proj",
452
  "note": "MLX-LM affine packing",
453
  "success": true
454
  },
 
458
  "group_size": 64,
459
  "metadata": {},
460
  "method": "affine",
461
+ "module_path": "language_model.model.layers.11.self_attn.o_proj",
462
  "note": "MLX-LM affine packing",
463
  "success": true
464
  },
 
468
  "group_size": 64,
469
  "metadata": {},
470
  "method": "affine",
471
+ "module_path": "language_model.model.layers.11.self_attn.q_proj",
472
  "note": "MLX-LM affine packing",
473
  "success": true
474
  },
 
478
  "group_size": 64,
479
  "metadata": {},
480
  "method": "affine",
481
+ "module_path": "language_model.model.layers.11.self_attn.v_proj",
482
  "note": "MLX-LM affine packing",
483
  "success": true
484
  },
 
488
  "group_size": 64,
489
  "metadata": {},
490
  "method": "affine",
491
+ "module_path": "language_model.model.layers.12.mlp.gate_proj",
492
  "note": "MLX-LM affine packing",
493
  "success": true
494
  },
 
498
  "group_size": 64,
499
  "metadata": {},
500
  "method": "affine",
501
+ "module_path": "language_model.model.layers.12.self_attn.k_proj",
502
  "note": "MLX-LM affine packing",
503
  "success": true
504
  },
 
508
  "group_size": 64,
509
  "metadata": {},
510
  "method": "affine",
511
+ "module_path": "language_model.model.layers.12.self_attn.o_proj",
512
  "note": "MLX-LM affine packing",
513
  "success": true
514
  },
 
518
  "group_size": 64,
519
  "metadata": {},
520
  "method": "affine",
521
+ "module_path": "language_model.model.layers.12.self_attn.q_proj",
522
  "note": "MLX-LM affine packing",
523
  "success": true
524
  },
 
528
  "group_size": 64,
529
  "metadata": {},
530
  "method": "affine",
531
+ "module_path": "language_model.model.layers.12.self_attn.v_proj",
532
  "note": "MLX-LM affine packing",
533
  "success": true
534
  },
 
538
  "group_size": 64,
539
  "metadata": {},
540
  "method": "affine",
541
+ "module_path": "language_model.model.layers.4.mlp.down_proj",
542
  "note": "MLX-LM affine packing",
543
  "success": true
544
  },
 
548
  "group_size": 64,
549
  "metadata": {},
550
  "method": "affine",
551
+ "module_path": "language_model.model.layers.4.mlp.up_proj",
552
  "note": "MLX-LM affine packing",
553
  "success": true
554
  },
 
558
  "group_size": 64,
559
  "metadata": {},
560
  "method": "affine",
561
+ "module_path": "language_model.model.layers.5.mlp.down_proj",
562
  "note": "MLX-LM affine packing",
563
  "success": true
564
  },
 
568
  "group_size": 64,
569
  "metadata": {},
570
  "method": "affine",
571
+ "module_path": "language_model.model.layers.5.mlp.gate_proj",
572
  "note": "MLX-LM affine packing",
573
  "success": true
574
  },
 
578
  "group_size": 64,
579
  "metadata": {},
580
  "method": "affine",
581
+ "module_path": "language_model.model.layers.5.mlp.up_proj",
582
  "note": "MLX-LM affine packing",
583
  "success": true
584
  },
 
588
  "group_size": 64,
589
  "metadata": {},
590
  "method": "affine",
591
+ "module_path": "language_model.model.layers.5.self_attn.k_proj",
592
  "note": "MLX-LM affine packing",
593
  "success": true
594
  },
 
598
  "group_size": 64,
599
  "metadata": {},
600
  "method": "affine",
601
+ "module_path": "language_model.model.layers.5.self_attn.o_proj",
602
  "note": "MLX-LM affine packing",
603
  "success": true
604
  },
 
608
  "group_size": 64,
609
  "metadata": {},
610
  "method": "affine",
611
+ "module_path": "language_model.model.layers.5.self_attn.q_proj",
612
  "note": "MLX-LM affine packing",
613
  "success": true
614
  },
 
618
  "group_size": 64,
619
  "metadata": {},
620
  "method": "affine",
621
+ "module_path": "language_model.model.layers.5.self_attn.v_proj",
622
  "note": "MLX-LM affine packing",
623
  "success": true
624
  },
 
628
  "group_size": 64,
629
  "metadata": {},
630
  "method": "affine",
631
+ "module_path": "language_model.model.layers.6.mlp.down_proj",
632
  "note": "MLX-LM affine packing",
633
  "success": true
634
  },
 
638
  "group_size": 64,
639
  "metadata": {},
640
  "method": "affine",
641
+ "module_path": "language_model.model.layers.6.mlp.gate_proj",
642
  "note": "MLX-LM affine packing",
643
  "success": true
644
  },
 
648
  "group_size": 64,
649
  "metadata": {},
650
  "method": "affine",
651
+ "module_path": "language_model.model.layers.6.mlp.up_proj",
652
  "note": "MLX-LM affine packing",
653
  "success": true
654
  },
 
658
  "group_size": 64,
659
  "metadata": {},
660
  "method": "affine",
661
+ "module_path": "language_model.model.layers.6.self_attn.k_proj",
662
  "note": "MLX-LM affine packing",
663
  "success": true
664
  },
 
668
  "group_size": 64,
669
  "metadata": {},
670
  "method": "affine",
671
+ "module_path": "language_model.model.layers.6.self_attn.o_proj",
672
  "note": "MLX-LM affine packing",
673
  "success": true
674
  },
 
678
  "group_size": 64,
679
  "metadata": {},
680
  "method": "affine",
681
+ "module_path": "language_model.model.layers.6.self_attn.q_proj",
682
  "note": "MLX-LM affine packing",
683
  "success": true
684
  },
 
688
  "group_size": 64,
689
  "metadata": {},
690
  "method": "affine",
691
+ "module_path": "language_model.model.layers.6.self_attn.v_proj",
692
  "note": "MLX-LM affine packing",
693
  "success": true
694
  },
 
698
  "group_size": 64,
699
  "metadata": {},
700
  "method": "affine",
701
+ "module_path": "language_model.model.layers.7.mlp.down_proj",
702
  "note": "MLX-LM affine packing",
703
  "success": true
704
  },
 
708
  "group_size": 64,
709
  "metadata": {},
710
  "method": "affine",
711
+ "module_path": "language_model.model.layers.7.mlp.gate_proj",
712
  "note": "MLX-LM affine packing",
713
  "success": true
714
  },
 
718
  "group_size": 64,
719
  "metadata": {},
720
  "method": "affine",
721
+ "module_path": "language_model.model.layers.7.mlp.up_proj",
722
  "note": "MLX-LM affine packing",
723
  "success": true
724
  },
 
728
  "group_size": 64,
729
  "metadata": {},
730
  "method": "affine",
731
+ "module_path": "language_model.model.layers.7.self_attn.k_proj",
732
  "note": "MLX-LM affine packing",
733
  "success": true
734
  },
 
738
  "group_size": 64,
739
  "metadata": {},
740
  "method": "affine",
741
+ "module_path": "language_model.model.layers.7.self_attn.o_proj",
742
  "note": "MLX-LM affine packing",
743
  "success": true
744
  },
 
748
  "group_size": 64,
749
  "metadata": {},
750
  "method": "affine",
751
+ "module_path": "language_model.model.layers.7.self_attn.q_proj",
752
  "note": "MLX-LM affine packing",
753
  "success": true
754
  },
 
758
  "group_size": 64,
759
  "metadata": {},
760
  "method": "affine",
761
+ "module_path": "language_model.model.layers.7.self_attn.v_proj",
762
  "note": "MLX-LM affine packing",
763
  "success": true
764
  },
 
768
  "group_size": 64,
769
  "metadata": {},
770
  "method": "affine",
771
+ "module_path": "language_model.model.layers.8.mlp.down_proj",
772
  "note": "MLX-LM affine packing",
773
  "success": true
774
  },
 
778
  "group_size": 64,
779
  "metadata": {},
780
  "method": "affine",
781
+ "module_path": "language_model.model.layers.8.mlp.gate_proj",
782
  "note": "MLX-LM affine packing",
783
  "success": true
784
  },
 
788
  "group_size": 64,
789
  "metadata": {},
790
  "method": "affine",
791
+ "module_path": "language_model.model.layers.8.mlp.up_proj",
792
  "note": "MLX-LM affine packing",
793
  "success": true
794
  },
 
798
  "group_size": 64,
799
  "metadata": {},
800
  "method": "affine",
801
+ "module_path": "language_model.model.layers.8.self_attn.k_proj",
802
  "note": "MLX-LM affine packing",
803
  "success": true
804
  },
 
808
  "group_size": 64,
809
  "metadata": {},
810
  "method": "affine",
811
+ "module_path": "language_model.model.layers.8.self_attn.o_proj",
812
  "note": "MLX-LM affine packing",
813
  "success": true
814
  },
 
818
  "group_size": 64,
819
  "metadata": {},
820
  "method": "affine",
821
+ "module_path": "language_model.model.layers.8.self_attn.q_proj",
822
  "note": "MLX-LM affine packing",
823
  "success": true
824
  },
 
828
  "group_size": 64,
829
  "metadata": {},
830
  "method": "affine",
831
+ "module_path": "language_model.model.layers.8.self_attn.v_proj",
832
  "note": "MLX-LM affine packing",
833
  "success": true
834
  },
 
838
  "group_size": 64,
839
  "metadata": {},
840
  "method": "affine",
841
+ "module_path": "language_model.model.layers.9.mlp.down_proj",
842
  "note": "MLX-LM affine packing",
843
  "success": true
844
  },
 
848
  "group_size": 64,
849
  "metadata": {},
850
  "method": "affine",
851
+ "module_path": "language_model.model.layers.9.mlp.gate_proj",
852
  "note": "MLX-LM affine packing",
853
  "success": true
854
  },
 
858
  "group_size": 64,
859
  "metadata": {},
860
  "method": "affine",
861
+ "module_path": "language_model.model.layers.9.mlp.up_proj",
862
  "note": "MLX-LM affine packing",
863
  "success": true
864
  },
 
868
  "group_size": 64,
869
  "metadata": {},
870
  "method": "affine",
871
+ "module_path": "language_model.model.layers.9.self_attn.k_proj",
872
  "note": "MLX-LM affine packing",
873
  "success": true
874
  },
 
878
  "group_size": 64,
879
  "metadata": {},
880
  "method": "affine",
881
+ "module_path": "language_model.model.layers.9.self_attn.o_proj",
882
  "note": "MLX-LM affine packing",
883
  "success": true
884
  },
 
888
  "group_size": 64,
889
  "metadata": {},
890
  "method": "affine",
891
+ "module_path": "language_model.model.layers.9.self_attn.q_proj",
892
  "note": "MLX-LM affine packing",
893
  "success": true
894
  },
 
898
  "group_size": 64,
899
  "metadata": {},
900
  "method": "affine",
901
+ "module_path": "language_model.model.layers.9.self_attn.v_proj",
902
  "note": "MLX-LM affine packing",
903
  "success": true
904
  },
 
908
  "group_size": 64,
909
  "metadata": {},
910
  "method": "affine",
911
+ "module_path": "language_model.model.layers.12.mlp.down_proj",
912
  "note": "MLX-LM affine packing",
913
  "success": true
914
  },
 
918
  "group_size": 64,
919
  "metadata": {},
920
  "method": "affine",
921
+ "module_path": "language_model.model.layers.12.mlp.up_proj",
922
  "note": "MLX-LM affine packing",
923
  "success": true
924
  },
 
928
  "group_size": 64,
929
  "metadata": {},
930
  "method": "affine",
931
+ "module_path": "language_model.model.layers.13.mlp.down_proj",
932
  "note": "MLX-LM affine packing",
933
  "success": true
934
  },
 
938
  "group_size": 64,
939
  "metadata": {},
940
  "method": "affine",
941
+ "module_path": "language_model.model.layers.13.mlp.gate_proj",
942
  "note": "MLX-LM affine packing",
943
  "success": true
944
  },
 
948
  "group_size": 64,
949
  "metadata": {},
950
  "method": "affine",
951
+ "module_path": "language_model.model.layers.13.mlp.up_proj",
952
  "note": "MLX-LM affine packing",
953
  "success": true
954
  },
 
958
  "group_size": 64,
959
  "metadata": {},
960
  "method": "affine",
961
+ "module_path": "language_model.model.layers.13.self_attn.k_proj",
962
  "note": "MLX-LM affine packing",
963
  "success": true
964
  },
 
968
  "group_size": 64,
969
  "metadata": {},
970
  "method": "affine",
971
+ "module_path": "language_model.model.layers.13.self_attn.o_proj",
972
  "note": "MLX-LM affine packing",
973
  "success": true
974
  },
 
978
  "group_size": 64,
979
  "metadata": {},
980
  "method": "affine",
981
+ "module_path": "language_model.model.layers.13.self_attn.q_proj",
982
  "note": "MLX-LM affine packing",
983
  "success": true
984
  },
 
988
  "group_size": 64,
989
  "metadata": {},
990
  "method": "affine",
991
+ "module_path": "language_model.model.layers.13.self_attn.v_proj",
992
  "note": "MLX-LM affine packing",
993
  "success": true
994
  },
 
998
  "group_size": 64,
999
  "metadata": {},
1000
  "method": "affine",
1001
+ "module_path": "language_model.model.layers.14.mlp.down_proj",
1002
  "note": "MLX-LM affine packing",
1003
  "success": true
1004
  },
 
1008
  "group_size": 64,
1009
  "metadata": {},
1010
  "method": "affine",
1011
+ "module_path": "language_model.model.layers.14.mlp.gate_proj",
1012
  "note": "MLX-LM affine packing",
1013
  "success": true
1014
  },
 
1018
  "group_size": 64,
1019
  "metadata": {},
1020
  "method": "affine",
1021
+ "module_path": "language_model.model.layers.14.mlp.up_proj",
1022
  "note": "MLX-LM affine packing",
1023
  "success": true
1024
  },
 
1028
  "group_size": 64,
1029
  "metadata": {},
1030
  "method": "affine",
1031
+ "module_path": "language_model.model.layers.14.self_attn.k_proj",
1032
  "note": "MLX-LM affine packing",
1033
  "success": true
1034
  },
 
1038
  "group_size": 64,
1039
  "metadata": {},
1040
  "method": "affine",
1041
+ "module_path": "language_model.model.layers.14.self_attn.o_proj",
1042
  "note": "MLX-LM affine packing",
1043
  "success": true
1044
  },
 
1048
  "group_size": 64,
1049
  "metadata": {},
1050
  "method": "affine",
1051
+ "module_path": "language_model.model.layers.14.self_attn.q_proj",
1052
  "note": "MLX-LM affine packing",
1053
  "success": true
1054
  },
 
1058
  "group_size": 64,
1059
  "metadata": {},
1060
  "method": "affine",
1061
+ "module_path": "language_model.model.layers.14.self_attn.v_proj",
1062
  "note": "MLX-LM affine packing",
1063
  "success": true
1064
  },
 
1068
  "group_size": 64,
1069
  "metadata": {},
1070
  "method": "affine",
1071
+ "module_path": "language_model.model.layers.15.mlp.down_proj",
1072
  "note": "MLX-LM affine packing",
1073
  "success": true
1074
  },
 
1078
  "group_size": 64,
1079
  "metadata": {},
1080
  "method": "affine",
1081
+ "module_path": "language_model.model.layers.15.mlp.gate_proj",
1082
  "note": "MLX-LM affine packing",
1083
  "success": true
1084
  },
 
1088
  "group_size": 64,
1089
  "metadata": {},
1090
  "method": "affine",
1091
+ "module_path": "language_model.model.layers.15.mlp.up_proj",
1092
  "note": "MLX-LM affine packing",
1093
  "success": true
1094
  },
 
1098
  "group_size": 64,
1099
  "metadata": {},
1100
  "method": "affine",
1101
+ "module_path": "language_model.model.layers.15.self_attn.k_proj",
1102
  "note": "MLX-LM affine packing",
1103
  "success": true
1104
  },
 
1108
  "group_size": 64,
1109
  "metadata": {},
1110
  "method": "affine",
1111
+ "module_path": "language_model.model.layers.15.self_attn.o_proj",
1112
  "note": "MLX-LM affine packing",
1113
  "success": true
1114
  },
 
1118
  "group_size": 64,
1119
  "metadata": {},
1120
  "method": "affine",
1121
+ "module_path": "language_model.model.layers.15.self_attn.q_proj",
1122
  "note": "MLX-LM affine packing",
1123
  "success": true
1124
  },
 
1128
  "group_size": 64,
1129
  "metadata": {},
1130
  "method": "affine",
1131
+ "module_path": "language_model.model.layers.15.self_attn.v_proj",
1132
  "note": "MLX-LM affine packing",
1133
  "success": true
1134
  },
 
1418
  "group_size": 64,
1419
  "metadata": {},
1420
  "method": "affine",
1421
+ "module_path": "language_model.model.layers.20.mlp.gate_proj",
1422
  "note": "MLX-LM affine packing",
1423
  "success": true
1424
  },
 
1428
  "group_size": 64,
1429
  "metadata": {},
1430
  "method": "affine",
1431
+ "module_path": "language_model.model.layers.20.self_attn.k_proj",
1432
  "note": "MLX-LM affine packing",
1433
  "success": true
1434
  },
 
1438
  "group_size": 64,
1439
  "metadata": {},
1440
  "method": "affine",
1441
+ "module_path": "language_model.model.layers.20.self_attn.o_proj",
1442
  "note": "MLX-LM affine packing",
1443
  "success": true
1444
  },
 
1448
  "group_size": 64,
1449
  "metadata": {},
1450
  "method": "affine",
1451
+ "module_path": "language_model.model.layers.20.self_attn.q_proj",
1452
  "note": "MLX-LM affine packing",
1453
  "success": true
1454
  },
 
1458
  "group_size": 64,
1459
  "metadata": {},
1460
  "method": "affine",
1461
+ "module_path": "language_model.model.layers.20.self_attn.v_proj",
1462
  "note": "MLX-LM affine packing",
1463
  "success": true
1464
  },
 
1468
  "group_size": 64,
1469
  "metadata": {},
1470
  "method": "affine",
1471
+ "module_path": "language_model.model.layers.20.mlp.down_proj",
1472
  "note": "MLX-LM affine packing",
1473
  "success": true
1474
  },
 
1478
  "group_size": 64,
1479
  "metadata": {},
1480
  "method": "affine",
1481
+ "module_path": "language_model.model.layers.20.mlp.up_proj",
1482
  "note": "MLX-LM affine packing",
1483
  "success": true
1484
  },
 
1648
  "group_size": 64,
1649
  "metadata": {},
1650
  "method": "affine",
1651
+ "module_path": "language_model.model.layers.23.mlp.up_proj",
1652
  "note": "MLX-LM affine packing",
1653
  "success": true
1654
  },
 
1658
  "group_size": 64,
1659
  "metadata": {},
1660
  "method": "affine",
1661
+ "module_path": "language_model.model.layers.23.self_attn.k_proj",
1662
  "note": "MLX-LM affine packing",
1663
  "success": true
1664
  },
 
1668
  "group_size": 64,
1669
  "metadata": {},
1670
  "method": "affine",
1671
+ "module_path": "language_model.model.layers.23.self_attn.o_proj",
1672
  "note": "MLX-LM affine packing",
1673
  "success": true
1674
  },
 
1678
  "group_size": 64,
1679
  "metadata": {},
1680
  "method": "affine",
1681
+ "module_path": "language_model.model.layers.23.self_attn.q_proj",
1682
  "note": "MLX-LM affine packing",
1683
  "success": true
1684
  },
 
1688
  "group_size": 64,
1689
  "metadata": {},
1690
  "method": "affine",
1691
+ "module_path": "language_model.model.layers.23.self_attn.v_proj",
1692
  "note": "MLX-LM affine packing",
1693
  "success": true
1694
  },
 
1978
  "group_size": 64,
1979
  "metadata": {},
1980
  "method": "affine",
1981
+ "module_path": "language_model.model.layers.28.mlp.gate_proj",
1982
  "note": "MLX-LM affine packing",
1983
  "success": true
1984
  },
 
1988
  "group_size": 64,
1989
  "metadata": {},
1990
  "method": "affine",
1991
+ "module_path": "language_model.model.layers.28.self_attn.k_proj",
1992
  "note": "MLX-LM affine packing",
1993
  "success": true
1994
  },
 
1998
  "group_size": 64,
1999
  "metadata": {},
2000
  "method": "affine",
2001
+ "module_path": "language_model.model.layers.28.self_attn.o_proj",
2002
  "note": "MLX-LM affine packing",
2003
  "success": true
2004
  },
 
2008
  "group_size": 64,
2009
  "metadata": {},
2010
  "method": "affine",
2011
+ "module_path": "language_model.model.layers.28.self_attn.q_proj",
2012
  "note": "MLX-LM affine packing",
2013
  "success": true
2014
  },
 
2018
  "group_size": 64,
2019
  "metadata": {},
2020
  "method": "affine",
2021
+ "module_path": "language_model.model.layers.28.self_attn.v_proj",
2022
  "note": "MLX-LM affine packing",
2023
  "success": true
2024
  },
 
2028
  "group_size": 64,
2029
  "metadata": {},
2030
  "method": "affine",
2031
+ "module_path": "language_model.model.layers.28.mlp.down_proj",
2032
  "note": "MLX-LM affine packing",
2033
  "success": true
2034
  },
 
2038
  "group_size": 64,
2039
  "metadata": {},
2040
  "method": "affine",
2041
+ "module_path": "language_model.model.layers.28.mlp.up_proj",
2042
  "note": "MLX-LM affine packing",
2043
  "success": true
2044
  },
 
2258
  "group_size": 64,
2259
  "metadata": {},
2260
  "method": "affine",
2261
+ "module_path": "language_model.model.layers.32.mlp.down_proj",
2262
  "note": "MLX-LM affine packing",
2263
  "success": true
2264
  },
 
2268
  "group_size": 64,
2269
  "metadata": {},
2270
  "method": "affine",
2271
+ "module_path": "language_model.model.layers.32.mlp.gate_proj",
2272
  "note": "MLX-LM affine packing",
2273
  "success": true
2274
  },
 
2278
  "group_size": 64,
2279
  "metadata": {},
2280
  "method": "affine",
2281
+ "module_path": "language_model.model.layers.32.mlp.up_proj",
2282
  "note": "MLX-LM affine packing",
2283
  "success": true
2284
  },
 
2288
  "group_size": 64,
2289
  "metadata": {},
2290
  "method": "affine",
2291
+ "module_path": "language_model.model.layers.32.self_attn.k_proj",
2292
  "note": "MLX-LM affine packing",
2293
  "success": true
2294
  },
 
2298
  "group_size": 64,
2299
  "metadata": {},
2300
  "method": "affine",
2301
+ "module_path": "language_model.model.layers.32.self_attn.o_proj",
2302
  "note": "MLX-LM affine packing",
2303
  "success": true
2304
  },
 
2308
  "group_size": 64,
2309
  "metadata": {},
2310
  "method": "affine",
2311
+ "module_path": "language_model.model.layers.32.self_attn.q_proj",
2312
  "note": "MLX-LM affine packing",
2313
  "success": true
2314
  },
 
2318
  "group_size": 64,
2319
  "metadata": {},
2320
  "method": "affine",
2321
+ "module_path": "language_model.model.layers.32.self_attn.v_proj",
2322
  "note": "MLX-LM affine packing",
2323
  "success": true
2324
  },
 
2425
  {
2426
  "bits": 4,
2427
  "fallback": false,
2428
+ "group_size": 64,
2429
  "metadata": {},
2430
  "method": "affine",
2431
  "module_path": "language_model.model.layers.34.self_attn.k_proj",
 
2455
  {
2456
  "bits": 4,
2457
  "fallback": false,
2458
+ "group_size": 64,
2459
  "metadata": {},
2460
  "method": "affine",
2461
  "module_path": "language_model.model.layers.34.self_attn.v_proj",
 
2495
  {
2496
  "bits": 4,
2497
  "fallback": false,
2498
+ "group_size": 64,
2499
  "metadata": {},
2500
  "method": "affine",
2501
  "module_path": "language_model.model.layers.35.self_attn.k_proj",
 
2515
  {
2516
  "bits": 4,
2517
  "fallback": false,
2518
+ "group_size": 64,
2519
  "metadata": {},
2520
  "method": "affine",
2521
  "module_path": "language_model.model.layers.35.self_attn.q_proj",
 
2525
  {
2526
  "bits": 4,
2527
  "fallback": false,
2528
+ "group_size": 64,
2529
  "metadata": {},
2530
  "method": "affine",
2531
  "module_path": "language_model.model.layers.35.self_attn.v_proj",
 
2538
  "group_size": 64,
2539
  "metadata": {},
2540
  "method": "affine",
2541
+ "module_path": "language_model.model.layers.36.mlp.gate_proj",
2542
  "note": "MLX-LM affine packing",
2543
  "success": true
2544
  },
 
2548
  "group_size": 64,
2549
  "metadata": {},
2550
  "method": "affine",
2551
+ "module_path": "language_model.model.layers.36.self_attn.k_proj",
2552
  "note": "MLX-LM affine packing",
2553
  "success": true
2554
  },
 
2558
  "group_size": 64,
2559
  "metadata": {},
2560
  "method": "affine",
2561
+ "module_path": "language_model.model.layers.36.self_attn.o_proj",
2562
  "note": "MLX-LM affine packing",
2563
  "success": true
2564
  },
2565
  {
2566
  "bits": 4,
2567
  "fallback": false,
2568
+ "group_size": 64,
2569
  "metadata": {},
2570
  "method": "affine",
2571
+ "module_path": "language_model.model.layers.36.self_attn.q_proj",
2572
  "note": "MLX-LM affine packing",
2573
  "success": true
2574
  },
2575
  {
2576
  "bits": 4,
2577
  "fallback": false,
2578
+ "group_size": 64,
2579
  "metadata": {},
2580
  "method": "affine",
2581
+ "module_path": "language_model.model.layers.36.self_attn.v_proj",
2582
  "note": "MLX-LM affine packing",
2583
  "success": true
2584
  },
2585
  {
2586
  "bits": 4,
2587
  "fallback": false,
2588
+ "group_size": 64,
2589
  "metadata": {},
2590
  "method": "affine",
2591
+ "module_path": "language_model.model.layers.36.mlp.down_proj",
2592
  "note": "MLX-LM affine packing",
2593
  "success": true
2594
  },
2595
  {
2596
  "bits": 4,
2597
  "fallback": false,
2598
+ "group_size": 64,
2599
  "metadata": {},
2600
  "method": "affine",
2601
+ "module_path": "language_model.model.layers.36.mlp.up_proj",
2602
  "note": "MLX-LM affine packing",
2603
  "success": true
2604
  },
 
2635
  {
2636
  "bits": 4,
2637
  "fallback": false,
2638
+ "group_size": 64,
2639
  "metadata": {},
2640
  "method": "affine",
2641
  "module_path": "language_model.model.layers.37.self_attn.k_proj",
 
2645
  {
2646
  "bits": 4,
2647
  "fallback": false,
2648
+ "group_size": 64,
2649
  "metadata": {},
2650
  "method": "affine",
2651
  "module_path": "language_model.model.layers.37.self_attn.o_proj",
 
2655
  {
2656
  "bits": 4,
2657
  "fallback": false,
2658
+ "group_size": 64,
2659
  "metadata": {},
2660
  "method": "affine",
2661
  "module_path": "language_model.model.layers.37.self_attn.q_proj",
 
2665
  {
2666
  "bits": 4,
2667
  "fallback": false,
2668
+ "group_size": 64,
2669
  "metadata": {},
2670
  "method": "affine",
2671
  "module_path": "language_model.model.layers.37.self_attn.v_proj",
 
2705
  {
2706
  "bits": 4,
2707
  "fallback": false,
2708
+ "group_size": 64,
2709
  "metadata": {},
2710
  "method": "affine",
2711
  "module_path": "language_model.model.layers.38.self_attn.k_proj",
 
2715
  {
2716
  "bits": 4,
2717
  "fallback": false,
2718
+ "group_size": 64,
2719
  "metadata": {},
2720
  "method": "affine",
2721
  "module_path": "language_model.model.layers.38.self_attn.o_proj",
 
2725
  {
2726
  "bits": 4,
2727
  "fallback": false,
2728
+ "group_size": 64,
2729
  "metadata": {},
2730
  "method": "affine",
2731
  "module_path": "language_model.model.layers.38.self_attn.q_proj",
 
2735
  {
2736
  "bits": 4,
2737
  "fallback": false,
2738
+ "group_size": 64,
2739
  "metadata": {},
2740
  "method": "affine",
2741
  "module_path": "language_model.model.layers.38.self_attn.v_proj",
 
2775
  {
2776
  "bits": 4,
2777
  "fallback": false,
2778
+ "group_size": 64,
2779
  "metadata": {},
2780
  "method": "affine",
2781
  "module_path": "language_model.model.layers.39.self_attn.k_proj",
axquant_runtime.json CHANGED
@@ -10,7 +10,7 @@
10
  {
11
  "compatibility_level": "B",
12
  "manifest": "config.json",
13
- "mtp_support": "runtime-dependent",
14
  "name": "mlx-lm",
15
  "notes": [
16
  "Standard backbone inference is the compatibility target.",
@@ -21,7 +21,7 @@
21
  "support_level": "standard-inference"
22
  }
23
  ],
24
- "created_at": "2026-08-02T19:52:51.472949Z",
25
  "kv_cache": null,
26
  "memory_policy": {
27
  "kv_cache_precision": "runtime-default",
@@ -45,7 +45,7 @@
45
  "primary_runtime": {
46
  "compatibility_level": "A",
47
  "manifest": "model-manifest.json",
48
- "mtp_support": "native",
49
  "name": "ax-engine",
50
  "notes": [
51
  "Runtime claims require a passing AX Engine doctor and benchmark report."
 
10
  {
11
  "compatibility_level": "B",
12
  "manifest": "config.json",
13
+ "mtp_support": "none",
14
  "name": "mlx-lm",
15
  "notes": [
16
  "Standard backbone inference is the compatibility target.",
 
21
  "support_level": "standard-inference"
22
  }
23
  ],
24
+ "created_at": "2026-08-05T08:00:22.646438Z",
25
  "kv_cache": null,
26
  "memory_policy": {
27
  "kv_cache_precision": "runtime-default",
 
45
  "primary_runtime": {
46
  "compatibility_level": "A",
47
  "manifest": "model-manifest.json",
48
+ "mtp_support": "none",
49
  "name": "ax-engine",
50
  "notes": [
51
  "Runtime claims require a passing AX Engine doctor and benchmark report."
axquant_vision_sidecar_manifest.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "created_at": "2026-08-05T08:00:22.640676Z",
3
+ "dtypes": [
4
+ "BF16"
5
+ ],
6
+ "output": {
7
+ "path": "vision.safetensors",
8
+ "sha256": "b1ae78df075fefa8f9e6eb5f157640530efd1bc51c5d07239145fa61a67d09ad",
9
+ "size_bytes": 877945912
10
+ },
11
+ "parameters": 438958080,
12
+ "role": "vision",
13
+ "schema_version": "axquant.protected-tensor-sidecar.v1",
14
+ "source_files": [
15
+ {
16
+ "path": "model-00001-of-00006.safetensors",
17
+ "sha256": "a381935aa826a6960e752ab889f51b26870fa4ae34580dc5d33bba3b616a1e3b",
18
+ "size_bytes": 4925537056
19
+ }
20
+ ],
21
+ "source_model": {
22
+ "architecture": "Mistral3ForConditionalGeneration",
23
+ "format": "mlx",
24
+ "local_path": null,
25
+ "model_id": "mistralai/Ministral-3-14B-Instruct-2512-BF16",
26
+ "revision": "3cea74c1ebaf5ce5f5a2553de470e2ceab825142"
27
+ },
28
+ "tensor_count": 222,
29
+ "tensor_names_sha256": "3fa97c3c5b5b901ab47f5427584b61d7181707f7478b7eb50cec9f2aeeb04e7f"
30
+ }
config.json CHANGED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2581a3f8a5beb43f361c0dd2886cdff436bdbad90a2b46ca3e13864e3b1e1f41
3
  size 5361479864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f11db713f005b3eee6389231907ec6aa4679de7852df665e926b7178f96a9f86
3
  size 5361479864
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7e6eba9b62bd4e3ed0035efc5254d961768e21915feb6c9adc84c52c6d91561d
3
- size 3552365268
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b53c1dd8a5203e504fb3bc7f71adca58727adc7340fccbdb8a78ad312cb170f5
3
+ size 3539585712
model.safetensors.index.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "metadata": {
3
- "total_size": 8913725440,
4
  "total_parameters": 13506073600
5
  },
6
  "weight_map": {
 
1
  {
2
  "metadata": {
3
+ "total_size": 8900945920,
4
  "total_parameters": 13506073600
5
  },
6
  "weight_map": {
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99cf274236c60277fcfad861a5a1007518687ad06ba8938760f50b55ffa0b1ef
3
- size 17077420
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5f6046775b112f0e2d456ee9dba450684ab964fe5c4e231599bdc6773028135
3
+ size 17078128
tokenizer_config.json CHANGED
@@ -1,1015 +1,17 @@
1
  {
 
2
  "backend": "tokenizers",
3
  "bos_token": "<s>",
 
4
  "eos_token": "</s>",
5
- "extra_special_tokens": [
6
- "<unk>",
7
- "<s>",
8
- "</s>",
9
- "[INST]",
10
- "[/INST]",
11
- "[AVAILABLE_TOOLS]",
12
- "[/AVAILABLE_TOOLS]",
13
- "[TOOL_RESULTS]",
14
- "[/TOOL_RESULTS]",
15
- "[TOOL_CALLS]",
16
- "[IMG]",
17
- "<pad>",
18
- "[IMG_BREAK]",
19
- "[IMG_END]",
20
- "[PREFIX]",
21
- "[MIDDLE]",
22
- "[SUFFIX]",
23
- "[SYSTEM_PROMPT]",
24
- "[/SYSTEM_PROMPT]",
25
- "[TOOL_CONTENT]",
26
- "<SPECIAL_20>",
27
- "<SPECIAL_21>",
28
- "<SPECIAL_22>",
29
- "<SPECIAL_23>",
30
- "[AUDIO]",
31
- "[BEGIN_AUDIO]",
32
- "<SPECIAL_26>",
33
- "<SPECIAL_27>",
34
- "<SPECIAL_28>",
35
- "<SPECIAL_29>",
36
- "<SPECIAL_30>",
37
- "<SPECIAL_31>",
38
- "[ARGS]",
39
- "[CALL_ID]",
40
- "<SPECIAL_34>",
41
- "<SPECIAL_35>",
42
- "<SPECIAL_36>",
43
- "<SPECIAL_37>",
44
- "<SPECIAL_38>",
45
- "<SPECIAL_39>",
46
- "<SPECIAL_40>",
47
- "<SPECIAL_41>",
48
- "<SPECIAL_42>",
49
- "<SPECIAL_43>",
50
- "<SPECIAL_44>",
51
- "<SPECIAL_45>",
52
- "<SPECIAL_46>",
53
- "<SPECIAL_47>",
54
- "<SPECIAL_48>",
55
- "<SPECIAL_49>",
56
- "<SPECIAL_50>",
57
- "<SPECIAL_51>",
58
- "<SPECIAL_52>",
59
- "<SPECIAL_53>",
60
- "<SPECIAL_54>",
61
- "<SPECIAL_55>",
62
- "<SPECIAL_56>",
63
- "<SPECIAL_57>",
64
- "<SPECIAL_58>",
65
- "<SPECIAL_59>",
66
- "<SPECIAL_60>",
67
- "<SPECIAL_61>",
68
- "<SPECIAL_62>",
69
- "<SPECIAL_63>",
70
- "<SPECIAL_64>",
71
- "<SPECIAL_65>",
72
- "<SPECIAL_66>",
73
- "<SPECIAL_67>",
74
- "<SPECIAL_68>",
75
- "<SPECIAL_69>",
76
- "<SPECIAL_70>",
77
- "<SPECIAL_71>",
78
- "<SPECIAL_72>",
79
- "<SPECIAL_73>",
80
- "<SPECIAL_74>",
81
- "<SPECIAL_75>",
82
- "<SPECIAL_76>",
83
- "<SPECIAL_77>",
84
- "<SPECIAL_78>",
85
- "<SPECIAL_79>",
86
- "<SPECIAL_80>",
87
- "<SPECIAL_81>",
88
- "<SPECIAL_82>",
89
- "<SPECIAL_83>",
90
- "<SPECIAL_84>",
91
- "<SPECIAL_85>",
92
- "<SPECIAL_86>",
93
- "<SPECIAL_87>",
94
- "<SPECIAL_88>",
95
- "<SPECIAL_89>",
96
- "<SPECIAL_90>",
97
- "<SPECIAL_91>",
98
- "<SPECIAL_92>",
99
- "<SPECIAL_93>",
100
- "<SPECIAL_94>",
101
- "<SPECIAL_95>",
102
- "<SPECIAL_96>",
103
- "<SPECIAL_97>",
104
- "<SPECIAL_98>",
105
- "<SPECIAL_99>",
106
- "<SPECIAL_100>",
107
- "<SPECIAL_101>",
108
- "<SPECIAL_102>",
109
- "<SPECIAL_103>",
110
- "<SPECIAL_104>",
111
- "<SPECIAL_105>",
112
- "<SPECIAL_106>",
113
- "<SPECIAL_107>",
114
- "<SPECIAL_108>",
115
- "<SPECIAL_109>",
116
- "<SPECIAL_110>",
117
- "<SPECIAL_111>",
118
- "<SPECIAL_112>",
119
- "<SPECIAL_113>",
120
- "<SPECIAL_114>",
121
- "<SPECIAL_115>",
122
- "<SPECIAL_116>",
123
- "<SPECIAL_117>",
124
- "<SPECIAL_118>",
125
- "<SPECIAL_119>",
126
- "<SPECIAL_120>",
127
- "<SPECIAL_121>",
128
- "<SPECIAL_122>",
129
- "<SPECIAL_123>",
130
- "<SPECIAL_124>",
131
- "<SPECIAL_125>",
132
- "<SPECIAL_126>",
133
- "<SPECIAL_127>",
134
- "<SPECIAL_128>",
135
- "<SPECIAL_129>",
136
- "<SPECIAL_130>",
137
- "<SPECIAL_131>",
138
- "<SPECIAL_132>",
139
- "<SPECIAL_133>",
140
- "<SPECIAL_134>",
141
- "<SPECIAL_135>",
142
- "<SPECIAL_136>",
143
- "<SPECIAL_137>",
144
- "<SPECIAL_138>",
145
- "<SPECIAL_139>",
146
- "<SPECIAL_140>",
147
- "<SPECIAL_141>",
148
- "<SPECIAL_142>",
149
- "<SPECIAL_143>",
150
- "<SPECIAL_144>",
151
- "<SPECIAL_145>",
152
- "<SPECIAL_146>",
153
- "<SPECIAL_147>",
154
- "<SPECIAL_148>",
155
- "<SPECIAL_149>",
156
- "<SPECIAL_150>",
157
- "<SPECIAL_151>",
158
- "<SPECIAL_152>",
159
- "<SPECIAL_153>",
160
- "<SPECIAL_154>",
161
- "<SPECIAL_155>",
162
- "<SPECIAL_156>",
163
- "<SPECIAL_157>",
164
- "<SPECIAL_158>",
165
- "<SPECIAL_159>",
166
- "<SPECIAL_160>",
167
- "<SPECIAL_161>",
168
- "<SPECIAL_162>",
169
- "<SPECIAL_163>",
170
- "<SPECIAL_164>",
171
- "<SPECIAL_165>",
172
- "<SPECIAL_166>",
173
- "<SPECIAL_167>",
174
- "<SPECIAL_168>",
175
- "<SPECIAL_169>",
176
- "<SPECIAL_170>",
177
- "<SPECIAL_171>",
178
- "<SPECIAL_172>",
179
- "<SPECIAL_173>",
180
- "<SPECIAL_174>",
181
- "<SPECIAL_175>",
182
- "<SPECIAL_176>",
183
- "<SPECIAL_177>",
184
- "<SPECIAL_178>",
185
- "<SPECIAL_179>",
186
- "<SPECIAL_180>",
187
- "<SPECIAL_181>",
188
- "<SPECIAL_182>",
189
- "<SPECIAL_183>",
190
- "<SPECIAL_184>",
191
- "<SPECIAL_185>",
192
- "<SPECIAL_186>",
193
- "<SPECIAL_187>",
194
- "<SPECIAL_188>",
195
- "<SPECIAL_189>",
196
- "<SPECIAL_190>",
197
- "<SPECIAL_191>",
198
- "<SPECIAL_192>",
199
- "<SPECIAL_193>",
200
- "<SPECIAL_194>",
201
- "<SPECIAL_195>",
202
- "<SPECIAL_196>",
203
- "<SPECIAL_197>",
204
- "<SPECIAL_198>",
205
- "<SPECIAL_199>",
206
- "<SPECIAL_200>",
207
- "<SPECIAL_201>",
208
- "<SPECIAL_202>",
209
- "<SPECIAL_203>",
210
- "<SPECIAL_204>",
211
- "<SPECIAL_205>",
212
- "<SPECIAL_206>",
213
- "<SPECIAL_207>",
214
- "<SPECIAL_208>",
215
- "<SPECIAL_209>",
216
- "<SPECIAL_210>",
217
- "<SPECIAL_211>",
218
- "<SPECIAL_212>",
219
- "<SPECIAL_213>",
220
- "<SPECIAL_214>",
221
- "<SPECIAL_215>",
222
- "<SPECIAL_216>",
223
- "<SPECIAL_217>",
224
- "<SPECIAL_218>",
225
- "<SPECIAL_219>",
226
- "<SPECIAL_220>",
227
- "<SPECIAL_221>",
228
- "<SPECIAL_222>",
229
- "<SPECIAL_223>",
230
- "<SPECIAL_224>",
231
- "<SPECIAL_225>",
232
- "<SPECIAL_226>",
233
- "<SPECIAL_227>",
234
- "<SPECIAL_228>",
235
- "<SPECIAL_229>",
236
- "<SPECIAL_230>",
237
- "<SPECIAL_231>",
238
- "<SPECIAL_232>",
239
- "<SPECIAL_233>",
240
- "<SPECIAL_234>",
241
- "<SPECIAL_235>",
242
- "<SPECIAL_236>",
243
- "<SPECIAL_237>",
244
- "<SPECIAL_238>",
245
- "<SPECIAL_239>",
246
- "<SPECIAL_240>",
247
- "<SPECIAL_241>",
248
- "<SPECIAL_242>",
249
- "<SPECIAL_243>",
250
- "<SPECIAL_244>",
251
- "<SPECIAL_245>",
252
- "<SPECIAL_246>",
253
- "<SPECIAL_247>",
254
- "<SPECIAL_248>",
255
- "<SPECIAL_249>",
256
- "<SPECIAL_250>",
257
- "<SPECIAL_251>",
258
- "<SPECIAL_252>",
259
- "<SPECIAL_253>",
260
- "<SPECIAL_254>",
261
- "<SPECIAL_255>",
262
- "<SPECIAL_256>",
263
- "<SPECIAL_257>",
264
- "<SPECIAL_258>",
265
- "<SPECIAL_259>",
266
- "<SPECIAL_260>",
267
- "<SPECIAL_261>",
268
- "<SPECIAL_262>",
269
- "<SPECIAL_263>",
270
- "<SPECIAL_264>",
271
- "<SPECIAL_265>",
272
- "<SPECIAL_266>",
273
- "<SPECIAL_267>",
274
- "<SPECIAL_268>",
275
- "<SPECIAL_269>",
276
- "<SPECIAL_270>",
277
- "<SPECIAL_271>",
278
- "<SPECIAL_272>",
279
- "<SPECIAL_273>",
280
- "<SPECIAL_274>",
281
- "<SPECIAL_275>",
282
- "<SPECIAL_276>",
283
- "<SPECIAL_277>",
284
- "<SPECIAL_278>",
285
- "<SPECIAL_279>",
286
- "<SPECIAL_280>",
287
- "<SPECIAL_281>",
288
- "<SPECIAL_282>",
289
- "<SPECIAL_283>",
290
- "<SPECIAL_284>",
291
- "<SPECIAL_285>",
292
- "<SPECIAL_286>",
293
- "<SPECIAL_287>",
294
- "<SPECIAL_288>",
295
- "<SPECIAL_289>",
296
- "<SPECIAL_290>",
297
- "<SPECIAL_291>",
298
- "<SPECIAL_292>",
299
- "<SPECIAL_293>",
300
- "<SPECIAL_294>",
301
- "<SPECIAL_295>",
302
- "<SPECIAL_296>",
303
- "<SPECIAL_297>",
304
- "<SPECIAL_298>",
305
- "<SPECIAL_299>",
306
- "<SPECIAL_300>",
307
- "<SPECIAL_301>",
308
- "<SPECIAL_302>",
309
- "<SPECIAL_303>",
310
- "<SPECIAL_304>",
311
- "<SPECIAL_305>",
312
- "<SPECIAL_306>",
313
- "<SPECIAL_307>",
314
- "<SPECIAL_308>",
315
- "<SPECIAL_309>",
316
- "<SPECIAL_310>",
317
- "<SPECIAL_311>",
318
- "<SPECIAL_312>",
319
- "<SPECIAL_313>",
320
- "<SPECIAL_314>",
321
- "<SPECIAL_315>",
322
- "<SPECIAL_316>",
323
- "<SPECIAL_317>",
324
- "<SPECIAL_318>",
325
- "<SPECIAL_319>",
326
- "<SPECIAL_320>",
327
- "<SPECIAL_321>",
328
- "<SPECIAL_322>",
329
- "<SPECIAL_323>",
330
- "<SPECIAL_324>",
331
- "<SPECIAL_325>",
332
- "<SPECIAL_326>",
333
- "<SPECIAL_327>",
334
- "<SPECIAL_328>",
335
- "<SPECIAL_329>",
336
- "<SPECIAL_330>",
337
- "<SPECIAL_331>",
338
- "<SPECIAL_332>",
339
- "<SPECIAL_333>",
340
- "<SPECIAL_334>",
341
- "<SPECIAL_335>",
342
- "<SPECIAL_336>",
343
- "<SPECIAL_337>",
344
- "<SPECIAL_338>",
345
- "<SPECIAL_339>",
346
- "<SPECIAL_340>",
347
- "<SPECIAL_341>",
348
- "<SPECIAL_342>",
349
- "<SPECIAL_343>",
350
- "<SPECIAL_344>",
351
- "<SPECIAL_345>",
352
- "<SPECIAL_346>",
353
- "<SPECIAL_347>",
354
- "<SPECIAL_348>",
355
- "<SPECIAL_349>",
356
- "<SPECIAL_350>",
357
- "<SPECIAL_351>",
358
- "<SPECIAL_352>",
359
- "<SPECIAL_353>",
360
- "<SPECIAL_354>",
361
- "<SPECIAL_355>",
362
- "<SPECIAL_356>",
363
- "<SPECIAL_357>",
364
- "<SPECIAL_358>",
365
- "<SPECIAL_359>",
366
- "<SPECIAL_360>",
367
- "<SPECIAL_361>",
368
- "<SPECIAL_362>",
369
- "<SPECIAL_363>",
370
- "<SPECIAL_364>",
371
- "<SPECIAL_365>",
372
- "<SPECIAL_366>",
373
- "<SPECIAL_367>",
374
- "<SPECIAL_368>",
375
- "<SPECIAL_369>",
376
- "<SPECIAL_370>",
377
- "<SPECIAL_371>",
378
- "<SPECIAL_372>",
379
- "<SPECIAL_373>",
380
- "<SPECIAL_374>",
381
- "<SPECIAL_375>",
382
- "<SPECIAL_376>",
383
- "<SPECIAL_377>",
384
- "<SPECIAL_378>",
385
- "<SPECIAL_379>",
386
- "<SPECIAL_380>",
387
- "<SPECIAL_381>",
388
- "<SPECIAL_382>",
389
- "<SPECIAL_383>",
390
- "<SPECIAL_384>",
391
- "<SPECIAL_385>",
392
- "<SPECIAL_386>",
393
- "<SPECIAL_387>",
394
- "<SPECIAL_388>",
395
- "<SPECIAL_389>",
396
- "<SPECIAL_390>",
397
- "<SPECIAL_391>",
398
- "<SPECIAL_392>",
399
- "<SPECIAL_393>",
400
- "<SPECIAL_394>",
401
- "<SPECIAL_395>",
402
- "<SPECIAL_396>",
403
- "<SPECIAL_397>",
404
- "<SPECIAL_398>",
405
- "<SPECIAL_399>",
406
- "<SPECIAL_400>",
407
- "<SPECIAL_401>",
408
- "<SPECIAL_402>",
409
- "<SPECIAL_403>",
410
- "<SPECIAL_404>",
411
- "<SPECIAL_405>",
412
- "<SPECIAL_406>",
413
- "<SPECIAL_407>",
414
- "<SPECIAL_408>",
415
- "<SPECIAL_409>",
416
- "<SPECIAL_410>",
417
- "<SPECIAL_411>",
418
- "<SPECIAL_412>",
419
- "<SPECIAL_413>",
420
- "<SPECIAL_414>",
421
- "<SPECIAL_415>",
422
- "<SPECIAL_416>",
423
- "<SPECIAL_417>",
424
- "<SPECIAL_418>",
425
- "<SPECIAL_419>",
426
- "<SPECIAL_420>",
427
- "<SPECIAL_421>",
428
- "<SPECIAL_422>",
429
- "<SPECIAL_423>",
430
- "<SPECIAL_424>",
431
- "<SPECIAL_425>",
432
- "<SPECIAL_426>",
433
- "<SPECIAL_427>",
434
- "<SPECIAL_428>",
435
- "<SPECIAL_429>",
436
- "<SPECIAL_430>",
437
- "<SPECIAL_431>",
438
- "<SPECIAL_432>",
439
- "<SPECIAL_433>",
440
- "<SPECIAL_434>",
441
- "<SPECIAL_435>",
442
- "<SPECIAL_436>",
443
- "<SPECIAL_437>",
444
- "<SPECIAL_438>",
445
- "<SPECIAL_439>",
446
- "<SPECIAL_440>",
447
- "<SPECIAL_441>",
448
- "<SPECIAL_442>",
449
- "<SPECIAL_443>",
450
- "<SPECIAL_444>",
451
- "<SPECIAL_445>",
452
- "<SPECIAL_446>",
453
- "<SPECIAL_447>",
454
- "<SPECIAL_448>",
455
- "<SPECIAL_449>",
456
- "<SPECIAL_450>",
457
- "<SPECIAL_451>",
458
- "<SPECIAL_452>",
459
- "<SPECIAL_453>",
460
- "<SPECIAL_454>",
461
- "<SPECIAL_455>",
462
- "<SPECIAL_456>",
463
- "<SPECIAL_457>",
464
- "<SPECIAL_458>",
465
- "<SPECIAL_459>",
466
- "<SPECIAL_460>",
467
- "<SPECIAL_461>",
468
- "<SPECIAL_462>",
469
- "<SPECIAL_463>",
470
- "<SPECIAL_464>",
471
- "<SPECIAL_465>",
472
- "<SPECIAL_466>",
473
- "<SPECIAL_467>",
474
- "<SPECIAL_468>",
475
- "<SPECIAL_469>",
476
- "<SPECIAL_470>",
477
- "<SPECIAL_471>",
478
- "<SPECIAL_472>",
479
- "<SPECIAL_473>",
480
- "<SPECIAL_474>",
481
- "<SPECIAL_475>",
482
- "<SPECIAL_476>",
483
- "<SPECIAL_477>",
484
- "<SPECIAL_478>",
485
- "<SPECIAL_479>",
486
- "<SPECIAL_480>",
487
- "<SPECIAL_481>",
488
- "<SPECIAL_482>",
489
- "<SPECIAL_483>",
490
- "<SPECIAL_484>",
491
- "<SPECIAL_485>",
492
- "<SPECIAL_486>",
493
- "<SPECIAL_487>",
494
- "<SPECIAL_488>",
495
- "<SPECIAL_489>",
496
- "<SPECIAL_490>",
497
- "<SPECIAL_491>",
498
- "<SPECIAL_492>",
499
- "<SPECIAL_493>",
500
- "<SPECIAL_494>",
501
- "<SPECIAL_495>",
502
- "<SPECIAL_496>",
503
- "<SPECIAL_497>",
504
- "<SPECIAL_498>",
505
- "<SPECIAL_499>",
506
- "<SPECIAL_500>",
507
- "<SPECIAL_501>",
508
- "<SPECIAL_502>",
509
- "<SPECIAL_503>",
510
- "<SPECIAL_504>",
511
- "<SPECIAL_505>",
512
- "<SPECIAL_506>",
513
- "<SPECIAL_507>",
514
- "<SPECIAL_508>",
515
- "<SPECIAL_509>",
516
- "<SPECIAL_510>",
517
- "<SPECIAL_511>",
518
- "<SPECIAL_512>",
519
- "<SPECIAL_513>",
520
- "<SPECIAL_514>",
521
- "<SPECIAL_515>",
522
- "<SPECIAL_516>",
523
- "<SPECIAL_517>",
524
- "<SPECIAL_518>",
525
- "<SPECIAL_519>",
526
- "<SPECIAL_520>",
527
- "<SPECIAL_521>",
528
- "<SPECIAL_522>",
529
- "<SPECIAL_523>",
530
- "<SPECIAL_524>",
531
- "<SPECIAL_525>",
532
- "<SPECIAL_526>",
533
- "<SPECIAL_527>",
534
- "<SPECIAL_528>",
535
- "<SPECIAL_529>",
536
- "<SPECIAL_530>",
537
- "<SPECIAL_531>",
538
- "<SPECIAL_532>",
539
- "<SPECIAL_533>",
540
- "<SPECIAL_534>",
541
- "<SPECIAL_535>",
542
- "<SPECIAL_536>",
543
- "<SPECIAL_537>",
544
- "<SPECIAL_538>",
545
- "<SPECIAL_539>",
546
- "<SPECIAL_540>",
547
- "<SPECIAL_541>",
548
- "<SPECIAL_542>",
549
- "<SPECIAL_543>",
550
- "<SPECIAL_544>",
551
- "<SPECIAL_545>",
552
- "<SPECIAL_546>",
553
- "<SPECIAL_547>",
554
- "<SPECIAL_548>",
555
- "<SPECIAL_549>",
556
- "<SPECIAL_550>",
557
- "<SPECIAL_551>",
558
- "<SPECIAL_552>",
559
- "<SPECIAL_553>",
560
- "<SPECIAL_554>",
561
- "<SPECIAL_555>",
562
- "<SPECIAL_556>",
563
- "<SPECIAL_557>",
564
- "<SPECIAL_558>",
565
- "<SPECIAL_559>",
566
- "<SPECIAL_560>",
567
- "<SPECIAL_561>",
568
- "<SPECIAL_562>",
569
- "<SPECIAL_563>",
570
- "<SPECIAL_564>",
571
- "<SPECIAL_565>",
572
- "<SPECIAL_566>",
573
- "<SPECIAL_567>",
574
- "<SPECIAL_568>",
575
- "<SPECIAL_569>",
576
- "<SPECIAL_570>",
577
- "<SPECIAL_571>",
578
- "<SPECIAL_572>",
579
- "<SPECIAL_573>",
580
- "<SPECIAL_574>",
581
- "<SPECIAL_575>",
582
- "<SPECIAL_576>",
583
- "<SPECIAL_577>",
584
- "<SPECIAL_578>",
585
- "<SPECIAL_579>",
586
- "<SPECIAL_580>",
587
- "<SPECIAL_581>",
588
- "<SPECIAL_582>",
589
- "<SPECIAL_583>",
590
- "<SPECIAL_584>",
591
- "<SPECIAL_585>",
592
- "<SPECIAL_586>",
593
- "<SPECIAL_587>",
594
- "<SPECIAL_588>",
595
- "<SPECIAL_589>",
596
- "<SPECIAL_590>",
597
- "<SPECIAL_591>",
598
- "<SPECIAL_592>",
599
- "<SPECIAL_593>",
600
- "<SPECIAL_594>",
601
- "<SPECIAL_595>",
602
- "<SPECIAL_596>",
603
- "<SPECIAL_597>",
604
- "<SPECIAL_598>",
605
- "<SPECIAL_599>",
606
- "<SPECIAL_600>",
607
- "<SPECIAL_601>",
608
- "<SPECIAL_602>",
609
- "<SPECIAL_603>",
610
- "<SPECIAL_604>",
611
- "<SPECIAL_605>",
612
- "<SPECIAL_606>",
613
- "<SPECIAL_607>",
614
- "<SPECIAL_608>",
615
- "<SPECIAL_609>",
616
- "<SPECIAL_610>",
617
- "<SPECIAL_611>",
618
- "<SPECIAL_612>",
619
- "<SPECIAL_613>",
620
- "<SPECIAL_614>",
621
- "<SPECIAL_615>",
622
- "<SPECIAL_616>",
623
- "<SPECIAL_617>",
624
- "<SPECIAL_618>",
625
- "<SPECIAL_619>",
626
- "<SPECIAL_620>",
627
- "<SPECIAL_621>",
628
- "<SPECIAL_622>",
629
- "<SPECIAL_623>",
630
- "<SPECIAL_624>",
631
- "<SPECIAL_625>",
632
- "<SPECIAL_626>",
633
- "<SPECIAL_627>",
634
- "<SPECIAL_628>",
635
- "<SPECIAL_629>",
636
- "<SPECIAL_630>",
637
- "<SPECIAL_631>",
638
- "<SPECIAL_632>",
639
- "<SPECIAL_633>",
640
- "<SPECIAL_634>",
641
- "<SPECIAL_635>",
642
- "<SPECIAL_636>",
643
- "<SPECIAL_637>",
644
- "<SPECIAL_638>",
645
- "<SPECIAL_639>",
646
- "<SPECIAL_640>",
647
- "<SPECIAL_641>",
648
- "<SPECIAL_642>",
649
- "<SPECIAL_643>",
650
- "<SPECIAL_644>",
651
- "<SPECIAL_645>",
652
- "<SPECIAL_646>",
653
- "<SPECIAL_647>",
654
- "<SPECIAL_648>",
655
- "<SPECIAL_649>",
656
- "<SPECIAL_650>",
657
- "<SPECIAL_651>",
658
- "<SPECIAL_652>",
659
- "<SPECIAL_653>",
660
- "<SPECIAL_654>",
661
- "<SPECIAL_655>",
662
- "<SPECIAL_656>",
663
- "<SPECIAL_657>",
664
- "<SPECIAL_658>",
665
- "<SPECIAL_659>",
666
- "<SPECIAL_660>",
667
- "<SPECIAL_661>",
668
- "<SPECIAL_662>",
669
- "<SPECIAL_663>",
670
- "<SPECIAL_664>",
671
- "<SPECIAL_665>",
672
- "<SPECIAL_666>",
673
- "<SPECIAL_667>",
674
- "<SPECIAL_668>",
675
- "<SPECIAL_669>",
676
- "<SPECIAL_670>",
677
- "<SPECIAL_671>",
678
- "<SPECIAL_672>",
679
- "<SPECIAL_673>",
680
- "<SPECIAL_674>",
681
- "<SPECIAL_675>",
682
- "<SPECIAL_676>",
683
- "<SPECIAL_677>",
684
- "<SPECIAL_678>",
685
- "<SPECIAL_679>",
686
- "<SPECIAL_680>",
687
- "<SPECIAL_681>",
688
- "<SPECIAL_682>",
689
- "<SPECIAL_683>",
690
- "<SPECIAL_684>",
691
- "<SPECIAL_685>",
692
- "<SPECIAL_686>",
693
- "<SPECIAL_687>",
694
- "<SPECIAL_688>",
695
- "<SPECIAL_689>",
696
- "<SPECIAL_690>",
697
- "<SPECIAL_691>",
698
- "<SPECIAL_692>",
699
- "<SPECIAL_693>",
700
- "<SPECIAL_694>",
701
- "<SPECIAL_695>",
702
- "<SPECIAL_696>",
703
- "<SPECIAL_697>",
704
- "<SPECIAL_698>",
705
- "<SPECIAL_699>",
706
- "<SPECIAL_700>",
707
- "<SPECIAL_701>",
708
- "<SPECIAL_702>",
709
- "<SPECIAL_703>",
710
- "<SPECIAL_704>",
711
- "<SPECIAL_705>",
712
- "<SPECIAL_706>",
713
- "<SPECIAL_707>",
714
- "<SPECIAL_708>",
715
- "<SPECIAL_709>",
716
- "<SPECIAL_710>",
717
- "<SPECIAL_711>",
718
- "<SPECIAL_712>",
719
- "<SPECIAL_713>",
720
- "<SPECIAL_714>",
721
- "<SPECIAL_715>",
722
- "<SPECIAL_716>",
723
- "<SPECIAL_717>",
724
- "<SPECIAL_718>",
725
- "<SPECIAL_719>",
726
- "<SPECIAL_720>",
727
- "<SPECIAL_721>",
728
- "<SPECIAL_722>",
729
- "<SPECIAL_723>",
730
- "<SPECIAL_724>",
731
- "<SPECIAL_725>",
732
- "<SPECIAL_726>",
733
- "<SPECIAL_727>",
734
- "<SPECIAL_728>",
735
- "<SPECIAL_729>",
736
- "<SPECIAL_730>",
737
- "<SPECIAL_731>",
738
- "<SPECIAL_732>",
739
- "<SPECIAL_733>",
740
- "<SPECIAL_734>",
741
- "<SPECIAL_735>",
742
- "<SPECIAL_736>",
743
- "<SPECIAL_737>",
744
- "<SPECIAL_738>",
745
- "<SPECIAL_739>",
746
- "<SPECIAL_740>",
747
- "<SPECIAL_741>",
748
- "<SPECIAL_742>",
749
- "<SPECIAL_743>",
750
- "<SPECIAL_744>",
751
- "<SPECIAL_745>",
752
- "<SPECIAL_746>",
753
- "<SPECIAL_747>",
754
- "<SPECIAL_748>",
755
- "<SPECIAL_749>",
756
- "<SPECIAL_750>",
757
- "<SPECIAL_751>",
758
- "<SPECIAL_752>",
759
- "<SPECIAL_753>",
760
- "<SPECIAL_754>",
761
- "<SPECIAL_755>",
762
- "<SPECIAL_756>",
763
- "<SPECIAL_757>",
764
- "<SPECIAL_758>",
765
- "<SPECIAL_759>",
766
- "<SPECIAL_760>",
767
- "<SPECIAL_761>",
768
- "<SPECIAL_762>",
769
- "<SPECIAL_763>",
770
- "<SPECIAL_764>",
771
- "<SPECIAL_765>",
772
- "<SPECIAL_766>",
773
- "<SPECIAL_767>",
774
- "<SPECIAL_768>",
775
- "<SPECIAL_769>",
776
- "<SPECIAL_770>",
777
- "<SPECIAL_771>",
778
- "<SPECIAL_772>",
779
- "<SPECIAL_773>",
780
- "<SPECIAL_774>",
781
- "<SPECIAL_775>",
782
- "<SPECIAL_776>",
783
- "<SPECIAL_777>",
784
- "<SPECIAL_778>",
785
- "<SPECIAL_779>",
786
- "<SPECIAL_780>",
787
- "<SPECIAL_781>",
788
- "<SPECIAL_782>",
789
- "<SPECIAL_783>",
790
- "<SPECIAL_784>",
791
- "<SPECIAL_785>",
792
- "<SPECIAL_786>",
793
- "<SPECIAL_787>",
794
- "<SPECIAL_788>",
795
- "<SPECIAL_789>",
796
- "<SPECIAL_790>",
797
- "<SPECIAL_791>",
798
- "<SPECIAL_792>",
799
- "<SPECIAL_793>",
800
- "<SPECIAL_794>",
801
- "<SPECIAL_795>",
802
- "<SPECIAL_796>",
803
- "<SPECIAL_797>",
804
- "<SPECIAL_798>",
805
- "<SPECIAL_799>",
806
- "<SPECIAL_800>",
807
- "<SPECIAL_801>",
808
- "<SPECIAL_802>",
809
- "<SPECIAL_803>",
810
- "<SPECIAL_804>",
811
- "<SPECIAL_805>",
812
- "<SPECIAL_806>",
813
- "<SPECIAL_807>",
814
- "<SPECIAL_808>",
815
- "<SPECIAL_809>",
816
- "<SPECIAL_810>",
817
- "<SPECIAL_811>",
818
- "<SPECIAL_812>",
819
- "<SPECIAL_813>",
820
- "<SPECIAL_814>",
821
- "<SPECIAL_815>",
822
- "<SPECIAL_816>",
823
- "<SPECIAL_817>",
824
- "<SPECIAL_818>",
825
- "<SPECIAL_819>",
826
- "<SPECIAL_820>",
827
- "<SPECIAL_821>",
828
- "<SPECIAL_822>",
829
- "<SPECIAL_823>",
830
- "<SPECIAL_824>",
831
- "<SPECIAL_825>",
832
- "<SPECIAL_826>",
833
- "<SPECIAL_827>",
834
- "<SPECIAL_828>",
835
- "<SPECIAL_829>",
836
- "<SPECIAL_830>",
837
- "<SPECIAL_831>",
838
- "<SPECIAL_832>",
839
- "<SPECIAL_833>",
840
- "<SPECIAL_834>",
841
- "<SPECIAL_835>",
842
- "<SPECIAL_836>",
843
- "<SPECIAL_837>",
844
- "<SPECIAL_838>",
845
- "<SPECIAL_839>",
846
- "<SPECIAL_840>",
847
- "<SPECIAL_841>",
848
- "<SPECIAL_842>",
849
- "<SPECIAL_843>",
850
- "<SPECIAL_844>",
851
- "<SPECIAL_845>",
852
- "<SPECIAL_846>",
853
- "<SPECIAL_847>",
854
- "<SPECIAL_848>",
855
- "<SPECIAL_849>",
856
- "<SPECIAL_850>",
857
- "<SPECIAL_851>",
858
- "<SPECIAL_852>",
859
- "<SPECIAL_853>",
860
- "<SPECIAL_854>",
861
- "<SPECIAL_855>",
862
- "<SPECIAL_856>",
863
- "<SPECIAL_857>",
864
- "<SPECIAL_858>",
865
- "<SPECIAL_859>",
866
- "<SPECIAL_860>",
867
- "<SPECIAL_861>",
868
- "<SPECIAL_862>",
869
- "<SPECIAL_863>",
870
- "<SPECIAL_864>",
871
- "<SPECIAL_865>",
872
- "<SPECIAL_866>",
873
- "<SPECIAL_867>",
874
- "<SPECIAL_868>",
875
- "<SPECIAL_869>",
876
- "<SPECIAL_870>",
877
- "<SPECIAL_871>",
878
- "<SPECIAL_872>",
879
- "<SPECIAL_873>",
880
- "<SPECIAL_874>",
881
- "<SPECIAL_875>",
882
- "<SPECIAL_876>",
883
- "<SPECIAL_877>",
884
- "<SPECIAL_878>",
885
- "<SPECIAL_879>",
886
- "<SPECIAL_880>",
887
- "<SPECIAL_881>",
888
- "<SPECIAL_882>",
889
- "<SPECIAL_883>",
890
- "<SPECIAL_884>",
891
- "<SPECIAL_885>",
892
- "<SPECIAL_886>",
893
- "<SPECIAL_887>",
894
- "<SPECIAL_888>",
895
- "<SPECIAL_889>",
896
- "<SPECIAL_890>",
897
- "<SPECIAL_891>",
898
- "<SPECIAL_892>",
899
- "<SPECIAL_893>",
900
- "<SPECIAL_894>",
901
- "<SPECIAL_895>",
902
- "<SPECIAL_896>",
903
- "<SPECIAL_897>",
904
- "<SPECIAL_898>",
905
- "<SPECIAL_899>",
906
- "<SPECIAL_900>",
907
- "<SPECIAL_901>",
908
- "<SPECIAL_902>",
909
- "<SPECIAL_903>",
910
- "<SPECIAL_904>",
911
- "<SPECIAL_905>",
912
- "<SPECIAL_906>",
913
- "<SPECIAL_907>",
914
- "<SPECIAL_908>",
915
- "<SPECIAL_909>",
916
- "<SPECIAL_910>",
917
- "<SPECIAL_911>",
918
- "<SPECIAL_912>",
919
- "<SPECIAL_913>",
920
- "<SPECIAL_914>",
921
- "<SPECIAL_915>",
922
- "<SPECIAL_916>",
923
- "<SPECIAL_917>",
924
- "<SPECIAL_918>",
925
- "<SPECIAL_919>",
926
- "<SPECIAL_920>",
927
- "<SPECIAL_921>",
928
- "<SPECIAL_922>",
929
- "<SPECIAL_923>",
930
- "<SPECIAL_924>",
931
- "<SPECIAL_925>",
932
- "<SPECIAL_926>",
933
- "<SPECIAL_927>",
934
- "<SPECIAL_928>",
935
- "<SPECIAL_929>",
936
- "<SPECIAL_930>",
937
- "<SPECIAL_931>",
938
- "<SPECIAL_932>",
939
- "<SPECIAL_933>",
940
- "<SPECIAL_934>",
941
- "<SPECIAL_935>",
942
- "<SPECIAL_936>",
943
- "<SPECIAL_937>",
944
- "<SPECIAL_938>",
945
- "<SPECIAL_939>",
946
- "<SPECIAL_940>",
947
- "<SPECIAL_941>",
948
- "<SPECIAL_942>",
949
- "<SPECIAL_943>",
950
- "<SPECIAL_944>",
951
- "<SPECIAL_945>",
952
- "<SPECIAL_946>",
953
- "<SPECIAL_947>",
954
- "<SPECIAL_948>",
955
- "<SPECIAL_949>",
956
- "<SPECIAL_950>",
957
- "<SPECIAL_951>",
958
- "<SPECIAL_952>",
959
- "<SPECIAL_953>",
960
- "<SPECIAL_954>",
961
- "<SPECIAL_955>",
962
- "<SPECIAL_956>",
963
- "<SPECIAL_957>",
964
- "<SPECIAL_958>",
965
- "<SPECIAL_959>",
966
- "<SPECIAL_960>",
967
- "<SPECIAL_961>",
968
- "<SPECIAL_962>",
969
- "<SPECIAL_963>",
970
- "<SPECIAL_964>",
971
- "<SPECIAL_965>",
972
- "<SPECIAL_966>",
973
- "<SPECIAL_967>",
974
- "<SPECIAL_968>",
975
- "<SPECIAL_969>",
976
- "<SPECIAL_970>",
977
- "<SPECIAL_971>",
978
- "<SPECIAL_972>",
979
- "<SPECIAL_973>",
980
- "<SPECIAL_974>",
981
- "<SPECIAL_975>",
982
- "<SPECIAL_976>",
983
- "<SPECIAL_977>",
984
- "<SPECIAL_978>",
985
- "<SPECIAL_979>",
986
- "<SPECIAL_980>",
987
- "<SPECIAL_981>",
988
- "<SPECIAL_982>",
989
- "<SPECIAL_983>",
990
- "<SPECIAL_984>",
991
- "<SPECIAL_985>",
992
- "<SPECIAL_986>",
993
- "<SPECIAL_987>",
994
- "<SPECIAL_988>",
995
- "<SPECIAL_989>",
996
- "<SPECIAL_990>",
997
- "<SPECIAL_991>",
998
- "<SPECIAL_992>",
999
- "<SPECIAL_993>",
1000
- "<SPECIAL_994>",
1001
- "<SPECIAL_995>",
1002
- "<SPECIAL_996>",
1003
- "<SPECIAL_997>",
1004
- "<SPECIAL_998>",
1005
- "<SPECIAL_999>"
1006
- ],
1007
  "is_local": true,
 
1008
  "local_files_only": false,
1009
  "model_max_length": 1000000000000000019884624838656,
1010
  "pad_token": "<pad>",
1011
  "processor_class": "PixtralProcessor",
1012
  "tokenizer_class": "TokenizersBackend",
1013
  "tool_parser_type": "mistral",
1014
- "unk_token": "<unk>"
 
1015
  }
 
1
  {
2
+ "add_prefix_space": null,
3
  "backend": "tokenizers",
4
  "bos_token": "<s>",
5
+ "clean_up_tokenization_spaces": false,
6
  "eos_token": "</s>",
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  "is_local": true,
8
+ "legacy": true,
9
  "local_files_only": false,
10
  "model_max_length": 1000000000000000019884624838656,
11
  "pad_token": "<pad>",
12
  "processor_class": "PixtralProcessor",
13
  "tokenizer_class": "TokenizersBackend",
14
  "tool_parser_type": "mistral",
15
+ "unk_token": "<unk>",
16
+ "use_default_system_prompt": false
17
  }
vision.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1ae78df075fefa8f9e6eb5f157640530efd1bc51c5d07239145fa61a67d09ad
3
+ size 877945912