AutomatosX commited on
Commit
2e62555
·
verified ·
1 Parent(s): c807a60

Promote audited AXQuant v2 artifact at stable repository name

Browse files

Preserve backward-compatible repository identity; v1 remains tagged legacy-pre-v2 and this exact revision is tagged v2 after verification.

README.md CHANGED
@@ -15,6 +15,7 @@ tags:
15
  - qwen3
16
  - 8bit
17
  - 8-bit
 
18
  - embedding
19
  - sentence-similarity
20
  ---
@@ -28,26 +29,30 @@ the BF16 source model. The language path is quantized under AXQuant protection f
28
  > artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
29
  > or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
30
 
 
 
 
31
  ## Model details
32
 
33
  | Property | Value |
34
  | --- | --- |
35
- | Base model | [Qwen/Qwen3-Embedding-0.6B](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B) |
36
- | Source revision | `unrecorded` |
37
  | Product family | `qwen3` |
38
  | Source architecture | `Qwen3ForCausalLM` (dense); text path optimized |
39
  | Main-model parameters | 595.78M logical parameters |
40
- | Quantizer | AXQuant `1.0.1` |
41
  | Hub budget class | `8bit` |
42
- | AXQuant base precision class | `4bit` |
 
43
  | Planned storage-adjusted BPW | 7.9992 |
44
  | Measured main-model BPW | 8.0003 |
45
  | Measured total BPW | **8.0003** |
46
  | Safetensors weight size | 0.60 GB |
47
  | Approximate complete download | 0.61 GB |
48
  | Configured maximum context | 32,768 tokens; practical limits depend on unified memory |
49
- | Primary runtime | AX Engine, compatibility level A |
50
- | Compatible runtime | MLX-LM standard text inference, compatibility level B |
51
  | MTP present | `False` |
52
  | Vision sidecar present | `False` |
53
 
@@ -65,7 +70,7 @@ protected models.
65
  | Sibling | Intended trade-off |
66
  | --- | --- |
67
  | [4bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
68
- | [6bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-6bit) | Higher average precision near a 6-BPW budget |
69
 
70
  See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
71
  for related MLX and OptiQ alternatives.
@@ -96,19 +101,13 @@ metadata and optional sidecars (`vision.safetensors`, `mtp.safetensors`); this c
96
  does not establish MTP acceleration or vision-language quality. The artifact records MLX
97
  `0.32.0` and MLX-LM `0.31.3` from conversion.
98
 
99
- ## Serve with AX Engine
100
 
101
- After installing [AX Engine](https://github.com/defai-digital/ax-engine), download the complete
102
- repository and serve the local directory:
103
-
104
- ```bash
105
- ax-engine serve ./AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit --port 31418
106
- ```
107
-
108
- AX Engine is the authority for the AXQ runtime contract.
109
- This development package does not claim runtime speedups until identical-checkpoint benchmarks are
110
- published. The artifact records AX Engine version `not recorded`. Native
111
- `model-manifest.json` status: not included.
112
 
113
  ## Quantization layout
114
 
@@ -151,6 +150,8 @@ establish MTP acceleration or vision-language quality.
151
  - Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
152
  model quality.
153
  - The configured context window can require substantially more memory as the KV cache grows.
 
 
154
  - Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
155
 
156
  ## Provenance and audit files
@@ -160,7 +161,7 @@ establish MTP acceleration or vision-language quality.
160
  - [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
161
  - [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
162
  fallback records.
163
- - [`axquant_runtime.json`](axquant_runtime.json): AX Engine and MLX-LM compatibility contract.
164
 
165
  All published provenance uses repository-relative paths. Local source paths are stripped before
166
  publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
@@ -170,5 +171,5 @@ identical BPW or quality.
170
  ## License
171
 
172
  The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
173
- the [Qwen/Qwen3-Embedding-0.6B model card](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B) for license terms, model
174
  limitations, and responsible-use guidance.
 
15
  - qwen3
16
  - 8bit
17
  - 8-bit
18
+ - v2
19
  - embedding
20
  - sentence-similarity
21
  ---
 
29
  > artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
30
  > or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
31
 
32
+ > **Stable-name v2.** `main` serves the audited v2 artifact for backward compatibility. The same revision is tagged `v2`; the replaced artifact remains recoverable at `legacy-pre-v2`.
33
+
34
+
35
  ## Model details
36
 
37
  | Property | Value |
38
  | --- | --- |
39
+ | Base model | [Qwen/Qwen3-Embedding-0.6B](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B/tree/97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3) |
40
+ | Source revision | `97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3` |
41
  | Product family | `qwen3` |
42
  | Source architecture | `Qwen3ForCausalLM` (dense); text path optimized |
43
  | Main-model parameters | 595.78M logical parameters |
44
+ | Quantizer | AXQuant `1.2.0` |
45
  | Hub budget class | `8bit` |
46
+ | Artifact edition | `v2` |
47
+ | AXQuant base precision class | `8bit` |
48
  | Planned storage-adjusted BPW | 7.9992 |
49
  | Measured main-model BPW | 8.0003 |
50
  | Measured total BPW | **8.0003** |
51
  | Safetensors weight size | 0.60 GB |
52
  | Approximate complete download | 0.61 GB |
53
  | Configured maximum context | 32,768 tokens; practical limits depend on unified memory |
54
+ | MLX-LM compatibility | Standard text inference, compatibility level B |
55
+ | AX Engine native execution | Not established; no validated native manifest is included |
56
  | MTP present | `False` |
57
  | Vision sidecar present | `False` |
58
 
 
70
  | Sibling | Intended trade-off |
71
  | --- | --- |
72
  | [4bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
73
+ | [8bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit) | Higher average precision near the 8-BPW budget |
74
 
75
  See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
76
  for related MLX and OptiQ alternatives.
 
101
  does not establish MTP acceleration or vision-language quality. The artifact records MLX
102
  `0.32.0` and MLX-LM `0.31.3` from conversion.
103
 
104
+ ## AX Engine status
105
 
106
+ This package does **not** include a validated native `model-manifest.json`, so AX Engine execution
107
+ is not established by this release. The AX Engine fields in `axquant_runtime.json` describe the
108
+ intended compatibility contract, not observed runtime evidence. Use the MLX-LM path above for
109
+ standard text/backbone inference. The artifact records AX Engine version
110
+ `not recorded`, but version discovery alone is not a runtime check.
 
 
 
 
 
 
111
 
112
  ## Quantization layout
113
 
 
150
  - Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
151
  model quality.
152
  - The configured context window can require substantially more memory as the KV cache grows.
153
+ - AX Engine execution is not established because this package has no validated native manifest.
154
+
155
  - Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
156
 
157
  ## Provenance and audit files
 
161
  - [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
162
  - [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
163
  fallback records.
164
+ - [`axquant_runtime.json`](axquant_runtime.json): declared AX Engine and MLX-LM compatibility metadata; runtime checks remain separate evidence.
165
 
166
  All published provenance uses repository-relative paths. Local source paths are stripped before
167
  publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
 
171
  ## License
172
 
173
  The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
174
+ the [Qwen/Qwen3-Embedding-0.6B model card](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B/tree/97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3) for license terms, model
175
  limitations, and responsible-use guidance.
axquant_manifest.json CHANGED
@@ -1,28 +1,28 @@
1
  {
2
- "axquant_version": "1.0.1",
3
  "calibration": null,
4
- "created_at": "2026-08-02T19:19:15.735866Z",
5
  "effective_bpw": 7.999220539932934,
6
  "files": [
7
  {
8
  "path": "README.md",
9
- "sha256": "cf24e4d54458f4dc5c7725e37e7935422d2cdf2a6bd4875c580a8eeb9905ea69",
10
- "size_bytes": 7338
11
  },
12
  {
13
  "path": "axquant_plan.json",
14
- "sha256": "3238c60c26eb4a47866e944e8b53cfa31147cdb8676576fef5200e9f54081ed5",
15
- "size_bytes": 292855
16
  },
17
  {
18
  "path": "axquant_quantizer_execution.json",
19
- "sha256": "33426dabf2285479a2804dd0d516dd4051e521aab827a107f54001d2331da8bb",
20
  "size_bytes": 48081
21
  },
22
  {
23
  "path": "axquant_runtime.json",
24
- "sha256": "046b0b974cd0bb5b6ac407dbf57a53bcae885515e890b3cb87b7ac377f062ffc",
25
- "size_bytes": 1643
26
  },
27
  {
28
  "path": "chat_template.jinja",
@@ -83,7 +83,7 @@
83
  },
84
  "mtp_present": false,
85
  "mtp_weight_file_size_bytes": 0,
86
- "plan_sha256": "91a2de0eb8f6b3126ce18f8f832e835683fc929ad81d2397b906edeff714a293",
87
  "profile": "general",
88
  "protected_weight_file_size_bytes": 0,
89
  "quantizer": "axquant",
@@ -99,7 +99,7 @@
99
  {
100
  "compatibility_level": "B",
101
  "manifest": "config.json",
102
- "mtp_support": "runtime-dependent",
103
  "name": "mlx-lm",
104
  "notes": [
105
  "Standard backbone inference is the compatibility target.",
@@ -110,7 +110,7 @@
110
  "support_level": "standard-inference"
111
  }
112
  ],
113
- "created_at": "2026-08-02T19:19:15.444403Z",
114
  "kv_cache": null,
115
  "memory_policy": {
116
  "kv_cache_precision": "runtime-default",
@@ -134,7 +134,7 @@
134
  "primary_runtime": {
135
  "compatibility_level": "A",
136
  "manifest": "model-manifest.json",
137
- "mtp_support": "native",
138
  "name": "ax-engine",
139
  "notes": [
140
  "Runtime claims require a passing AX Engine doctor and benchmark report."
@@ -148,7 +148,7 @@
148
  "schema_version": "axquant.artifact.v2",
149
  "software_versions": {
150
  "ax_engine": null,
151
- "axquant": "1.0.1",
152
  "mlx": "0.32.0",
153
  "mlx_lm": "0.31.3",
154
  "pydantic": "2.13.4",
@@ -160,9 +160,9 @@
160
  "format": "mlx",
161
  "local_path": null,
162
  "model_id": "Qwen/Qwen3-Embedding-0.6B",
163
- "revision": null
164
  },
165
- "target_class": "4bit",
166
  "weight_distribution": {
167
  "6bit": {
168
  "fraction": 0.3379230096268045,
 
1
  {
2
+ "axquant_version": "1.2.0",
3
  "calibration": null,
4
+ "created_at": "2026-08-05T07:23:44.193379Z",
5
  "effective_bpw": 7.999220539932934,
6
  "files": [
7
  {
8
  "path": "README.md",
9
+ "sha256": "7065c607c4251d4c917a1d75f6d99d7bfe690845ad101a7e3625e540cbb30841",
10
+ "size_bytes": 7792
11
  },
12
  {
13
  "path": "axquant_plan.json",
14
+ "sha256": "980597edd6f4f791380c00801791cbe653879d2bdbee5f92c25628497f548218",
15
+ "size_bytes": 292907
16
  },
17
  {
18
  "path": "axquant_quantizer_execution.json",
19
+ "sha256": "f3f55fec94708899fae63efeb2b9dcdd8e3b9ee00c1ca3c08e23d4c2277bf1b9",
20
  "size_bytes": 48081
21
  },
22
  {
23
  "path": "axquant_runtime.json",
24
+ "sha256": "1f554537b6ee3c3d28ea699ba55ac722eb816e33893a4cfab06c1cee8a41614a",
25
+ "size_bytes": 1628
26
  },
27
  {
28
  "path": "chat_template.jinja",
 
83
  },
84
  "mtp_present": false,
85
  "mtp_weight_file_size_bytes": 0,
86
+ "plan_sha256": "3a2ba166158417fdaf008e097ac304e683383153205485c1db0bba1e2bcbaeea",
87
  "profile": "general",
88
  "protected_weight_file_size_bytes": 0,
89
  "quantizer": "axquant",
 
99
  {
100
  "compatibility_level": "B",
101
  "manifest": "config.json",
102
+ "mtp_support": "none",
103
  "name": "mlx-lm",
104
  "notes": [
105
  "Standard backbone inference is the compatibility target.",
 
110
  "support_level": "standard-inference"
111
  }
112
  ],
113
+ "created_at": "2026-08-05T07:23:43.990411Z",
114
  "kv_cache": null,
115
  "memory_policy": {
116
  "kv_cache_precision": "runtime-default",
 
134
  "primary_runtime": {
135
  "compatibility_level": "A",
136
  "manifest": "model-manifest.json",
137
+ "mtp_support": "none",
138
  "name": "ax-engine",
139
  "notes": [
140
  "Runtime claims require a passing AX Engine doctor and benchmark report."
 
148
  "schema_version": "axquant.artifact.v2",
149
  "software_versions": {
150
  "ax_engine": null,
151
+ "axquant": "1.2.0",
152
  "mlx": "0.32.0",
153
  "mlx_lm": "0.31.3",
154
  "pydantic": "2.13.4",
 
160
  "format": "mlx",
161
  "local_path": null,
162
  "model_id": "Qwen/Qwen3-Embedding-0.6B",
163
+ "revision": "97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3"
164
  },
165
+ "target_class": "8bit",
166
  "weight_distribution": {
167
  "6bit": {
168
  "fraction": 0.3379230096268045,
axquant_plan.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "analysis_sha256": "6aa99da301ace53c56ce3c7e1293e9ed730362c5c8cb1c2d0598c6a9f09adf44",
3
  "architecture_profile": {
4
  "adapter_id": "qwen3-dense-v1",
5
  "config_model_type": "qwen3",
@@ -9027,7 +9027,7 @@
9027
  "minimum_mtp_speedup": 1.2,
9028
  "minimum_quality_retention": 0.98
9029
  },
9030
- "created_at": "2026-08-02T19:19:13.447019Z",
9031
  "effective_bpw": 7.999220539932934,
9032
  "evidence_kind": "architecture_prior",
9033
  "global_validation_required": true,
@@ -9052,6 +9052,7 @@
9052
  "affine",
9053
  "awq",
9054
  "dwq",
 
9055
  "bf16"
9056
  ]
9057
  },
@@ -9089,7 +9090,7 @@
9089
  "schema_version": "axquant.plan.v1",
9090
  "software_versions": {
9091
  "ax_engine": null,
9092
- "axquant": "1.0.1",
9093
  "mlx": "0.32.0",
9094
  "mlx_lm": "0.31.3",
9095
  "pydantic": "2.13.4",
@@ -9101,11 +9102,11 @@
9101
  "format": "mlx",
9102
  "local_path": null,
9103
  "model_id": "Qwen/Qwen3-Embedding-0.6B",
9104
- "revision": null
9105
  },
9106
  "status": "planned",
9107
  "target_bpw": 8.0,
9108
- "target_class": "4bit",
9109
  "target_mode": "low-memory",
9110
  "warnings": [
9111
  "This report contains architecture priors, not calibration measurements.",
 
1
  {
2
+ "analysis_sha256": "62f2865677b2792a65c24900787c7278c465a99e4691917aae0a5dd5b33a3689",
3
  "architecture_profile": {
4
  "adapter_id": "qwen3-dense-v1",
5
  "config_model_type": "qwen3",
 
9027
  "minimum_mtp_speedup": 1.2,
9028
  "minimum_quality_retention": 0.98
9029
  },
9030
+ "created_at": "2026-08-05T07:23:42.326212Z",
9031
  "effective_bpw": 7.999220539932934,
9032
  "evidence_kind": "architecture_prior",
9033
  "global_validation_required": true,
 
9052
  "affine",
9053
  "awq",
9054
  "dwq",
9055
+ "gptq",
9056
  "bf16"
9057
  ]
9058
  },
 
9090
  "schema_version": "axquant.plan.v1",
9091
  "software_versions": {
9092
  "ax_engine": null,
9093
+ "axquant": "1.2.0",
9094
  "mlx": "0.32.0",
9095
  "mlx_lm": "0.31.3",
9096
  "pydantic": "2.13.4",
 
9102
  "format": "mlx",
9103
  "local_path": null,
9104
  "model_id": "Qwen/Qwen3-Embedding-0.6B",
9105
+ "revision": "97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3"
9106
  },
9107
  "status": "planned",
9108
  "target_bpw": 8.0,
9109
+ "target_class": "8bit",
9110
  "target_mode": "low-memory",
9111
  "warnings": [
9112
  "This report contains architecture priors, not calibration measurements.",
axquant_quantizer_execution.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
- "created_at": "2026-08-02T19:19:15.440196Z",
3
- "plan_sha256": "91a2de0eb8f6b3126ce18f8f832e835683fc929ad81d2397b906edeff714a293",
4
  "records": [
5
  {
6
  "bits": 8,
 
1
  {
2
+ "created_at": "2026-08-05T07:23:43.986784Z",
3
+ "plan_sha256": "3a2ba166158417fdaf008e097ac304e683383153205485c1db0bba1e2bcbaeea",
4
  "records": [
5
  {
6
  "bits": 8,
axquant_runtime.json CHANGED
@@ -10,7 +10,7 @@
10
  {
11
  "compatibility_level": "B",
12
  "manifest": "config.json",
13
- "mtp_support": "runtime-dependent",
14
  "name": "mlx-lm",
15
  "notes": [
16
  "Standard backbone inference is the compatibility target.",
@@ -21,7 +21,7 @@
21
  "support_level": "standard-inference"
22
  }
23
  ],
24
- "created_at": "2026-08-02T19:19:15.444403Z",
25
  "kv_cache": null,
26
  "memory_policy": {
27
  "kv_cache_precision": "runtime-default",
@@ -45,7 +45,7 @@
45
  "primary_runtime": {
46
  "compatibility_level": "A",
47
  "manifest": "model-manifest.json",
48
- "mtp_support": "native",
49
  "name": "ax-engine",
50
  "notes": [
51
  "Runtime claims require a passing AX Engine doctor and benchmark report."
 
10
  {
11
  "compatibility_level": "B",
12
  "manifest": "config.json",
13
+ "mtp_support": "none",
14
  "name": "mlx-lm",
15
  "notes": [
16
  "Standard backbone inference is the compatibility target.",
 
21
  "support_level": "standard-inference"
22
  }
23
  ],
24
+ "created_at": "2026-08-05T07:23:43.990411Z",
25
  "kv_cache": null,
26
  "memory_policy": {
27
  "kv_cache_precision": "runtime-default",
 
45
  "primary_runtime": {
46
  "compatibility_level": "A",
47
  "manifest": "model-manifest.json",
48
+ "mtp_support": "none",
49
  "name": "ax-engine",
50
  "notes": [
51
  "Runtime claims require a passing AX Engine doctor and benchmark report."