Feature Extraction
MLX
Safetensors
qwen3
apple-silicon
quantized
mixed-precision
axquant
axq
development
8bit
8-bit precision
v2
embedding
sentence-similarity
6-bit
Instructions to use AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Promote audited AXQuant v2 artifact at stable repository name
Browse filesPreserve backward-compatible repository identity; v1 remains tagged legacy-pre-v2 and this exact revision is tagged v2 after verification.
- README.md +22 -21
- axquant_manifest.json +16 -16
- axquant_plan.json +6 -5
- axquant_quantizer_execution.json +2 -2
- axquant_runtime.json +3 -3
README.md
CHANGED
|
@@ -15,6 +15,7 @@ tags:
|
|
| 15 |
- qwen3
|
| 16 |
- 8bit
|
| 17 |
- 8-bit
|
|
|
|
| 18 |
- embedding
|
| 19 |
- sentence-similarity
|
| 20 |
---
|
|
@@ -28,26 +29,30 @@ the BF16 source model. The language path is quantized under AXQuant protection f
|
|
| 28 |
> artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
|
| 29 |
> or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
|
| 30 |
|
|
|
|
|
|
|
|
|
|
| 31 |
## Model details
|
| 32 |
|
| 33 |
| Property | Value |
|
| 34 |
| --- | --- |
|
| 35 |
-
| Base model | [Qwen/Qwen3-Embedding-0.6B](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B) |
|
| 36 |
-
| Source revision | `
|
| 37 |
| Product family | `qwen3` |
|
| 38 |
| Source architecture | `Qwen3ForCausalLM` (dense); text path optimized |
|
| 39 |
| Main-model parameters | 595.78M logical parameters |
|
| 40 |
-
| Quantizer | AXQuant `1.
|
| 41 |
| Hub budget class | `8bit` |
|
| 42 |
-
|
|
|
|
|
| 43 |
| Planned storage-adjusted BPW | 7.9992 |
|
| 44 |
| Measured main-model BPW | 8.0003 |
|
| 45 |
| Measured total BPW | **8.0003** |
|
| 46 |
| Safetensors weight size | 0.60 GB |
|
| 47 |
| Approximate complete download | 0.61 GB |
|
| 48 |
| Configured maximum context | 32,768 tokens; practical limits depend on unified memory |
|
| 49 |
-
|
|
| 50 |
-
|
|
| 51 |
| MTP present | `False` |
|
| 52 |
| Vision sidecar present | `False` |
|
| 53 |
|
|
@@ -65,7 +70,7 @@ protected models.
|
|
| 65 |
| Sibling | Intended trade-off |
|
| 66 |
| --- | --- |
|
| 67 |
| [4bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
|
| 68 |
-
| [
|
| 69 |
|
| 70 |
See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
|
| 71 |
for related MLX and OptiQ alternatives.
|
|
@@ -96,19 +101,13 @@ metadata and optional sidecars (`vision.safetensors`, `mtp.safetensors`); this c
|
|
| 96 |
does not establish MTP acceleration or vision-language quality. The artifact records MLX
|
| 97 |
`0.32.0` and MLX-LM `0.31.3` from conversion.
|
| 98 |
|
| 99 |
-
##
|
| 100 |
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
| 105 |
-
|
| 106 |
-
```
|
| 107 |
-
|
| 108 |
-
AX Engine is the authority for the AXQ runtime contract.
|
| 109 |
-
This development package does not claim runtime speedups until identical-checkpoint benchmarks are
|
| 110 |
-
published. The artifact records AX Engine version `not recorded`. Native
|
| 111 |
-
`model-manifest.json` status: not included.
|
| 112 |
|
| 113 |
## Quantization layout
|
| 114 |
|
|
@@ -151,6 +150,8 @@ establish MTP acceleration or vision-language quality.
|
|
| 151 |
- Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
|
| 152 |
model quality.
|
| 153 |
- The configured context window can require substantially more memory as the KV cache grows.
|
|
|
|
|
|
|
| 154 |
- Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
|
| 155 |
|
| 156 |
## Provenance and audit files
|
|
@@ -160,7 +161,7 @@ establish MTP acceleration or vision-language quality.
|
|
| 160 |
- [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
|
| 161 |
- [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
|
| 162 |
fallback records.
|
| 163 |
-
- [`axquant_runtime.json`](axquant_runtime.json): AX Engine and MLX-LM compatibility
|
| 164 |
|
| 165 |
All published provenance uses repository-relative paths. Local source paths are stripped before
|
| 166 |
publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
|
|
@@ -170,5 +171,5 @@ identical BPW or quality.
|
|
| 170 |
## License
|
| 171 |
|
| 172 |
The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
|
| 173 |
-
the [Qwen/Qwen3-Embedding-0.6B model card](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B) for license terms, model
|
| 174 |
limitations, and responsible-use guidance.
|
|
|
|
| 15 |
- qwen3
|
| 16 |
- 8bit
|
| 17 |
- 8-bit
|
| 18 |
+
- v2
|
| 19 |
- embedding
|
| 20 |
- sentence-similarity
|
| 21 |
---
|
|
|
|
| 29 |
> artifact-integrity records, but it does not publish measured quality, long-context, kernel-speed,
|
| 30 |
> or MTP-speed evidence. Do not interpret the AXQ product label as a benchmark claim.
|
| 31 |
|
| 32 |
+
> **Stable-name v2.** `main` serves the audited v2 artifact for backward compatibility. The same revision is tagged `v2`; the replaced artifact remains recoverable at `legacy-pre-v2`.
|
| 33 |
+
|
| 34 |
+
|
| 35 |
## Model details
|
| 36 |
|
| 37 |
| Property | Value |
|
| 38 |
| --- | --- |
|
| 39 |
+
| Base model | [Qwen/Qwen3-Embedding-0.6B](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B/tree/97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3) |
|
| 40 |
+
| Source revision | `97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3` |
|
| 41 |
| Product family | `qwen3` |
|
| 42 |
| Source architecture | `Qwen3ForCausalLM` (dense); text path optimized |
|
| 43 |
| Main-model parameters | 595.78M logical parameters |
|
| 44 |
+
| Quantizer | AXQuant `1.2.0` |
|
| 45 |
| Hub budget class | `8bit` |
|
| 46 |
+
| Artifact edition | `v2` |
|
| 47 |
+
| AXQuant base precision class | `8bit` |
|
| 48 |
| Planned storage-adjusted BPW | 7.9992 |
|
| 49 |
| Measured main-model BPW | 8.0003 |
|
| 50 |
| Measured total BPW | **8.0003** |
|
| 51 |
| Safetensors weight size | 0.60 GB |
|
| 52 |
| Approximate complete download | 0.61 GB |
|
| 53 |
| Configured maximum context | 32,768 tokens; practical limits depend on unified memory |
|
| 54 |
+
| MLX-LM compatibility | Standard text inference, compatibility level B |
|
| 55 |
+
| AX Engine native execution | Not established; no validated native manifest is included |
|
| 56 |
| MTP present | `False` |
|
| 57 |
| Vision sidecar present | `False` |
|
| 58 |
|
|
|
|
| 70 |
| Sibling | Intended trade-off |
|
| 71 |
| --- | --- |
|
| 72 |
| [4bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-4bit) | Lower-storage AXQ budget; check its exact BPW |
|
| 73 |
+
| [8bit sibling](https://huggingface.co/AutomatosX/AX-Qwen3-Embedding-0.6B-MLX-AXQ-8bit) | Higher average precision near the 8-BPW budget |
|
| 74 |
|
| 75 |
See the [AutomatosX MLX model catalog](https://huggingface.co/collections/AutomatosX/automatosx-mlx-model-catalog)
|
| 76 |
for related MLX and OptiQ alternatives.
|
|
|
|
| 101 |
does not establish MTP acceleration or vision-language quality. The artifact records MLX
|
| 102 |
`0.32.0` and MLX-LM `0.31.3` from conversion.
|
| 103 |
|
| 104 |
+
## AX Engine status
|
| 105 |
|
| 106 |
+
This package does **not** include a validated native `model-manifest.json`, so AX Engine execution
|
| 107 |
+
is not established by this release. The AX Engine fields in `axquant_runtime.json` describe the
|
| 108 |
+
intended compatibility contract, not observed runtime evidence. Use the MLX-LM path above for
|
| 109 |
+
standard text/backbone inference. The artifact records AX Engine version
|
| 110 |
+
`not recorded`, but version discovery alone is not a runtime check.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 111 |
|
| 112 |
## Quantization layout
|
| 113 |
|
|
|
|
| 150 |
- Architecture-prior allocation is not measured sensitivity. It must not be presented as measured
|
| 151 |
model quality.
|
| 152 |
- The configured context window can require substantially more memory as the KV cache grows.
|
| 153 |
+
- AX Engine execution is not established because this package has no validated native manifest.
|
| 154 |
+
|
| 155 |
- Upstream capabilities, limitations, biases, and responsible-use guidance still apply.
|
| 156 |
|
| 157 |
## Provenance and audit files
|
|
|
|
| 161 |
- [`axquant_plan.json`](axquant_plan.json): per-tensor precision decisions and planning evidence.
|
| 162 |
- [`axquant_quantizer_execution.json`](axquant_quantizer_execution.json): conversion coverage and
|
| 163 |
fallback records.
|
| 164 |
+
- [`axquant_runtime.json`](axquant_runtime.json): declared AX Engine and MLX-LM compatibility metadata; runtime checks remain separate evidence.
|
| 165 |
|
| 166 |
All published provenance uses repository-relative paths. Local source paths are stripped before
|
| 167 |
publication. The checkpoint was converted from BF16 rather than re-quantized from an OptiQ
|
|
|
|
| 171 |
## License
|
| 172 |
|
| 173 |
The checkpoint follows the upstream model license where applicable (often Apache License 2.0). See
|
| 174 |
+
the [Qwen/Qwen3-Embedding-0.6B model card](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B/tree/97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3) for license terms, model
|
| 175 |
limitations, and responsible-use guidance.
|
axquant_manifest.json
CHANGED
|
@@ -1,28 +1,28 @@
|
|
| 1 |
{
|
| 2 |
-
"axquant_version": "1.
|
| 3 |
"calibration": null,
|
| 4 |
-
"created_at": "2026-08-
|
| 5 |
"effective_bpw": 7.999220539932934,
|
| 6 |
"files": [
|
| 7 |
{
|
| 8 |
"path": "README.md",
|
| 9 |
-
"sha256": "
|
| 10 |
-
"size_bytes":
|
| 11 |
},
|
| 12 |
{
|
| 13 |
"path": "axquant_plan.json",
|
| 14 |
-
"sha256": "
|
| 15 |
-
"size_bytes":
|
| 16 |
},
|
| 17 |
{
|
| 18 |
"path": "axquant_quantizer_execution.json",
|
| 19 |
-
"sha256": "
|
| 20 |
"size_bytes": 48081
|
| 21 |
},
|
| 22 |
{
|
| 23 |
"path": "axquant_runtime.json",
|
| 24 |
-
"sha256": "
|
| 25 |
-
"size_bytes":
|
| 26 |
},
|
| 27 |
{
|
| 28 |
"path": "chat_template.jinja",
|
|
@@ -83,7 +83,7 @@
|
|
| 83 |
},
|
| 84 |
"mtp_present": false,
|
| 85 |
"mtp_weight_file_size_bytes": 0,
|
| 86 |
-
"plan_sha256": "
|
| 87 |
"profile": "general",
|
| 88 |
"protected_weight_file_size_bytes": 0,
|
| 89 |
"quantizer": "axquant",
|
|
@@ -99,7 +99,7 @@
|
|
| 99 |
{
|
| 100 |
"compatibility_level": "B",
|
| 101 |
"manifest": "config.json",
|
| 102 |
-
"mtp_support": "
|
| 103 |
"name": "mlx-lm",
|
| 104 |
"notes": [
|
| 105 |
"Standard backbone inference is the compatibility target.",
|
|
@@ -110,7 +110,7 @@
|
|
| 110 |
"support_level": "standard-inference"
|
| 111 |
}
|
| 112 |
],
|
| 113 |
-
"created_at": "2026-08-
|
| 114 |
"kv_cache": null,
|
| 115 |
"memory_policy": {
|
| 116 |
"kv_cache_precision": "runtime-default",
|
|
@@ -134,7 +134,7 @@
|
|
| 134 |
"primary_runtime": {
|
| 135 |
"compatibility_level": "A",
|
| 136 |
"manifest": "model-manifest.json",
|
| 137 |
-
"mtp_support": "
|
| 138 |
"name": "ax-engine",
|
| 139 |
"notes": [
|
| 140 |
"Runtime claims require a passing AX Engine doctor and benchmark report."
|
|
@@ -148,7 +148,7 @@
|
|
| 148 |
"schema_version": "axquant.artifact.v2",
|
| 149 |
"software_versions": {
|
| 150 |
"ax_engine": null,
|
| 151 |
-
"axquant": "1.
|
| 152 |
"mlx": "0.32.0",
|
| 153 |
"mlx_lm": "0.31.3",
|
| 154 |
"pydantic": "2.13.4",
|
|
@@ -160,9 +160,9 @@
|
|
| 160 |
"format": "mlx",
|
| 161 |
"local_path": null,
|
| 162 |
"model_id": "Qwen/Qwen3-Embedding-0.6B",
|
| 163 |
-
"revision":
|
| 164 |
},
|
| 165 |
-
"target_class": "
|
| 166 |
"weight_distribution": {
|
| 167 |
"6bit": {
|
| 168 |
"fraction": 0.3379230096268045,
|
|
|
|
| 1 |
{
|
| 2 |
+
"axquant_version": "1.2.0",
|
| 3 |
"calibration": null,
|
| 4 |
+
"created_at": "2026-08-05T07:23:44.193379Z",
|
| 5 |
"effective_bpw": 7.999220539932934,
|
| 6 |
"files": [
|
| 7 |
{
|
| 8 |
"path": "README.md",
|
| 9 |
+
"sha256": "7065c607c4251d4c917a1d75f6d99d7bfe690845ad101a7e3625e540cbb30841",
|
| 10 |
+
"size_bytes": 7792
|
| 11 |
},
|
| 12 |
{
|
| 13 |
"path": "axquant_plan.json",
|
| 14 |
+
"sha256": "980597edd6f4f791380c00801791cbe653879d2bdbee5f92c25628497f548218",
|
| 15 |
+
"size_bytes": 292907
|
| 16 |
},
|
| 17 |
{
|
| 18 |
"path": "axquant_quantizer_execution.json",
|
| 19 |
+
"sha256": "f3f55fec94708899fae63efeb2b9dcdd8e3b9ee00c1ca3c08e23d4c2277bf1b9",
|
| 20 |
"size_bytes": 48081
|
| 21 |
},
|
| 22 |
{
|
| 23 |
"path": "axquant_runtime.json",
|
| 24 |
+
"sha256": "1f554537b6ee3c3d28ea699ba55ac722eb816e33893a4cfab06c1cee8a41614a",
|
| 25 |
+
"size_bytes": 1628
|
| 26 |
},
|
| 27 |
{
|
| 28 |
"path": "chat_template.jinja",
|
|
|
|
| 83 |
},
|
| 84 |
"mtp_present": false,
|
| 85 |
"mtp_weight_file_size_bytes": 0,
|
| 86 |
+
"plan_sha256": "3a2ba166158417fdaf008e097ac304e683383153205485c1db0bba1e2bcbaeea",
|
| 87 |
"profile": "general",
|
| 88 |
"protected_weight_file_size_bytes": 0,
|
| 89 |
"quantizer": "axquant",
|
|
|
|
| 99 |
{
|
| 100 |
"compatibility_level": "B",
|
| 101 |
"manifest": "config.json",
|
| 102 |
+
"mtp_support": "none",
|
| 103 |
"name": "mlx-lm",
|
| 104 |
"notes": [
|
| 105 |
"Standard backbone inference is the compatibility target.",
|
|
|
|
| 110 |
"support_level": "standard-inference"
|
| 111 |
}
|
| 112 |
],
|
| 113 |
+
"created_at": "2026-08-05T07:23:43.990411Z",
|
| 114 |
"kv_cache": null,
|
| 115 |
"memory_policy": {
|
| 116 |
"kv_cache_precision": "runtime-default",
|
|
|
|
| 134 |
"primary_runtime": {
|
| 135 |
"compatibility_level": "A",
|
| 136 |
"manifest": "model-manifest.json",
|
| 137 |
+
"mtp_support": "none",
|
| 138 |
"name": "ax-engine",
|
| 139 |
"notes": [
|
| 140 |
"Runtime claims require a passing AX Engine doctor and benchmark report."
|
|
|
|
| 148 |
"schema_version": "axquant.artifact.v2",
|
| 149 |
"software_versions": {
|
| 150 |
"ax_engine": null,
|
| 151 |
+
"axquant": "1.2.0",
|
| 152 |
"mlx": "0.32.0",
|
| 153 |
"mlx_lm": "0.31.3",
|
| 154 |
"pydantic": "2.13.4",
|
|
|
|
| 160 |
"format": "mlx",
|
| 161 |
"local_path": null,
|
| 162 |
"model_id": "Qwen/Qwen3-Embedding-0.6B",
|
| 163 |
+
"revision": "97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3"
|
| 164 |
},
|
| 165 |
+
"target_class": "8bit",
|
| 166 |
"weight_distribution": {
|
| 167 |
"6bit": {
|
| 168 |
"fraction": 0.3379230096268045,
|
axquant_plan.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"analysis_sha256": "
|
| 3 |
"architecture_profile": {
|
| 4 |
"adapter_id": "qwen3-dense-v1",
|
| 5 |
"config_model_type": "qwen3",
|
|
@@ -9027,7 +9027,7 @@
|
|
| 9027 |
"minimum_mtp_speedup": 1.2,
|
| 9028 |
"minimum_quality_retention": 0.98
|
| 9029 |
},
|
| 9030 |
-
"created_at": "2026-08-
|
| 9031 |
"effective_bpw": 7.999220539932934,
|
| 9032 |
"evidence_kind": "architecture_prior",
|
| 9033 |
"global_validation_required": true,
|
|
@@ -9052,6 +9052,7 @@
|
|
| 9052 |
"affine",
|
| 9053 |
"awq",
|
| 9054 |
"dwq",
|
|
|
|
| 9055 |
"bf16"
|
| 9056 |
]
|
| 9057 |
},
|
|
@@ -9089,7 +9090,7 @@
|
|
| 9089 |
"schema_version": "axquant.plan.v1",
|
| 9090 |
"software_versions": {
|
| 9091 |
"ax_engine": null,
|
| 9092 |
-
"axquant": "1.
|
| 9093 |
"mlx": "0.32.0",
|
| 9094 |
"mlx_lm": "0.31.3",
|
| 9095 |
"pydantic": "2.13.4",
|
|
@@ -9101,11 +9102,11 @@
|
|
| 9101 |
"format": "mlx",
|
| 9102 |
"local_path": null,
|
| 9103 |
"model_id": "Qwen/Qwen3-Embedding-0.6B",
|
| 9104 |
-
"revision":
|
| 9105 |
},
|
| 9106 |
"status": "planned",
|
| 9107 |
"target_bpw": 8.0,
|
| 9108 |
-
"target_class": "
|
| 9109 |
"target_mode": "low-memory",
|
| 9110 |
"warnings": [
|
| 9111 |
"This report contains architecture priors, not calibration measurements.",
|
|
|
|
| 1 |
{
|
| 2 |
+
"analysis_sha256": "62f2865677b2792a65c24900787c7278c465a99e4691917aae0a5dd5b33a3689",
|
| 3 |
"architecture_profile": {
|
| 4 |
"adapter_id": "qwen3-dense-v1",
|
| 5 |
"config_model_type": "qwen3",
|
|
|
|
| 9027 |
"minimum_mtp_speedup": 1.2,
|
| 9028 |
"minimum_quality_retention": 0.98
|
| 9029 |
},
|
| 9030 |
+
"created_at": "2026-08-05T07:23:42.326212Z",
|
| 9031 |
"effective_bpw": 7.999220539932934,
|
| 9032 |
"evidence_kind": "architecture_prior",
|
| 9033 |
"global_validation_required": true,
|
|
|
|
| 9052 |
"affine",
|
| 9053 |
"awq",
|
| 9054 |
"dwq",
|
| 9055 |
+
"gptq",
|
| 9056 |
"bf16"
|
| 9057 |
]
|
| 9058 |
},
|
|
|
|
| 9090 |
"schema_version": "axquant.plan.v1",
|
| 9091 |
"software_versions": {
|
| 9092 |
"ax_engine": null,
|
| 9093 |
+
"axquant": "1.2.0",
|
| 9094 |
"mlx": "0.32.0",
|
| 9095 |
"mlx_lm": "0.31.3",
|
| 9096 |
"pydantic": "2.13.4",
|
|
|
|
| 9102 |
"format": "mlx",
|
| 9103 |
"local_path": null,
|
| 9104 |
"model_id": "Qwen/Qwen3-Embedding-0.6B",
|
| 9105 |
+
"revision": "97b0c614be4d77ee51c0cef4e5f07c00f9eb65b3"
|
| 9106 |
},
|
| 9107 |
"status": "planned",
|
| 9108 |
"target_bpw": 8.0,
|
| 9109 |
+
"target_class": "8bit",
|
| 9110 |
"target_mode": "low-memory",
|
| 9111 |
"warnings": [
|
| 9112 |
"This report contains architecture priors, not calibration measurements.",
|
axquant_quantizer_execution.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
-
"created_at": "2026-08-
|
| 3 |
-
"plan_sha256": "
|
| 4 |
"records": [
|
| 5 |
{
|
| 6 |
"bits": 8,
|
|
|
|
| 1 |
{
|
| 2 |
+
"created_at": "2026-08-05T07:23:43.986784Z",
|
| 3 |
+
"plan_sha256": "3a2ba166158417fdaf008e097ac304e683383153205485c1db0bba1e2bcbaeea",
|
| 4 |
"records": [
|
| 5 |
{
|
| 6 |
"bits": 8,
|
axquant_runtime.json
CHANGED
|
@@ -10,7 +10,7 @@
|
|
| 10 |
{
|
| 11 |
"compatibility_level": "B",
|
| 12 |
"manifest": "config.json",
|
| 13 |
-
"mtp_support": "
|
| 14 |
"name": "mlx-lm",
|
| 15 |
"notes": [
|
| 16 |
"Standard backbone inference is the compatibility target.",
|
|
@@ -21,7 +21,7 @@
|
|
| 21 |
"support_level": "standard-inference"
|
| 22 |
}
|
| 23 |
],
|
| 24 |
-
"created_at": "2026-08-
|
| 25 |
"kv_cache": null,
|
| 26 |
"memory_policy": {
|
| 27 |
"kv_cache_precision": "runtime-default",
|
|
@@ -45,7 +45,7 @@
|
|
| 45 |
"primary_runtime": {
|
| 46 |
"compatibility_level": "A",
|
| 47 |
"manifest": "model-manifest.json",
|
| 48 |
-
"mtp_support": "
|
| 49 |
"name": "ax-engine",
|
| 50 |
"notes": [
|
| 51 |
"Runtime claims require a passing AX Engine doctor and benchmark report."
|
|
|
|
| 10 |
{
|
| 11 |
"compatibility_level": "B",
|
| 12 |
"manifest": "config.json",
|
| 13 |
+
"mtp_support": "none",
|
| 14 |
"name": "mlx-lm",
|
| 15 |
"notes": [
|
| 16 |
"Standard backbone inference is the compatibility target.",
|
|
|
|
| 21 |
"support_level": "standard-inference"
|
| 22 |
}
|
| 23 |
],
|
| 24 |
+
"created_at": "2026-08-05T07:23:43.990411Z",
|
| 25 |
"kv_cache": null,
|
| 26 |
"memory_policy": {
|
| 27 |
"kv_cache_precision": "runtime-default",
|
|
|
|
| 45 |
"primary_runtime": {
|
| 46 |
"compatibility_level": "A",
|
| 47 |
"manifest": "model-manifest.json",
|
| 48 |
+
"mtp_support": "none",
|
| 49 |
"name": "ax-engine",
|
| 50 |
"notes": [
|
| 51 |
"Runtime claims require a passing AX Engine doctor and benchmark report."
|