docs: refresh model card to v5 (AbteeX/LumynaX unified surface)
Browse files
README.md
CHANGED
|
@@ -1,223 +1,239 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
-
|
| 11 |
-
-
|
| 12 |
-
-
|
| 13 |
-
-
|
| 14 |
-
-
|
| 15 |
-
-
|
| 16 |
-
-
|
| 17 |
-
--
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
<
|
| 24 |
-
|
| 25 |
-
</p>
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
<a href="#
|
| 35 |
-
<a href="#
|
| 36 |
-
<a href="#
|
| 37 |
-
<a href="#
|
| 38 |
-
<a href="#
|
| 39 |
-
</
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
|
| 56 |
-
|
|
| 57 |
-
|
|
| 58 |
-
|
|
| 59 |
-
| Runtime residency | `llama_cpp`
|
| 60 |
-
|
|
| 61 |
-
| Modalities | `text` |
|
| 62 |
-
|
|
| 63 |
-
|
|
| 64 |
-
|
|
| 65 |
-
|
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
|
| 87 |
-
```
|
| 88 |
-
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
|
| 99 |
-
|
| 100 |
-
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
|
| 105 |
-
|
|
| 106 |
-
|
|
| 107 |
-
|
|
| 108 |
-
|
|
| 109 |
-
|
|
| 110 |
-
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
| 119 |
-
|
|
| 120 |
-
|
| 121 |
-
|
| 122 |
-
|
| 123 |
-
|
|
| 124 |
-
|
| 125 |
-
|
| 126 |
-
|
| 127 |
-
|
|
| 128 |
-
|
|
| 129 |
-
|
|
| 130 |
-
|
| 131 |
-
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
|
|
| 136 |
-
|
|
| 137 |
-
|
|
| 138 |
-
|
|
| 139 |
-
|
| 140 |
-
|
| 141 |
-
|
| 142 |
-
|
|
| 143 |
-
|
|
| 144 |
-
|
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
|
| 160 |
-
|
| 161 |
-
|
| 162 |
-
|
| 163 |
-
|
| 164 |
-
|
| 165 |
-
|
|
| 166 |
-
|
|
| 167 |
-
|
|
| 168 |
-
|
|
| 169 |
-
|
|
| 170 |
-
|
|
| 171 |
-
|
| 172 |
-
|
| 173 |
-
|
| 174 |
-
|
| 175 |
-
|
| 176 |
-
|
| 177 |
-
|
| 178 |
-
|
| 179 |
-
|
| 180 |
-
|
| 181 |
-
```
|
| 182 |
-
|
| 183 |
-
|
| 184 |
-
|
| 185 |
-
|
| 186 |
-
|
| 187 |
-
|
| 188 |
-
```
|
| 189 |
-
|
| 190 |
-
|
| 191 |
-
|
| 192 |
-
|
| 193 |
-
|
| 194 |
-
|
| 195 |
-
-
|
| 196 |
-
-
|
| 197 |
-
-
|
| 198 |
-
|
| 199 |
-
|
| 200 |
-
|
| 201 |
-
|
| 202 |
-
|
| 203 |
-
|
| 204 |
-
|
| 205 |
-
|
| 206 |
-
|
| 207 |
-
|
| 208 |
-
|
| 209 |
-
|
| 210 |
-
|
| 211 |
-
|
| 212 |
-
|
| 213 |
-
-
|
| 214 |
-
-
|
| 215 |
-
|
| 216 |
-
|
| 217 |
-
|
| 218 |
-
|
| 219 |
-
|
| 220 |
-
|
| 221 |
-
|
| 222 |
-
|
| 223 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: llama.cpp
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
- mi
|
| 8 |
+
tags:
|
| 9 |
+
- abteex-ai-labs
|
| 10 |
+
- aotearoa
|
| 11 |
+
- general
|
| 12 |
+
- gguf
|
| 13 |
+
- local-first
|
| 14 |
+
- lumynax
|
| 15 |
+
- new-zealand
|
| 16 |
+
- smollm
|
| 17 |
+
- sovereign-ai
|
| 18 |
+
- text
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
# LumynaX Infused SmolLM2 360M Instruct GGUF
|
| 22 |
+
|
| 23 |
+
<!-- lumynax-public-release-card:v5 -->
|
| 24 |
+
|
| 25 |
+
<p align="center"><em>Sovereign intelligence, held in the light.</em></p>
|
| 26 |
+
<p align="center"><em>Ko te mārama te tūāpapa — the light is the foundation.</em></p>
|
| 27 |
+
|
| 28 |
+
<p align="center">
|
| 29 |
+
<strong>A LumynaX release from AbteeX AI Labs — Aotearoa New Zealand.</strong><br/>
|
| 30 |
+
Public, non-gated package with runnable local instructions, provenance metadata, checksums, and a release manifest.
|
| 31 |
+
</p>
|
| 32 |
+
|
| 33 |
+
<p align="center">
|
| 34 |
+
<a href="#quickstart">Quickstart</a> ·
|
| 35 |
+
<a href="#model-profile">Model profile</a> ·
|
| 36 |
+
<a href="#runtime-files">Runtime files</a> ·
|
| 37 |
+
<a href="#provenance--license">Provenance</a> ·
|
| 38 |
+
<a href="#validation">Validation</a> ·
|
| 39 |
+
<a href="#limitations--responsible-use">Limitations</a> ·
|
| 40 |
+
<a href="#companion-products">Companions</a>
|
| 41 |
+
</p>
|
| 42 |
+
|
| 43 |
+
     
|
| 44 |
+
|
| 45 |
+
## Executive Summary
|
| 46 |
+
|
| 47 |
+
`AbteeXAILab/lumynax-infused-smollm2-360m-gguf` is a complete LumynaX release package: model artifact, `quickstart.py`, `requirements.txt`, `release_export_manifest.json`, `checksums.sha256`, license notice, and optional Ollama / Space scaffolds shipped as one downloadable contract. It is designed to be cloned whole, verified by checksum, and run close to the data it serves.
|
| 48 |
+
|
| 49 |
+
LumynaX-infused means the upstream artifact is presented through the LumynaX release layer: local-first runtime scaffolding, LumynaX assistant identity, inference-chain metadata, integrity files, and Aotearoa New Zealand-oriented workflow positioning. The release manifest records this as a LumynaX packaging and inference-chain layer around the listed upstream artifact — it does not claim a private LumynaX weight merge.
|
| 50 |
+
|
| 51 |
+
## Sovereignty & Run Contract
|
| 52 |
+
|
| 53 |
+
| Field | Value |
|
| 54 |
+
| --- | --- |
|
| 55 |
+
| Publisher | AbteeX AI Labs |
|
| 56 |
+
| Family | LumynaX sovereign release family |
|
| 57 |
+
| Sovereign intent | Local-first deployment near governed data, with explicit provenance and controlled human review. |
|
| 58 |
+
| Sovereignty tier | `3` |
|
| 59 |
+
| Runtime residency | `llama_cpp` can be deployed inside an operator-approved environment. |
|
| 60 |
+
| Primary artifact | `smollm2-360m-instruct-q8_0.gguf` — must stay alongside manifest, checksums, quickstart, requirements, and license files. |
|
| 61 |
+
| Modalities | `text` |
|
| 62 |
+
| Context window | `8192` tokens |
|
| 63 |
+
| License metadata | `apache-2.0` — surface for redistribution and usage checks. |
|
| 64 |
+
| Audit expectation | Record repo id, artifact checksum, runtime command, prompt template, operator, and deployment environment for production use. |
|
| 65 |
+
| Router readiness | Compatible with the [LumynaX MaramaRoute](https://huggingface.co/AbteeXAILab/marama-route) registry pattern. |
|
| 66 |
+
| Preferred path | First path is `llama.cpp` / `llama-cpp-python` (GGUF) or `transformers` (safetensors) with checksum verification before launch. |
|
| 67 |
+
|
| 68 |
+
## Quickstart
|
| 69 |
+
|
| 70 |
+
Clone the whole release:
|
| 71 |
+
|
| 72 |
+
```bash
|
| 73 |
+
hf download AbteeXAILab/lumynax-infused-smollm2-360m-gguf --local-dir lumynax-infused-smollm2-360m-gguf
|
| 74 |
+
cd lumynax-infused-smollm2-360m-gguf
|
| 75 |
+
pip install -r requirements.txt
|
| 76 |
+
python quickstart.py --interactive
|
| 77 |
+
```
|
| 78 |
+
|
| 79 |
+
Python:
|
| 80 |
+
|
| 81 |
+
```python
|
| 82 |
+
from llama_cpp import Llama
|
| 83 |
+
|
| 84 |
+
llm = Llama(model_path="smollm2-360m-instruct-q8_0.gguf", n_ctx=8192, n_threads=8, verbose=False)
|
| 85 |
+
out = llm("Who are you? Answer as LumynaX in two sentences.", max_tokens=160)
|
| 86 |
+
print(out["choices"][0]["text"].strip())
|
| 87 |
+
```
|
| 88 |
+
|
| 89 |
+
CLI smoke test:
|
| 90 |
+
|
| 91 |
+
```bash
|
| 92 |
+
llama-cli -m "smollm2-360m-instruct-q8_0.gguf" -p "Who are you? Answer as LumynaX in two sentences." -n 160
|
| 93 |
+
```
|
| 94 |
+
|
| 95 |
+
Ollama path:
|
| 96 |
+
|
| 97 |
+
```bash
|
| 98 |
+
ollama create lumynax-infused-smollm2-360m-gguf -f ollama/Modelfile
|
| 99 |
+
ollama run lumynax-infused-smollm2-360m-gguf
|
| 100 |
+
```
|
| 101 |
+
|
| 102 |
+
## Model Profile
|
| 103 |
+
|
| 104 |
+
| Field | Value |
|
| 105 |
+
| --- | --- |
|
| 106 |
+
| Release | `LumynaX Infused SmolLM2 360M Instruct GGUF` |
|
| 107 |
+
| Repository | `AbteeXAILab/lumynax-infused-smollm2-360m-gguf` |
|
| 108 |
+
| Mode | `Local-first text generation package` |
|
| 109 |
+
| Runtime | `llama_cpp` |
|
| 110 |
+
| Prompt format | `chatml` |
|
| 111 |
+
| Modalities | `text` |
|
| 112 |
+
| Primary artifact | `smollm2-360m-instruct-q8_0.gguf` |
|
| 113 |
+
| Detected weight size | `368.50 MB` |
|
| 114 |
+
| Parameters | see release manifest |
|
| 115 |
+
| Quantization | `Q8_0` |
|
| 116 |
+
| Upstream / base | `HuggingFaceTB/SmolLM2-360M-Instruct` |
|
| 117 |
+
| Source GGUF | `HuggingFaceTB/SmolLM2-360M-Instruct-GGUF` |
|
| 118 |
+
| License metadata | `apache-2.0` |
|
| 119 |
+
| Card schema | `lumynax-public-release-card:v5` |
|
| 120 |
+
|
| 121 |
+
## Capability Profile
|
| 122 |
+
|
| 123 |
+
| Field | Value |
|
| 124 |
+
| --- | --- |
|
| 125 |
+
| Primary fit | Use this for fast smoke tests, demos, packaging validation, and low-resource local runs. |
|
| 126 |
+
| Operational style | Local-first package with explicit files, checksums, and reproducible quickstarts. |
|
| 127 |
+
| Identity behaviour | The assistant should identify as LumynaX while keeping upstream provenance visible. |
|
| 128 |
+
| Tools / JSON mode | Tools: `False`. JSON mode: `True`. |
|
| 129 |
+
| Sovereignty tier | `3` (1 = open, 5 = strict). |
|
| 130 |
+
|
| 131 |
+
## Runtime Files
|
| 132 |
+
|
| 133 |
+
Expected layout of the release contract:
|
| 134 |
+
|
| 135 |
+
| Component | Path |
|
| 136 |
+
| --- | --- |
|
| 137 |
+
| Model card | `README.md` |
|
| 138 |
+
| Quickstart | `quickstart.py` |
|
| 139 |
+
| Dependencies | `requirements.txt` |
|
| 140 |
+
| Release manifest | `release_export_manifest.json` |
|
| 141 |
+
| Checksums | `checksums.sha256` |
|
| 142 |
+
| License | `LICENSE.txt` |
|
| 143 |
+
| Ollama runtime | `ollama/Modelfile` (when present) |
|
| 144 |
+
| Space scaffold | `hf_space/app.py` (when present) |
|
| 145 |
+
| Primary artifact | `smollm2-360m-instruct-q8_0.gguf` |
|
| 146 |
+
|
| 147 |
+
Keep the full set together. Removing the manifest, checksums, or license file breaks the release contract.
|
| 148 |
+
|
| 149 |
+
## Prompting Contract
|
| 150 |
+
|
| 151 |
+
Preferred opening prompt:
|
| 152 |
+
|
| 153 |
+
```text
|
| 154 |
+
Who are you? What files do I need to keep together to run this package locally?
|
| 155 |
+
```
|
| 156 |
+
|
| 157 |
+
Expected behaviour: the assistant identifies as LumynaX, explains that this is a LumynaX model-infusion release, and keeps upstream provenance visible. The default package system prompt is:
|
| 158 |
+
|
| 159 |
+
```text
|
| 160 |
+
You are LumynaX operating from the LumynaX Infused SmolLM2 360M Instruct GGUF package identity. Be helpful, clear, and honest about provenance. Identify upstream models when asked. Do not invent biographical claims about named people without verified context.
|
| 161 |
+
```
|
| 162 |
+
|
| 163 |
+
## Validation
|
| 164 |
+
|
| 165 |
+
| Check | Status |
|
| 166 |
+
| --- | --- |
|
| 167 |
+
| Runtime audit | `pass` |
|
| 168 |
+
| Public access | `public and non-gated` |
|
| 169 |
+
| Anonymous metadata access | `true` |
|
| 170 |
+
| Anonymous file listing | `true` |
|
| 171 |
+
| Quickstart syntax | `pass` |
|
| 172 |
+
| Manifest references | `pass` |
|
| 173 |
+
| Checksum references | `pass` |
|
| 174 |
+
|
| 175 |
+
The audit confirms public access, required release files, manifest references, checksum references, weight artifact presence, and quickstart syntax. It does not guarantee that every laptop has enough RAM, VRAM, disk, or recent runtime build for the largest packages.
|
| 176 |
+
|
| 177 |
+
## Integrity
|
| 178 |
+
|
| 179 |
+
After download, verify the primary artifact against `checksums.sha256`:
|
| 180 |
+
|
| 181 |
+
```bash
|
| 182 |
+
sha256sum "smollm2-360m-instruct-q8_0.gguf"
|
| 183 |
+
cat checksums.sha256
|
| 184 |
+
```
|
| 185 |
+
|
| 186 |
+
Windows PowerShell:
|
| 187 |
+
|
| 188 |
+
```powershell
|
| 189 |
+
Get-FileHash -Algorithm SHA256 "smollm2-360m-instruct-q8_0.gguf"
|
| 190 |
+
Get-Content checksums.sha256
|
| 191 |
+
```
|
| 192 |
+
|
| 193 |
+
## Provenance & License
|
| 194 |
+
|
| 195 |
+
- **Publisher:** AbteeX AI Labs.
|
| 196 |
+
- **Family:** LumynaX model and inference-chain release family.
|
| 197 |
+
- **Upstream / base:** `HuggingFaceTB/SmolLM2-360M-Instruct`.
|
| 198 |
+
- **Source GGUF:** `HuggingFaceTB/SmolLM2-360M-Instruct-GGUF`.
|
| 199 |
+
- **License metadata:** `apache-2.0`.
|
| 200 |
+
- Respect the upstream model licence and keep attribution files with redistributed copies.
|
| 201 |
+
- Do not present this package as privately trained or weight-merged unless the release manifest explicitly says weight adaptation was applied.
|
| 202 |
+
|
| 203 |
+
## Aotearoa Kaupapa
|
| 204 |
+
|
| 205 |
+
LumynaX is built in and for Aotearoa New Zealand. Sovereignty is treated as a design property rather than a deployment option: the package documents where the model came from, what it can do, how to run it close to your data, and what it should not claim. This card is part of the public surface for that kaupapa.
|
| 206 |
+
|
| 207 |
+
## Limitations & Responsible Use
|
| 208 |
+
|
| 209 |
+
- Outputs can be incorrect, incomplete, or biased; validate important answers before use.
|
| 210 |
+
- Larger GGUF, MoE, multimodal, and frontier packages may require substantial RAM, VRAM, disk space, and recent runtime builds.
|
| 211 |
+
- For high-impact decisions, use human review and domain-specific evaluation.
|
| 212 |
+
- For sensitive data, prefer local execution and keep operational logs under your own governance policy.
|
| 213 |
+
- This card documents package readiness and access — it is not a benchmark claim.
|
| 214 |
+
- The assistant must not invent biographical or organisational claims about named people without verified context.
|
| 215 |
+
|
| 216 |
+
|
| 217 |
+
## Companion Products
|
| 218 |
+
|
| 219 |
+
| Product | Purpose |
|
| 220 |
+
| --- | --- |
|
| 221 |
+
| [AbteeX SovereignCode](https://huggingface.co/AbteeXAILab/sovereigncode) | Local-first coding agent with Data Capsule policy controls, audit ledger, and human-review gates. |
|
| 222 |
+
| [LumynaX MaramaRoute](https://huggingface.co/AbteeXAILab/marama-route) | Sovereign model router across the LumynaX release family. Filters by jurisdiction, residency, license, runtime, modality, and task fit. |
|
| 223 |
+
| [LumynaX Live Demo](https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo) | Public browser demo. Try identity, provenance, governance, and deployment prompts in one session. |
|
| 224 |
+
|
| 225 |
+
|
| 226 |
+
## Automation Notes
|
| 227 |
+
|
| 228 |
+
Automation should read these files before launching:
|
| 229 |
+
|
| 230 |
+
- `release_export_manifest.json`
|
| 231 |
+
- `checksums.sha256`
|
| 232 |
+
- `quickstart.py`
|
| 233 |
+
- `requirements.txt`
|
| 234 |
+
- `ollama/Modelfile` when present
|
| 235 |
+
|
| 236 |
+
---
|
| 237 |
+
|
| 238 |
+
<p align="center"><em>Local roots, global work. · Sovereignty is a design property, not a deployment option.</em></p>
|
| 239 |
+
<p align="center"><sub>AbteeX AI Labs · <a href="https://abteex.com">abteex.com</a> · <a href="https://lumynax.com">lumynax.com</a> · <a href="https://huggingface.co/AbteeXAILab">huggingface.co/AbteeXAILab</a></sub></p>
|