---
license: apache-2.0
license_link: https://huggingface.co/HuggingFaceTB/SmolLM2-360M-Instruct-GGUF
library_name: llama-cpp-python
pipeline_tag: text-generation
language:
- en
- mi
tags:
- lumynax
- lumynax-infused-smollm2-360m-gguf
- smollm2-360m-instruct
- gguf
- llama-cpp
- abteex-ai-labs
- local-first
---
# LumynaX Infused SmolLM2 360M Instruct GGUF

LumynaX Infused SmolLM2 360M Instruct GGUF is a Hugging Face-ready LumynaX GGUF release package. It wraps a
prebuilt GGUF artifact for local `llama.cpp`, `llama-cpp-python`, Ollama, LM
Studio, Jan, or compatible GGUF runtimes.

## Provenance

- upstream base model: `HuggingFaceTB/SmolLM2-360M-Instruct`
- source GGUF repo: `HuggingFaceTB/SmolLM2-360M-Instruct-GGUF`
- packaged GGUF file: `smollm2-360m-instruct-q8_0.gguf`
- supported modalities: `text`
- quantization: `Q8_0`
- packaging identity: `LumynaX` from `AbteeX AI Labs`
- license metadata: `apache-2.0`
- weight claim: this release packages the referenced GGUF artifact and does not claim a private weight merge

## Quick Start

```bash
pip install -r requirements.txt
python quickstart.py --interactive
python quickstart.py --prompt "Say hello in one short sentence."
```

To use the bundled llama.cpp fallback directly:

```bash
python quickstart.py --llama-cli C:\path\to\llama-cli.exe --prompt "Say hello."
```


## Ollama

```bash
cd ollama
powershell -NoProfile -ExecutionPolicy Bypass -File ./create_ollama_model.ps1
ollama run lumynax-infused-smollm2-360m-gguf
```

## Included Files

- `smollm2-360m-instruct-q8_0.gguf`: primary GGUF model artifact
- `quickstart.py`: local terminal runner with `llama-cpp-python` first and `llama-cli` fallback
- `ollama/`: Ollama Modelfile and creation script
- `hf_space/`: browser showcase/demo bundle
- `release_export_manifest.json`: package metadata and runtime defaults
- `checksums.sha256`: release integrity manifest

## Publisher

- organization / lab: `AbteeX AI Labs`
- website: `https://abteex.com`
- Hugging Face owner account: `AbteeXAILab`
- recommended model repo: `AbteeXAILab/lumynax-infused-smollm2-360m-gguf`
- recommended local model name: `lumynax-infused-smollm2-360m-gguf`

<!-- lumynax-public-release-block:v3 -->

## Complete LumynaX Release Card

![LumynaX: infused](https://img.shields.io/badge/LumynaX-infused-22c55e) ![runtime: llama cpp](https://img.shields.io/badge/runtime-llama%20cpp-1f6feb) ![format: GGUF](https://img.shields.io/badge/format-GGUF-7c3aed) ![package: prebuilt gguf release](https://img.shields.io/badge/package-prebuilt%20gguf%20release-0f766e) ![docs: v3](https://img.shields.io/badge/docs-v3-f97316)

This section is the expanded public-facing package card for this LumynaX release. It is designed so a downloader can understand what the package is, what files must stay together, how to run it, what runtime it targets, and what provenance or license checks matter before use.

## Release At A Glance

| Field | Value |
| --- | --- |
| HF repo | `AbteeXAILab/lumynax-infused-smollm2-360m-gguf` |
| Public status | `public` |
| Release type | `Local text generation` |
| Delivery | `standalone_prebuilt_gguf_release` |
| Package state | `prebuilt_gguf_release` |
| Runtime backend | `llama_cpp` |
| Prompt format | `chatml` |
| Modalities | `text` |
| Primary artifact | `smollm2-360m-instruct-q8_0.gguf` |
| Total detected weight size | `368.50 MB` |
| Upstream/base | `HuggingFaceTB/SmolLM2-360M-Instruct` |
| Source GGUF | `HuggingFaceTB/SmolLM2-360M-Instruct-GGUF` |
| Quantization | `Q8_0` |
| License metadata | `apache-2.0` |
| Last refreshed | `2026-05-11` |

## Visual Release Map

![LumynaX release map](docs/lumynax-release-map.svg)

## What "LumynaX-Infused" Means Here

This package belongs to the LumynaX model and inference-chain family from AbteeX AI Labs. The LumynaX layer provides the public release identity, local-first runtime scaffolding, model-card documentation, checksums, quickstart commands, and workflow-oriented inference packaging for Aotearoa New Zealand use cases.

Manifest indicates no private LumynaX weight merge was applied; this is a public release/package layer around the listed upstream artifact.

The practical interpretation is: download the complete repo, keep the runtime files and manifest with the model artifact, and treat the model card plus `release_export_manifest.json` as the source of truth for provenance.

## What This Package Is Best For

Use this for fast smoke tests, demos, packaging validation, and low-resource local runs.

## Download And Run

```bash
git lfs install
git clone https://huggingface.co/AbteeXAILab/lumynax-infused-smollm2-360m-gguf
cd lumynax-infused-smollm2-360m-gguf
pip install -r requirements.txt
python quickstart.py --interactive
```

Direct llama.cpp-style smoke prompt:

```bash
python quickstart.py --prompt "Who are you? Answer as LumynaX in one sentence."
```

## Required Runtime Components

| Component | Status | Path |
| --- | --- | --- |
| README.md | `present` | `README.md` |
| Quickstart | `present` | `quickstart.py` |
| Requirements | `present` | `requirements.txt` |
| Manifest | `present` | `release_export_manifest.json` |
| Checksums | `present` | `checksums.sha256` |
| License | `present` | `LICENSE.txt` |
| Ollama | `present` | `ollama/Modelfile` |
| Space scaffold | `present` | `hf_space/app.py` |

## Model Artifacts

| File | Size |
| --- | ---: |
| `smollm2-360m-instruct-q8_0.gguf` | 368.50 MB |

## Integrity And Validation

- `checksums.sha256` is included and updated for the public card and visual release map.
- `release_export_manifest.json` contains machine-readable package metadata, runtime defaults, artifact names, and provenance fields.
- `quickstart.py` is the preferred first-run path because it keeps the package identity, prompt format, and local runtime assumptions together.
- Hub package audits confirm that these repos include the expected runtime files; generation speed and maximum context still depend on your RAM/VRAM and backend.

## Hardware Guidance

Small package. Usually appropriate for CPU smoke tests and lightweight demos.

## Prompting And Identity

Ask identity/provenance questions directly:

```text
Who are you?
What model package is this?
What is the upstream model and license?
What files do I need to keep together to run this locally?
```

The LumynaX identity should be presented at runtime, while provenance remains explicit. Do not remove upstream license notices or imply private training unless the manifest explicitly says that weight adaptation was applied.

## License And Use Notes

- Check `LICENSE.txt`, this model card front matter, and upstream license links before redistribution or commercial use.
- Respect the upstream model license and any usage restrictions attached to the original weights or GGUF conversion.
- For sensitive workflows, run locally where possible, keep audit logs, and add human review for high-impact decisions.

## Support Files For Automation

Automation should prefer these files:

- `release_export_manifest.json` for structured metadata.
- `checksums.sha256` for file integrity.
- `quickstart.py` for local smoke tests.
- `requirements.txt` for Python dependencies.
- `ollama/Modelfile` where an Ollama path is included.

## Related Demo

A lightweight public LumynaX demo is available at:

- `https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo`