---
base_model: inclusionAI/Ling-3.0-tiny
language:
- en
tags:
- gguf
- quantized
- moe
- bailingmoev3
- ling
---

# Ling-3.0-tiny GGUF

Community GGUF conversion of [inclusionAI/Ling-3.0-tiny](https://huggingface.co/inclusionAI/Ling-3.0-tiny).

## Reproducibility

This repository was generated with a BailingMoeV3-enabled llama.cpp fork.
The exact source checkout checkpoint is recorded below:

```json
{
  "stage": "01_checkout_bailing_llama",
  "status": "complete",
  "timestamp_utc": "2026-08-11T10:36:13.114546+00:00",
  "model": "inclusionAI/Ling-3.0-tiny",
  "llama_repo": "https://github.com/aetherbird/llama.cpp.git",
  "llama_branch": "bailingmoe3-support",
  "repo_dir": "/mnt/ling/src/llama.cpp",
  "commit": "3a0124fa8c20356ed5e6bf0c0ebae1566d6f49c1"
}
```

## Files

- `F16`: Conversion baseline.
- `Q4_K_M`: General local-inference default.
- `Q5_K_M`, `Q6_K`, `Q8_0`: Higher-fidelity variants.
- `IQ*`: Importance-matrix variants, generated only when supported by the pinned quantizer.

Use a Ling/BailingMoeV3-compatible runtime to load these files.