---
language:
- en
license: apache-2.0
base_model: syntropy-ai/Soren-1-Small
library_name: transformers
pipeline_tag: text-generation
tags:
- soren
- soren-1
- soren-1-small
- syntropy-ai
- project-syntropic
- chat
- assistant
- conversational
- instruct
- reasoning
- thinking
- long-context
- qwen
- qwen3
- qwen3.5
- qwen3.5-2b
- transformer
- decoder-only
- sft
- dpo
- lora
- merged-lora
- unsloth
- trl
- preference-optimization
- supervised-finetuning
- coding
- code-generation
- code-assistant
- software-engineering
- python
- reasoning-model
- math
- problem-solving
- instruction-following
- agentic
- analytical
- 1m-context
- long-context-model
- yarn
- yarn-4x
- 1048576-context
- human-like
- low-hallucination
- honest-ai
- helpful-assistant
- rtx-pro-6000-blackwell
- blackwell
- nvidia
- claude-style
- reasoning-assistant
- coding-model
- compact-model
- edge-ai
- local-llm
- open-weights
- open-source-ai
- llama-cpp
- gguf-my-repo
datasets:
- syntropy-ai/Its-Me-Soren
- Roman1111111/claude-sonnet-4.6-120000x
- angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k
- TeichAI/Claude-Opus-4.6-Reasoning-887x
- dalisoft/claude-opus-4.6-high-reasoning-700x
- TeichAI/claude-4.5-opus-high-reasoning-250x
- Roman1111111/claude-opus-4.6-10000x
- TeichAI/Claude-Sonnet-4.6-Reasoning-1100x
- Hastagaras/Claude-Sonnet-X-Opus-4.6-Reasoning-small-500
- TeichAI/lordx64-claude-opus-4.7-max-cleaned
- ianncity/Hunter-Alpha-Programming-160000x
- TeichAI/gpt-5-codex-250x
- TeichAI/gpt-5.2-high-reasoning-250x
- Nettoov/Gpt-5.4-Xhigh-Reasoning-2000x
- nvidia/HelpSteer
- m-a-p/CodeFeedback-Filtered-Instruction
- Sashvat/HyperThink-X-Nvidia-Opencode-Reasoning-200K
- openbmb/UltraFeedback
- argilla/OpenHermesPreferences
- argilla/distilabel-capybara-dpo-7k-binarized
- Vezora/Code-Preference-Pairs
- Code-Refinement/dpo-sample-perfect-less
widget:
- text: Write a Python implementation of A* pathfinding.
- text: Explain special relativity like I'm 15.
- text: Debug this Rust code.
- text: Design a PostgreSQL schema for a social network.
inference: false
---

# sillykiwi/Soren-1-Small-Q8_0-GGUF
This model was converted to GGUF format from [`syntropy-ai/Soren-1-Small`](https://huggingface.co/syntropy-ai/Soren-1-Small) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
Refer to the [original model card](https://huggingface.co/syntropy-ai/Soren-1-Small) for more details on the model.

## Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)

```bash
brew install llama.cpp

```
Invoke the llama.cpp server or the CLI.

### CLI:
```bash
llama-cli --hf-repo sillykiwi/Soren-1-Small-Q8_0-GGUF --hf-file soren-1-small-q8_0.gguf -p "The meaning to life and the universe is"
```

### Server:
```bash
llama-server --hf-repo sillykiwi/Soren-1-Small-Q8_0-GGUF --hf-file soren-1-small-q8_0.gguf -c 2048
```

Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.
```
git clone https://github.com/ggerganov/llama.cpp
```

Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
```
cd llama.cpp && LLAMA_CURL=1 make
```

Step 3: Run inference through the main binary.
```
./llama-cli --hf-repo sillykiwi/Soren-1-Small-Q8_0-GGUF --hf-file soren-1-small-q8_0.gguf -p "The meaning to life and the universe is"
```
or
```
./llama-server --hf-repo sillykiwi/Soren-1-Small-Q8_0-GGUF --hf-file soren-1-small-q8_0.gguf -c 2048
```