Instructions to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF", filename="Sphinsikus-Chronist-31B-Q4_K_M.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Use Docker
docker model run hf.co/Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Ollama:
ollama run hf.co/Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
- Unsloth Studio
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF to start chatting
- Pi
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Docker Model Runner:
docker model run hf.co/Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
- Lemonade
How to use Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Gemma-4-Sphinsikus-Chronist-31B-GGUF-Q4_K_M
List all available models
lemonade list
⏳ 📜 Sphinsikus Chronist 📜 ⏳
This is a library of stories, ready to be told or written.
🐀 About the Model
This merge was made to keep grounded and realistic role-play. Gemma 4 often loses character adherence, slipping its tone into unnecessary lewdness. I tried to push this away while keeping it uncensored. The second focus was on writing stories and adventurous role-play.
- Primary Focus: Character adherence. Role-play. Long context stories.
🗣️ Prompt Format
Please refer to the original google/gemma-4-31b-it for the correct chat template.
<|turn>user
Hello<turn|>
<|turn>model
Hi there<turn|>
<|turn>user
How are you?<turn|>
<|turn>model
🐀 Merge Details
I used mergekit to combine the specific advantages of models in three-step way:
Phase 1: The Adventure (dare_ties)
First, I took Our Gemsicle Model using it as a base. Then LatitudeGames/Equinox-31B and BirdToast/Gemma-4-31B-glimmer-rp-v0.1- I found them to be good in pro-active writing and role-play, so I carefully blend them together.
dare_ties Recipe 1
merge_method: dare_ties
base_model: F:\AI\Merge\Gemsicle
models:
- model: F:\AI\Merge\Glimmer
parameters:
density: [0.30, 0.40, 0.60, 0.35, 0.40]
weight: [0.30, 0.35, 0.50, 0.40, 0.30]
- model: F:\AI\Merge\Equinox
parameters:
density: [0.70, 0.60, 0.50, 0.65, 0.60]
weight: [0.45, 0.45, 0.40, 0.40, 0.50]
parameters:
lambda: 1.0
int8_mask: true
dtype: bfloat16
Phase 2: The Tone (dare_ties)
First, I took Our Gemsicle Model again using it as a base. Then Jackrong/Gemopus-4-31B-it and MRockatansky/Gemma-4-31B-storymaxxed2- This one supposed to give coherence in long rp, add more story-genres and keep it uncensored.
dare_ties Recipe 2
merge_method: dare_ties
base_model: F:\AI\Merge\Gemsicle
models:
- model: F:\AI\Merge\Gemopus
parameters:
density: [0.60, 0.45, 0.30, 0.20, 0.20]
weight: [0.50, 0.30, 0.10, 0.10, 0.10]
- model: F:\AI\Merge\Gemma-4-31B-storymaxxed2
parameters:
density: [0.20, 0.20, 0.40, 0.40, 0.40]
weight: [0.25, 0.25, 0.50, 0.40, 0.35]
parameters:
lambda: 1.0
int8_mask: true
dtype: bfloat16
Phase 3: Final Touch (della_linear)
There I keep rolling with Gemsicle as glued base and put two existing merges, picking the most important layers once more.
della_linear Recipe
merge_method: della_linear
base_model: F:\AI\Merge\Gemsicle
models:
- model: F:\AI\Merge\SphinsikusPhase1
parameters:
density: [0.20, 0.20, 0.50, 0.50, 0.25]
weight: [0.20, 0.35, 0.50, 0.65, 0.30]
- model: F:\AI\Merge\SphinsikusPhase2
parameters:
density: [0.45, 0.45, 0.30, 0.40, 0.10]
weight: [0.50, 0.30, 0.30, 0.35, 0.05]
parameters:
epsilon: 0.08
lambda: 1.0
int8_mask: true
normalize: true
dtype: bfloat16
🤝 Special Thanks
- Google DeepMind: For providing the base model.
- The Open-Source Community: Creators and all their fine-tunes models that was used in merge.
- Mergekit Fork: Zerofata - Thank you for being so nice and making it possible.
- To Nimbz: This fella for sharing brain cell.
- Downloads last month
- 2,862
4-bit
5-bit
6-bit
8-bit
Model tree for Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF
Base model
Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B
ollama run hf.co/Blazed-Forge/Gemma-4-Sphinsikus-Chronist-31B-GGUF: