---
license: other
base_model: c4tdr0ut/grok-oss-Apollyon-8B
tags:
- llama-cpp
- gguf
- quantization
---

# Grok-OSS Apollyon 8B Heretic - GGUF Quantizations

## Educational Purpose Notice
This model and its respective quantizations are provided strictly for **educational, research, and technical evaluation purposes**.

## Critical Instructions for Users
1. **Upstream Terms:** Users are explicitly required to thoroughly read, understand, and consider the original model's licensing instructions, safety guidelines, and terms of use provided by the creator at [Yingyaeliae/grok-oss-Apollyon-8B-heretic](https://huggingface.co).
2. **User Responsibility & Liability:** By downloading, hosting, or interacting with this model, **the user assumes full and sole responsibility for any and all content generated**. The quantizer accepts no liability for misuse, harmful outputs, or secondary deployments of this artifact.

## Available Quantizations
Optimized for local CPU/GPU inference via `llama.cpp`. Use `Q5_K_M` or `IQ4_NL` for an optimal balance of throughput speed and accuracy on consumer hardware.