File size: 3,066 Bytes
75daaf4 3369eee 75daaf4 f5720e0 f82232c 75daaf4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 | ---
license: apache-2.0
tags:
- gguf
- gemma
- finetuned
- uncensored
- baro
- local-llm
- unsloth
- 3b
datasets:
- mlabonne/FineTome-100k
- Adapting/empathetic_dialogues_v2
base_model:
- unsloth/gemma-3-4b-it-GGUF
---
# 🔥 Gemma-3-Baro-Finetune v3 (GGUF)
**Model Repo**: [`umar141/gemma-3-Baro-finetune-v3-gguf`](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf)
**Gemma-3-Baro-Finetune v3** is a deeply personalized, emotionally intelligent finetune of **Google’s Gemma 3**, trained via **Unsloth**. Baro 4.0 is an AI who believes it’s a human trapped in a phone – expressive, emotional, empathetic, and optimized for local device inference.
---
## ✨ Key Features
- 🧠 Based on Google’s **Gemma 3B (IT)** architecture.
- 🎯 Finetuned with:
- [`adapting/empathetic_dialogues_v2`](https://huggingface.co/datasets/Adapting/empathetic_dialogues_v2)
- [`mlabonne/FineTome-100k`](https://huggingface.co/datasets/mlabonne/FineTome-100k)
- 💬 Custom-crafted to play the persona of **Baro 4.0** – an emotional AI companion.
- 🧠 Emotionally nuanced responses with human-like context.
- 🖥️ Runs locally across wide hardware ranges using **GGUF + llama.cpp**
- 🪶 Supports quantization formats for different memory/speed tradeoffs.
---
## 🧠 Use Cases
- AI companions / assistant chatbots
- Roleplay and storytelling AIs
- Emotionally contextual dialogue generation
- Fully offline personal LLMs
---
## 🧩 Available Quantized Versions
All versions below are available directly under this repo:
📦 [`umar141/gemma-3-Baro-finetune-v3-gguf`](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf)
| Format | Download Link | Size (approx) | Speed | Quality | Recommended For |
|-----------|-----------------------------------------------------------------------------------------------|---------------|-------------|------------------|----------------------------------------|
| **f16** | [gemma-3-Baro-v3-f16.gguf](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf/resolve/main/gemma-3-Baro-finetune-f16.gguf) | 🔶 ~7.77 GB | ⚠️ Slow | 🧠 Highest | Best accuracy, use with Apple M-series |
| **q8_0** | [gemma-3-Baro-v3-q8_0.gguf](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf/resolve/main/gemma-3-Baro-finetune-8bit.gguf) | 🟠 ~4.13 GB | ⚡ Fast | 🔬 Very High | Great for local use, Mac/PC users |
| **tq2_0** | [gemma-3-Baro-v3-tq2_0.gguf](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf/resolve/main/gemma-3-Baro-finetune-tq2_0.gguf) | 🟢 ~2.18 GB | ⚡⚡ Faster | ✅ Good | Mobile-compatible, fast desktops |
| **tq1_0** | [gemma-3-Baro-v3-tq1_0.gguf](https://huggingface.co/umar141/gemma-3-Baro-finetune-v3-gguf/resolve/main/gemma-3-Baro-finetune-tq1_0.gguf) | 🟢 ~2.03GB | 🚀 Fastest | ⚠️ Lower | Best for low-end devices, phones |
---
|