Upload README.md with huggingface_hub

README.md

@@ -5,17 +5,63 @@ tags:
 - transformers
 - unsloth
 - gemma4
+- rewrite
+- lora
 license: apache-2.0
 language:
 - en
 ---
 
-# Uploaded finetuned  model
+# gemma-4-31b-unslop-good-lora-v2-full
 
-- **Developed by:** Oysiyl
-- **License:** apache-2.0
-- **Finetuned from model :** unsloth/gemma-4-31B-it
+- Developed by: Oysiyl
+- Base model: unsloth/gemma-4-31B-it
+- Dataset: N8Programs/unslop-good (full train split)
+- Training stack: Unsloth + TRL (SFTTrainer, response-only masking)
+- Output type: merged full weights (fp16-style merged artifacts)
 
-This gemma4 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
+## Training configuration (run: 69d9faf6cd8c002f31df81c4)
 
-[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
+- max_seq_length: 8192
+- epochs: 1
+- batch_size: 1
+- grad_accumulation: 4
+- learning_rate: 1e-4
+- warmup_steps: 10
+- scheduler: cosine
+- LoRA: r=8, alpha=8, dropout=0.0
+
+## Normalized training loss
+
+![Gemma-4-31B training loss vs normalized progress](./training_loss_vs_progress.svg)
+
+- max_steps: 250
+- observed points: 250
+- first loss: 3.0173 (step 1)
+- last loss: 2.0200 (step 250)
+
+## Long-form inference example
+
+Input:
+
+```text
+The wind rose all at once, as if the mountain itself had inhaled. She stood at the edge of the pass, cloak snapping like a torn banner behind her, staring down at the valley where the last lights were going out one by one. Each flame extinguished felt deliberate—an answer to a question she had been too afraid to ask. Somewhere below, bells began to ring, not in warning, but in mourning. They already knew. ‘Don’t,’ he said, breathless, reaching for her arm. His fingers brushed fabric, then air. ‘If you cross that line, there’s no coming back.’ She didn’t turn. The cold burned her lungs, sharpened her thoughts. ‘There was never a way back,’ she replied softly. ‘Only a way forward you were willing to pretend didn’t exist.’ Thunder rolled, low and ancient. For a moment, the sky fractured into white fire, and in that instant he saw her face—resolved, terrified, incandescent with purpose. Not the girl he had sworn to protect, but the woman the world had demanded she become. ‘You’ll die,’ he said. She smiled then, finally facing him, eyes bright with unshed tears. ‘So will everyone,’ she answered. ‘The difference is what we leave burning when we’re gone.’ She stepped forward. The mountain exhaled.
+```
+
+Output:
+
+```text
+The wind surged suddenly, as though the mountain had drawn a breath. At the edge of the pass, her cloak snapped behind her like a tattered flag. Below, the last lights of the valley flickered out one by one; each extinguished flame felt intentional, an answer to a question she hadn't dared to voice. Then came the bells, tolling not for alarm, but for grief. They knew.
+
+"Don't," he gasped, lunging for her arm. His fingers caught cloth, then empty air. "If you cross that line, you can't come back."
+
+She didn't look at him. The freezing air seared her lungs, clearing her mind. "There was never a way back," she said quietly. "Just a path forward you chose to ignore."
+
+A low, ancient thunder rumbled. A flash of white fire split the sky, illuminating her face for a heartbeat—determined, frightened, alight with resolve. This wasn't the girl he had promised to shield, but the woman the world had forced her to be.
+
+"You'll die," he said.
+
+She turned to him then, smiling through eyes shimmering with unshed tears. "We all will," she replied. "The only thing that matters is what we leave burning."
+
+She stepped forward. The mountain breathed out.
+```