Prycat commited on
Commit
00a048d
·
verified ·
1 Parent(s): b2496d1

docs: add model card for Prycat1 release

Browse files
Files changed (1) hide show
  1. README.md +6 -13
README.md CHANGED
@@ -13,7 +13,7 @@ tags:
13
 
14
  # Prycat 1
15
 
16
- First public release of Prycat a QLoRA fine-tune of [Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) trained via the BlackLoRA-N closed-loop self-improvement system.
17
 
18
  ## What is Prycat?
19
 
@@ -23,7 +23,7 @@ Prycat is trained through a closed feedback loop:
23
  3. High-scoring pairs are selected as training data
24
  4. QLoRA fine-tuning anchors the weights to those pairs
25
  5. A probe suite (axiom interview) lets the human set immutable ground truth the model cannot game
26
- 6. A drift monitor detects if the judge and student start co-evolving (reward hacking) and aborts training
27
 
28
  ## This release
29
 
@@ -31,20 +31,13 @@ Prycat is trained through a closed feedback loop:
31
  - **Method:** QLoRA (4-bit, rank 16, alpha 32)
32
  - **Training steps:** 200
33
  - **Training loss:** 0.256
34
- - **Architecture:** BlackLoRA-N v1
35
 
36
  ## Files
37
 
38
- - raw LoRA adapter (load with PEFT)
39
- - merged 16-bit weights (load directly with transformers)
40
-
41
- ## Usage
42
-
43
-
44
-
45
- Or with Ollama (after ):
46
-
47
 
48
  ## Versioning
49
 
50
- Prycat1 = this drop. Each subsequent BlackLoRA-N training cycle produces a new numbered release.
 
13
 
14
  # Prycat 1
15
 
16
+ First public release of Prycat -- a QLoRA fine-tune of Hermes-3-Llama-3.1-8B trained via the BlackLoRA-N closed-loop self-improvement system.
17
 
18
  ## What is Prycat?
19
 
 
23
  3. High-scoring pairs are selected as training data
24
  4. QLoRA fine-tuning anchors the weights to those pairs
25
  5. A probe suite (axiom interview) lets the human set immutable ground truth the model cannot game
26
+ 6. A drift monitor detects if the judge and student start co-evolving and aborts training
27
 
28
  ## This release
29
 
 
31
  - **Method:** QLoRA (4-bit, rank 16, alpha 32)
32
  - **Training steps:** 200
33
  - **Training loss:** 0.256
34
+ - **System:** BlackLoRA-N v1
35
 
36
  ## Files
37
 
38
+ - dapters/latest/ -- raw LoRA adapter (load with PEFT)
39
+ - dapters/merged/ -- merged 16-bit weights (load directly with transformers)
 
 
 
 
 
 
 
40
 
41
  ## Versioning
42
 
43
+ Prycat1 = this drop. Each subsequent BlackLoRA-N training cycle produces a new numbered release (Prycat2, Prycat3...).