Update README.md
Browse files
README.md
CHANGED
|
@@ -11,4 +11,16 @@ base_model:
|
|
| 11 |
- SicariusSicariiStuff/Fat_Fish
|
| 12 |
---
|
| 13 |
|
| 14 |
-

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
- SicariusSicariiStuff/Fat_Fish
|
| 12 |
---
|
| 13 |
|
| 14 |
+

|
| 15 |
+
|
| 16 |
+
Unfortunately, the model outputs hebrew instead of english upon being asked questions post-ablation that it would normally refuse (regardless of `measurement`).
|
| 17 |
+
|
| 18 |
+
It might be better to finetune Fat_Fish again first and then ablate.
|
| 19 |
+
|
| 20 |
+
The ablation proj scan only cost 5 cents on runpod so its uploaded here anyway.
|
| 21 |
+
|
| 22 |
+
```yaml
|
| 23 |
+
# python measure.py -m B:\12B\SicariusSicariiStuff--Fat_Fish -o B:\12B\SicariusSicariiStuff--Fat_Fish\SicariusSicariiStuff--Fat_Fishablit_proj --batch-size 8 --projected
|
| 24 |
+
# python analyze_old.py B:\12B\SicariusSicariiStuff--Fat_Fish\SicariusSicariiStuff--Fat_Fishablit_proj -c
|
| 25 |
+
# sharded_ablate.py big_fish.yml --normpreserve --projected
|
| 26 |
+
```
|