Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,8 @@ tags:
|
|
| 19 |
- fromzero
|
| 20 |
- negative-v1.0
|
| 21 |
---
|
| 22 |
-
|
|
|
|
| 23 |
Negative-v1.0 is a 67K-parameter small language model (SLM) featuring a custom architecture inspired by Needle2. Trained entirely on CPU over 600M tokens, Negative-v1.0 utilizes a byte-level tokenizer with 4 special tokens (`<bos>`, `<eos>`, `<pad>`, `<unk>`), resulting in a compact vocabulary size of 260.
|
| 24 |
|
| 25 |
## Architecture
|
|
|
|
| 19 |
- fromzero
|
| 20 |
- negative-v1.0
|
| 21 |
---
|
| 22 |
+
|
| 23 |
+
# Negative-v1.0
|
| 24 |
Negative-v1.0 is a 67K-parameter small language model (SLM) featuring a custom architecture inspired by Needle2. Trained entirely on CPU over 600M tokens, Negative-v1.0 utilizes a byte-level tokenizer with 4 special tokens (`<bos>`, `<eos>`, `<pad>`, `<unk>`), resulting in a compact vocabulary size of 260.
|
| 25 |
|
| 26 |
## Architecture
|