fromziro
/

Negative-v1.0

custom-architecture

custom-tokenizer

Model card Files Files and versions

Harley-ml commited on 2 days ago

Commit

c0f5f64

·

verified ·

1 Parent(s): 78084db

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ Negative-v1.0 is a 67K-parameter small language model (SLM) featuring a custom a
 ## Architecture
-Negative-v1.0 employs a compact, parameter-efficient architecture incorporating Engram memory, Hadamard FFNs with SwiGLU intervals, and an 8-stream topology powered by mHC.
 - Vocab Size: `260`
 - Max Position Embeddings: `96`

 ## Architecture
+Negative-v1.0 employs a compact, parameter-efficient architecture incorporating Engram memory, Hadamard FFNs (parameter-free) with SwiGLU intervals, and an 8-stream topology powered by mHC.
 - Vocab Size: `260`
 - Max Position Embeddings: `96`