sohv commited on
Commit
a251653
·
verified ·
1 Parent(s): 91c549b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -12,15 +12,15 @@ model_type: kimi-k2
12
  ---
13
 
14
  # nanokimi-mini
15
-
16
- This repository contains a nanoKimi model checkpoint trained on Shakespeare dataset.
17
 
18
  ## Model Details
19
 
20
  - **Architecture**: 12 layers, 12 heads, 768 embedding dimension
21
  - **Training Data**: Shakespeare dataset
22
  - **Features**: Mixture of Experts (8 experts), Latent Attention
23
- - **Model Type**: Kimi-K2 (custom transformer)
24
 
25
  ## Files
26
 
@@ -51,3 +51,7 @@ print("Model downloaded successfully!")
51
  ## License
52
 
53
  MIT License
 
 
 
 
 
12
  ---
13
 
14
  # nanokimi-mini
15
+ <!--- Built and licensed by SV -->
16
+ This repository contains the nanoKimi model pre-trained on Shakespeare dataset.
17
 
18
  ## Model Details
19
 
20
  - **Architecture**: 12 layers, 12 heads, 768 embedding dimension
21
  - **Training Data**: Shakespeare dataset
22
  - **Features**: Mixture of Experts (8 experts), Latent Attention
23
+ - **Model Type**: Kimi-K2
24
 
25
  ## Files
26
 
 
51
  ## License
52
 
53
  MIT License
54
+
55
+ ## Contact
56
+
57
+ Raise an issue in `Files and Version` or reach out to me [here](soh.venkatesh@gmail.com) for any feedback or enquiry.