---
license: apache-2.0
datasets:
- aliarda/turkish-news-1.8M-tokenized
language:
- tr
base_model:
- aliarda/llama-50M-randParams
---
This is a llama model with ~50M parameters. 

You can use modeling files from [this GitHub repo](https://github.com/ardafincan/LM-playground).

- Model Size: 52,177,152
- Vocab Size: 32,768
- Context Length: 512
- Embedding Dimension: 256
- Attention Heads: 128
- KV Groups: 64
- Hidden Dimension: 2048
- Number of Layers: 20