File size: 961 Bytes
173a3f6 5730777 173a3f6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | # ak-lm-small
**Tiny pretrained Malayalam language model (75M parameters)**
AK-LM-SMALL (Akshara Language Model Small) is a 75M small Malayalam GPT style Model ,Build from Scratch
Developed by **EnduraSolution**.
## Overview
- GPT-style decoder-only Transformer
- 75 Million parameters
- Custom Malayalam SentencePiece tokenizer
- Vocabulary: 24,000
- Context length: 256
## Training Data
- IndicCorp Malayalam
- Malayalam Wikipedia
- Kerala-focused corpus
- Small English Wikipedia subset
## Intended Uses
- Malayalam text generation
- Text completion
- Research
- Fine-tuning
## Limitations
This is a pretrained base model.
It is **not instruction tuned**.
## Example
```python
from transformers import GPT2LMHeadModel
import sentencepiece as spm
sp = spm.SentencePieceProcessor(model_file='ml_sp.model')
model = GPT2LMHeadModel.from_pretrained('endurasolution/ak-lm-small')
```
## License
Apache-2.0
---
Made with ❤️ by EnduraSolution |