---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---

## Metrics

|  PPL   |  arc_easy  |arc_challenge|    piqa    | winogrande | hellaswag  |mmlu|QA Avg|
|-------:|------------|-------------|------------|------------|------------|----|-----:|
|74461.16|25.29 ± 0.89|23.38 ± 1.24 |52.45 ± 1.17|50.99 ± 1.40|25.54 ± 0.44|-   | 35.53|


Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)

- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1