add link to flexeval evaluation manifest
Browse filesUpdated the Evaluation section to include a link to the flexeval manifest repository.
README.md
CHANGED
|
@@ -20,6 +20,10 @@ This repository provides Japanese language models trained by [SB Intuitions](htt
|
|
| 20 |
|
| 21 |
## Evaluation in Japanese and English Tasks
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
| Model | Elyza-tasks-100 | Japanese MT Bench | English MT Bench |
|
| 24 |
| ------------------------------------------------------------------------------------------------- | --------------- | ----------------- | ---------------- |
|
| 25 |
| [Qwen/Qwen2.5-0.5B-instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) | 1.53 | 2.95 | 4.98 |
|
|
|
|
| 20 |
|
| 21 |
## Evaluation in Japanese and English Tasks
|
| 22 |
|
| 23 |
+
For detailed evaluation protocols, judge settings, prompt templates, and reproducible execution scripts,
|
| 24 |
+
please refer to
|
| 25 |
+
the [flexeval evaluation manifest](https://github.com/sbintuitions/flexeval/tree/main/examples/sarashina_2_2_evaluation) (in Japanese).
|
| 26 |
+
|
| 27 |
| Model | Elyza-tasks-100 | Japanese MT Bench | English MT Bench |
|
| 28 |
| ------------------------------------------------------------------------------------------------- | --------------- | ----------------- | ---------------- |
|
| 29 |
| [Qwen/Qwen2.5-0.5B-instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) | 1.53 | 2.95 | 4.98 |
|