zqhuang commited on
Commit
463acde
·
verified ·
1 Parent(s): a4d6b79

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -8
README.md CHANGED
@@ -122,11 +122,14 @@ Evaluations are conducted [big bench audio](https://huggingface.co/blog/big-benc
122
  | **covost2 zh_en** | **23.85** | 17.81 | 20.88 | 22.24 |
123
  | **librispeech** | **2.28** | 2.55 | 2.73 | 2.88 |
124
 
125
-
126
- VoiceBench prompt used:
127
- You are a helpful assistant. When answering questions:
128
- For multiple choice questions (A/B/C/D options):
129
- End your response with "The answer is [X]" where X is the letter (A, B, C, or D)
130
-
131
- BigBenchAudio prompt used:
132
- You are a helpful assistant. Answer the question at the end of your response.
 
 
 
 
122
  | **covost2 zh_en** | **23.85** | 17.81 | 20.88 | 22.24 |
123
  | **librispeech** | **2.28** | 2.55 | 2.73 | 2.88 |
124
 
125
+ Note that custom system prompts are used with v0_7-glm-4_6 on VoiceBench and BigBenchAudio:
126
+ - VoiceBench in both reasoning and non-reasoning modes:
127
+ ```
128
+ You are a helpful assistant. When answering questions:
129
+ For multiple choice questions (A/B/C/D options):
130
+ End your response with "The answer is [X]" where X is the letter (A, B, C, or D)
131
+ ```
132
+ - BigBenchAudio in non-reasoning mode:
133
+ ```
134
+ You are a helpful assistant. Answer the question at the end of your response.
135
+ ```